• “Interpretability Will Not Reliably Find Deceptive AI” by Neel Nanda

  • May 5 2025
  • Length: 13 mins
  • Podcast

“Interpretability Will Not Reliably Find Deceptive AI” by Neel Nanda

  • Summary

  • (Disclaimer: Post written in a personal capacity. These are personal hot takes and do not in any way represent my employer's views.)

    TL;DR: I do not think we will produce high reliability methods to evaluate or monitor the safety of superintelligent systems via current research paradigms, with interpretability or otherwise. Interpretability seems a valuable tool here and remains worth investing in, as it will hopefully increase the reliability we can achieve. However, interpretability should be viewed as part of an overall portfolio of defences: a layer in a defence-in-depth strategy. It is not the one thing that will save us, and it still won’t be enough for high reliability.

    Introduction

    There's a common, often implicit, argument made in AI safety discussions: interpretability is presented as the only reliable path forward for detecting deception in advanced AI - among many other sources it was argued for in [...]

    ---

    Outline:

    (00:55) Introduction

    (02:57) High Reliability Seems Unattainable

    (05:12) Why Won't Interpretability be Reliable?

    (07:47) The Potential of Black-Box Methods

    (08:48) The Role of Interpretability

    (12:02) Conclusion

    The original text contained 5 footnotes which were omitted from this narration.

    ---

    First published:
    May 4th, 2025

    Source:
    https://www.lesswrong.com/posts/PwnadG4BFjaER3MGf/interpretability-will-not-reliably-find-deceptive-ai

    ---

    Narrated by TYPE III AUDIO.

    Show More Show Less
activate_mytile_page_redirect_t1

What listeners say about “Interpretability Will Not Reliably Find Deceptive AI” by Neel Nanda

Average Customer Ratings

Reviews - Please select the tabs below to change the source of reviews.

In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.