The Future of Empirical Research in the Age of AI cover art

The Future of Empirical Research in the Age of AI

The Future of Empirical Research in the Age of AI

Listen for free

View show details

About this listen

In this episode, we sit down with Stanford political scientist Andy Hall and PhD candidate Graham Straus to unpack their new paper, “How Accurately Did Claude Code Replicate and Extend a Published Political Science Paper?” — an empirical audit of what happens when an AI agent is asked to replicate and extend a real research project.

Last January, Andy asked Claude Code to generate an extension of an existing empirical political science paper in under an hour. The results were surprising: Claude correctly replicated the original estimates exactly and collected new data with very high accuracy. But did Claude make mistakes? Straus independently audited Claude’s work to see how accurate, reliable, and scientifically sound it really was.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.