20250815 - AI ‘chain of thought’ still just a ‘brittle mirage’ cover art

20250815 - AI ‘chain of thought’ still just a ‘brittle mirage’

20250815 - AI ‘chain of thought’ still just a ‘brittle mirage’

Listen for free

View show details

About this listen

a marketing lie from marketing liars
Text version: https://pivot-to-ai.com/2025/08/15/ai-chain-of-thought-is-still-just-a-brittle-mirage/

Patreon: https://www.patreon.com/davidgerard
Ko-Fi: https://ko-fi.com/A1529D5
Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6
REDBUBBLE SALE, 25% OFF TODAY: https://pivot-to-ai.redbubble.com

Sources:

Is Chain-of-Thought Reasoning of LLMs a Mirage? A Data Distribution Lens (PDF) https://arxiv.org/pdf/2508.01191
Learning to reason with LLMs: Hiding the Chains of Thought https://openai.com/index/learning-to-reason-with-llms/#hiding-the-chains-of-thought

Previously on Pivot to AI:

OpenAI does not want you delving into o1 Strawberry’s alleged ‘chain of thought’ https://pivot-to-ai.com/2024/09/17/openai-does-not-want-you-delving-into-o1-strawberrys-alleged-chain-of-thought/
LLMs can’t reason — they just crib reasoning-like steps from their training data https://pivot-to-ai.com/2024/10/13/llms-cant-reason-they-just-crib-reasoning-like-steps-from-their-training-data/
Apple: ‘Reasoning’ AIs fail hard if they actually have to think https://pivot-to-ai.com/2025/06/08/apple-reasoning-ais-fail-hard-if-they-actually-have-to-think/
video: https://www.youtube.com/watch?v=gSx9pI5so30&list=UU9rJrMVgcXTfa8xuMnbhAEA

Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA

No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.