LLM Trust Trap: Amit Shivpuja on Why Natural Language Bypasses Critical Thinking | Skin in the Game cover art

LLM Trust Trap: Amit Shivpuja on Why Natural Language Bypasses Critical Thinking | Skin in the Game

LLM Trust Trap: Amit Shivpuja on Why Natural Language Bypasses Critical Thinking | Skin in the Game

Listen for free

View show details

About this listen

There is a paradox emerging in the age of Generative AI.

Business leaders are trained to be skeptical of raw data. They question spreadsheets. They interrogate dashboards. But the moment that same data is wrapped in a conversational sentence by an LLM? The skepticism vanishes.
In the latest episode of Skin in the Game, I sat down with Amit Shivpuja (Director of Data Product & AI Enablement @ Walmart) to discuss why our biggest AI challenge isn't the technology—it's the misplaced trust that comes with a friendly chat interface.

As Amit put it:
"People tend to put a lot more trust in the system than they would normally do. They're a little skeptical if you give them a table of numbers, but if you write them a sentence saying the answer is X, they tend to trust it. It's on us to show them how we came up with the answer, not just give them a number."


We also explored a fascinating case from his VR days where survey data (what people said) completely contradicted usage data (what people did). The lesson? Whether you are dealing with human feedback or AI output, validation is non-negotiable.

If your organization is racing to adopt AI tools, this conversation is a vital reality check. We dig into:

  • The "Data Sandwich" framework for building trustworthy systems
  • How to build trust through radical transparency
  • Why accountability must always remain with the human

🔗 Links & Resources:

  • linkedin.com/in/amitshivpuja
  • datacompass.substack.com

📺 Watch on YouTube: youtu.be/o6n5IP_Z2DY

What makes YOU trust an AI output? Is it the authority of the tone, or the transparency of the source?. Drop your thoughts below. 👇

#AI #DataGovernance #DigitalTransformation #Leadership #GenerativeAI #Walmart #DataIntegrity #StanfordLEAD #stanfordgsb #SkinInTheGamewithDebbieGo

Enjoying the podcast? Leave us a quick review!

Support the show

Follow Us:

  • 🎧 Podcast website
  • 💼 LinkedIn
  • ▶️ YouTube
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.