Build with the OpenAI API cover art

Build with the OpenAI API

Build with the OpenAI API

By: Joe Pugh
Listen for free

This Season's Biggest Deal | $0.99/mo for 3 months + $20 Audible bonus

Auto-renews at $8.99/mo. after 3 months - terms apply.
Summary

Most of what sounds complicated about building with language models comes down to a handful of decisions. Who owns the control flow, your code or the model? When does a capability deserve to be an agent, and when is it just a well-designed set of tools? What does it actually cost to put something in the context window, and who pays for it on every turn?

Build with the Azure OpenAI API is the podcast companion to the course of the same name. Each episode takes one salient point, one technique, or one new technology from the course and gives it ten to twelve minutes of clear, conversational attention. The mental model that makes agents make sense. Why you don't need an agent for that. The Decisions API and the end of parsing. The economics of context, retrieval that grew up, MCP without the mystique, and skills as the specialist who doesn't need a desk. It closes where regulated firms have to: evaluation as a control, prompt injection as a property to contain, and approval as an architecture.

The point of view is an architect's, with the cost, latency, security and governance angle on everything. But if you're an engineer, a technical lead, or anyone trying to build something real on these APIs, you'll find the ground is the same. Every number and every claim traces back to the course, which cites its sources. The audio is AI generated.

Episodes
  • Retrieval Didn't Die. It Grew Up
    Nov 11 2026

    Million-token context windows were supposed to make retrieval obsolete. The prediction keeps not coming true, and the reasons why are the design constraints of any knowledge architecture you'll build. This episode covers what good retrieval looks like now, the quiet breakthrough of fixing chunks instead of queries, and the genuinely new decision: should your code drive the search, or should the model?

    Show More Show Less
    9 mins
  • The Economics of Context
    Nov 11 2026

    Got something to say to this podcast? Send a voicemail, and you might hear yourself on the next episode!

    Model prices get the headlines, but architecture decides the bill. Two systems on the same model can differ in cost per request by a factor of fifty. This episode explains the unusual shape of language model pricing, then walks through the three levers that move cost and latency more than any model choice: prompt caching, routing, and context discipline. Plus the one dynamic value that silently makes your prompt cost ten times more.

    Show More Show Less
    9 mins
  • Approval is an Architecture
    Nov 11 2026

    Got something to say to this podcast? Send a voicemail, and you might hear yourself on the next episode!

    For a decade, "human in the loop" was a reassuring phrase on a slide. That era is over, because the machines now act, and US regulators have noticed. This episode walks through what FINRA, the banking supervisors and Treasury now expect of firms running agents, how the approval checkpoint is becoming standard protocol plumbing through MCP elicitation, and the subtle failure the protocol doesn't solve for you: proving that what executed is what the human actually approved.

    Show More Show Less
    9 mins
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.