A Bigger Context cover art

A Bigger Context

A Bigger Context

Listen for free

View show details

About this listen

 Dive into the evolving world of AI context windows with Rooting. This episode unpacks the surprising paradox of 'more memory' in AI models: exploring the immense benefits of larger context, the hidden limitations like reasoning degradation, and the cutting-edge engineering techniques—from positional encoding tricks to novel reasoning architectures—that are shaping how AI truly understands and remembers. Essential listening for solution architects, software developers, and data scientists navigating the complexities of large language models.
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.