BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Failed to add items
Sorry, we are unable to add the item because your shopping cart is already at capacity.
Add to basket failed.
Please try again later
Add to Wish List failed.
Please try again later
Remove from Wish List failed.
Please try again later
Follow podcast failed
Unfollow podcast failed
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
-
Narrated by:
-
By:
About this listen
In this second episode of AI Papers Explained, we explore BERT, the model that taught Transformers to truly understand human language.
Building upon the foundation laid by Attention Is All You Need, BERT introduced two key innovations:
Bidirectional Attention, allowing context comprehension from both directions.
Masked Language Modeling and Next Sentence Prediction, enabling deep semantic understanding.
Through this episode, you’ll discover how these mechanisms made BERT the backbone of modern NLP systems — from search engines to chatbots.
🎙️ Source:
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Google AI Language.
https://arxiv.org/pdf/1810.04805
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.