#519: Data Science Cloud Lessons at Scale cover art

#519: Data Science Cloud Lessons at Scale

#519: Data Science Cloud Lessons at Scale

Listen for free

View show details

About this listen

 Today on Talk Python: What really happens when your data work outgrows your laptop. Matthew Rocklin, creator of Dask and cofounder of Coiled, and Nat Tabris a staff software engineer at Coiled join me to unpack the messy truth of cloud-scale Python. During the episode we actually spin up a 1,000 core cluster from a notebook, twice! We also discuss picking between pandas and Polars, when GPUs help, and how to avoid surprise bills. Real lessons, real tradeoffs, shared by people who have built this stuff. Stick around.

Episode sponsors

Seer: AI Debugging, Code TALKPYTHON
Talk Python Courses

Links from the show Matthew Rocklin: @mrocklin
Nat Tabris: tabris.us

Dask: dask.org
Coiled: coiled.io
Watch this episode on YouTube: youtube.com
Episode #519 deep-dive: talkpython.fm/519
Episode transcripts: talkpython.fm
Developer Rap Theme Song: Served in a Flask: talkpython.fm/flasksong

--- Stay in touch with us ---
Subscribe to Talk Python on YouTube: youtube.com
Talk Python on Bluesky: @talkpython.fm at bsky.app
Talk Python on Mastodon: talkpython
Michael on Bluesky: @mkennedy.codes at bsky.app
Michael on Mastodon: mkennedy
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.