333 afleveringen
How to Stay Relevant as a Data Scientist in the Age of AI | Interview with Dr. Jon Krohn
16-11-2026 | 43 Min.Staying relevant as a data scientist when AI is reshaping the field isn't just a career question — it's an existential one. Dr. Jon Krohn, neuroscientist-turned-data-science-educator, podcaster, and consultant, sits down to share how he thinks about navigating that challenge. From his unconventional path out of academia to the advice he gives practitioners trying to future-proof their careers, this conversation is packed with hard-won perspective. If you've ever wondered what it takes to keep growing in a field that won't stop moving, this one's for you.
Links:
Jon Krohn's website
https://www.jonkrohn.com
Y Carrot (Jon's AI consultancy)
https://www.ycarrot.com
Katie on the Super Data Science Podcast, episode 1029
https://www.superdatascience.com/podcast/sds-1029-how-ai-brought-a-podcast-back-from-the-dead-with-linear-digressions-katie-malone
METR (source of the "task length doubles every seven months" charts Jon cited)
https://metr.org
Artificial Analysis (AI benchmarking site Jon cited)
https://artificialanalysis.ai
Serg Masís, "The Podcast Pipeline Nobody Sees: Behind the Scenes with AI Agents and AI gen" (Build Stuff)
https://www.youtube.com/watch?v=tSnzRUjWvrc
Search Engine podcast, "One man could slow down AI. He won't. Why?"
https://www.searchengine.show/one-man-could-slow-down-ai-he-wont-why
---
Website: https://lineardigressions.com
Apple Podcasts: https://podcasts.apple.com/us/podcast/linear-digressions/id941219323
Spotify: https://open.spotify.com/show/1JdkD0ZoZ52KjwdR0b1WoT
Substack: https://substack.com/@lineardigressions- GPUs are the engines powering every AI conversation you've ever had — but what's actually happening inside those chips when an LLM generates a response? Understanding GPU fundamentals turns out to be surprisingly useful for making sense of why inference works the way it does, from the prefill stage that processes your entire prompt at once to the serial decode step that produces tokens one by one. If you want to understand the real constraints shaping modern AI systems, this is where to start.
- The unsung hero of every LLM conversation you've ever had? A clever optimization called the KV cache. Self-attention is computationally brutal — every token attending to every other token means costs that scale as N², and that blowup gets worse with every turn of a conversation. The KV cache is what keeps that from becoming completely intractable at scale. Today's episode goes deep on how it works, why inference is a harder and more interesting problem than it gets credit for, and what's really happening under the hood when you chat with an LLM.
- Everyone talks about training the model — the data, the compute, the alignment magic. But what happens after the weights are frozen and millions of users start hammering it with prompts? That's inference, and it's a surprisingly deep rabbit hole of engineering challenges that rarely gets the spotlight it deserves. This week I kick off a new series unpacking the full inference ecosystem — from the moment a model completes training to the moment tokens land in your hands.
Meer Technologie podcasts
Trending Technologie -podcasts
Over Linear Digressions
Demystifying AI for the intelligently curious
Podcast websiteLuister naar Linear Digressions, Machine Gods en vele andere podcasts van over de hele wereld met de radio.net-app

Ontvang de gratis radio.net app
- Zenders en podcasts om te bookmarken
- Streamen via Wi-Fi of Bluetooth
- Ondersteunt Carplay & Android Auto
- Veel andere app-functies







































