Intellectually Curious
Intellectually Curious is a podcast by Mike Breault featuring over 1,800 AI-powered explorations across science, mathematics, philosophy, and personal growth. Each short-form episode is generated, refined, and published with the help of large language models—turning curiosity into an ongoing audio encyclopedia. Designed for anyone who loves learning, it offers quick dives into everything from combinatorics and cryptography to systems thinking and psychology.
Inspiration for this podcast:
"Muad'Dib learned rapidly because his first training was in how to learn. And the first lesson of all was the basic trust that he could learn. It's shocking to find how many people do not believe they can learn, and how many more believe learning to be difficult. Muad'Dib knew that every experience carries its lesson."
― Frank Herbert, Dune
Note: These podcasts were made with NotebookLM. AI can make mistakes. Please double-check any critical information.
Intellectually Curious
Atomic GPT: Building a Transformer from Scratch in 200 Lines
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
A deep dive into Karpathy's Atomic GPT—a fully functional transformer implemented in roughly 200 lines of pure Python, with no libraries. We trace how a value class records computation history, how backpropagation unfolds from receipts, and how architectural choices like squared ReLU and RMSNorm shape learning. We explore the minimalist attention loop, manual KV cache management, and a from-scratch Adam optimizer, all while reflecting on what this teaches about intelligence, scalability, and the role of production-grade tools in real-world AI projects.
Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information.
Sponsored by Embersilk LLC