Epochs
NowRoomsWatchExperiencesJobsTopicsProgress
← All videos

Attention in transformers, step-by-step | Deep Learning Chapter 6

3Blue1Brown ·
🎯 Quiz me on Attention · 2 minutes, while it's fresh→

Up next

There's never been a better time to go into math3Blue1Brown · 2.7M views · 19 days agoThe last IMO problem AI could not solve3Blue1Brown · 3.1M views · 1 mo agoDeep Dive into LLMs like ChatGPTAndrej Karpathy · 10.2M views · 1 yr agoLet's build GPT: from scratch, in code, spelled out.Andrej Karpathy · 8.2M views · 3 yr agoThe spelled-out intro to neural networks and backpropagation: building microgradAndrej Karpathy · 4.4M views · 4 yr ago[1hr Talk] Intro to Large Language ModelsAndrej Karpathy · 4.3M views · 2 yr agoHow I use LLMsAndrej Karpathy · 2.9M views · 1 yr agoThe spelled-out intro to language modeling: building makemoreAndrej Karpathy · 1.3M views · 4 yr agoLet's build the GPT TokenizerAndrej Karpathy · 1.3M views · 2 yr agoLet's reproduce GPT-2 (124M)Andrej Karpathy · 1.2M views · 2 yr agoBuilding makemore Part 2: MLPAndrej Karpathy · 612.1K views · 4 yr agoBuilding makemore Part 3: Activations & Gradients, BatchNormAndrej Karpathy · 568.4K views · 4 yr agoMore 🧠 Machine learning →
EpochsTrain like a model. Interview like a pro.
TodayRoomsTopicsProgressInterview experiencesWatchJobs💬 Feedback
Free, no sign-up. Your practice history stays on your device. © 2026 Epochs