← Back to the full chapter
Lesson

Your nine-week plan

Follow the gradient. Train a small network. Learn what to check when it fails.

1 min read90 hours practice planWeeks 14–22Updated
Read source ↗

About ten hours a week. Start with Karpathy, or with fast.ai lessons 1–3 if you need an early win (see below).

WeekFocusDo thisDone when
14AutogradKarpathy micrograd / Zero to Hero 1–2; rebuild Value from an empty fileBackward pass on paper + code
15PyTorch basicsOfficial PyTorch tutorial; write a training loop and explain itLoop runs; you can diagnose a planted mode or gradient bug
16Debug trainingOverfit 10 samples; learning-rate sweep; loss curvesCan name 3 failure modes
17MLP / CNNDive into Deep Learning or CS231n notes; one small classifierBaseline comparison and loss curves explained
18Transfer learningfast.ai lessons 1–4 or fastbook ch 1–4; train the head, then compare unfreezing the backboneDemo on your images or domain
19Attention intuitionKarpathy build-GPT video; type alongCan draw the attention block
20TokeniserKarpathy tokeniser video; byte-level on small corpusEncode/decode round-trip works
21Your model + efficiencyPick capstone; profile eager training; save and resume a full checkpoint; try one supported precision/compile settingConfig reproduces the run and the bottleneck is measured
22Ablation + deployReport quality, memory and runtime; include failed runs; finish demoUntouched test, checkpoint replay and honest ablation in README

Something unclear or out of date? Suggest a correction ↗

Find your next idea

Loading local search…

Search is built from this edition. No account needed.