Deep Learning with PyTorch
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
For ML engineers and researchers who want to look inside transformer language models, find the features and circuits behind a behavior, and use that understanding to debug, steer and audit models.
The curriculum is being prepared and reviewed. Enrollment is not open yet.
Behavioral evaluation tells you what a model does; interpretability tries to tell you why. Over the last few years the field has moved from toy models to tooling that works on real open-weight LLMs: libraries that expose every activation, sparse dictionaries that decompose those activations into human-readable features, and attribution graphs that trace how a specific answer was computed. Used carefully, these tools can find the cause of a failure, suppress or amplify a behavior, and support safety claims with evidence. Used carelessly, they produce convincing stories that do not survive a control experiment.
This course teaches both the techniques and the skepticism. You start with the residual-stream view of the transformer and the classic findings (induction heads, superposition). You then work through the experimental toolkit: linear probes, the logit and tuned lens, activation patching and attribution patching, and causal scrubbing-style hypothesis tests. The middle of the course covers sparse autoencoders and transcoders: training them with SAELens, using the open Gemma Scope 2 suite for Gemma 3, browsing and labeling features on Neuronpedia, and building attribution graphs with the open circuit-tracer library. The final modules apply interpretability to steering, refusal and deception audits, and model debugging, and close with what interpretability evidence can and cannot support. Tool and release facts are current as of October 2026.
6 modules · 21 lessons · about 20 hours
The exam unlocks once you have completed every lesson. It draws 25 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 60 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.
Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.
The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by TransformerLens, nnsight / NDIF, SAELens, Neuronpedia, Google DeepMind (Gemma Scope), Anthropic (circuit-tracer), Hugging Face Transformers, or Captum. Product and company names are trademarks of their respective owners.
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
Build a decoder-only transformer piece by piece: tokenization, embeddings, scaled dot-product attention, multi-head and grouped-query attention, positional schemes such as RoPE, and the training and sampling loop, then map it onto real open-weight model architectures.
Gradient-boosted trees and linear models still win most tabular problems. This course covers leakage-proof pipelines, honest validation, tuning, calibration and explainability, then packaging, serving and monitoring for drift.