Deep Learning with PyTorch
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
For ML engineers who need a smaller, cheaper model that keeps the capability that matters, by distilling from a teacher, pruning structure away, or picking the right small model to start from.
The curriculum is being prepared and reviewed. Enrollment is not open yet.
Many production workloads do not need the largest model available; they need a model that is good at one job, fast and cheap. This course covers the techniques that produce such models. You start with knowledge distillation in its classic form, matching a teacher's softened output distribution, then move to the variants that matter for language models: sequence-level distillation, on-policy and generalized KD that train on the student's own samples, and reasoning-trace distillation from a large teacher.
The pruning half explains unstructured, semi-structured 2:4 and structured pruning, how importance is estimated from weights, activations or gradients, and the prune-then-distill recipe used by NVIDIA's Minitron work and implemented in Model Optimizer, where depth and width are cut and the model is retrained against its parent. You learn how to evaluate a compressed model against the teacher on your own task, how teacher-output licensing terms constrain what you may train, and how to choose among small open-weight families. Quantization is touched on only as a complementary step; it is taught in depth in srv-320. Model and library facts are current as of October 2026.
6 modules · 20 lessons · about 18 hours
The exam unlocks once you have completed every lesson. It draws 25 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 60 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.
Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.
The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by Hugging Face (TRL, Transformers), NVIDIA (Model Optimizer, NeMo, Minitron), PyTorch, Microsoft (Phi), Google (Gemma), Qwen, Meta Llama, or vLLM. Product and company names are trademarks of their respective owners.
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
Build a decoder-only transformer piece by piece: tokenization, embeddings, scaled dot-product attention, multi-head and grouped-query attention, positional schemes such as RoPE, and the training and sampling loop, then map it onto real open-weight model architectures.
Gradient-boosted trees and linear models still win most tabular problems. This course covers leakage-proof pipelines, honest validation, tuning, calibration and explainability, then packaging, serving and monitoring for drift.