Deep Learning with PyTorch
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
For ML engineers who post-train open-weight models and need to collect preference data, train reward models, run PPO-style RLHF or DPO-family methods, and prove the result is better and not just longer.
The curriculum is being prepared and reviewed. Enrollment is not open yet.
Supervised fine-tuning teaches a model what good outputs look like; preference optimization teaches it which of two plausible outputs is better. This course treats that second step as an engineering discipline. You start with the objective itself, the KL-regularized reward maximization behind RLHF, and derive why DPO can optimize the same objective without an explicit reward model or online sampling.
The course then covers each stage with real tooling. You design preference-data collection, rubrics and annotator agreement, and use AI feedback and constitution-style principles where human labels are too expensive. You train and audit reward models, run PPO with TRL, OpenRLHF or verl, and compare it with DPO, KTO, ORPO and SimPO on cost, stability and data needs. The final modules are about knowing whether it worked: length bias, reward hacking, over-refusal, sycophancy and regressions on capability benchmarks, plus safety tuning and red-team data. Reinforcement learning from verifiable rewards and GRPO for reasoning are covered in depth in mod-370 and only introduced here. Library features are current as of October 2026.
6 modules · 22 lessons · about 20 hours
The exam unlocks once you have completed every lesson. It draws 25 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 60 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.
Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.
The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by Hugging Face (TRL, PEFT), OpenRLHF, verl, NVIDIA NeMo RL, vLLM, Argilla, or AllenAI (Tulu recipes, RewardBench). Product and company names are trademarks of their respective owners.
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
Build a decoder-only transformer piece by piece: tokenization, embeddings, scaled dot-product attention, multi-head and grouped-query attention, positional schemes such as RoPE, and the training and sampling loop, then map it onto real open-weight model architectures.
Gradient-boosted trees and linear models still win most tabular problems. This course covers leakage-proof pipelines, honest validation, tuning, calibration and explainability, then packaging, serving and monitoring for drift.