Deep Learning with PyTorch
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
For ML engineers who build or adapt vision-language and other multimodal models and need to choose an architecture, assemble image-text data, run the pretraining and instruction-tuning stages, and evaluate the result.
The curriculum is being prepared and reviewed. Enrollment is not open yet.
Most frontier and open-weight models now accept images, and many accept video and audio. Under the hood, nearly all of them combine a pretrained encoder for each modality with a language model, then train the combination in stages: align the representations, teach broad multimodal understanding, then instruction-tune for the tasks users care about. The design choices along the way, such as how images become tokens, which parameters are frozen, how resolution is handled and what data is used, decide both quality and cost.
This course walks the full pipeline with open tools and open recipes. You train and evaluate a contrastive image-text encoder and understand why SigLIP's sigmoid loss displaced softmax CLIP training at scale. You study connector architectures from LLaVA's projector to cross-attention and native-resolution designs in the Qwen-VL family, and contrast them with early-fusion models that tokenize images directly. You build an image-text data pipeline with DataComp-style filtering, recaptioning and dense-caption data such as PixMo, then run alignment pretraining and visual instruction tuning with Hugging Face Transformers and TRL, including LoRA fine-tuning of an open VLM on document and chart data. Later modules extend the recipe to video and speech, then cover evaluation with VLMEvalKit and lmms-eval, object-hallucination testing, and preference tuning for multimodal outputs. Image and video generation are covered in mod-350. Model and library facts are current as of October 2026.
6 modules · 21 lessons · about 22 hours
The exam unlocks once you have completed every lesson. It draws 25 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 60 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.
Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.
The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by OpenAI (CLIP), OpenCLIP, Google (SigLIP 2, PaliGemma), Qwen (Qwen-VL family), AllenAI (Molmo, PixMo), LLaVA, Hugging Face (Transformers, TRL), Meta (Chameleon), LAION / DataComp, VLMEvalKit, or lmms-eval. Product and company names are trademarks of their respective owners.
A hands-on course in modern PyTorch: tensors and autograd, nn.Module design, data loading, a training loop you understand line by line, GPU and mixed-precision training, torch.compile, and exporting a model for deployment.
Build a decoder-only transformer piece by piece: tokenization, embeddings, scaled dot-product attention, multi-head and grouped-query attention, positional schemes such as RoPE, and the training and sampling loop, then map it onto real open-weight model architectures.
Gradient-boosted trees and linear models still win most tabular problems. This course covers leakage-proof pipelines, honest validation, tuning, calibration and explainability, then packaging, serving and monitoring for drift.