Wirewalk Instituteof AI

srv  Track

AI inference, serving and MLOps training

Deploying, optimizing, monitoring and operating models in production.

6 courses1 available now2 Intermediate4 Expert Filter in the catalog

Choose an AI learning path for your work

Compare courses according to the stage of operation you need to understand: packaging a model, exposing an API, optimizing inference or observing production behavior. The public catalog also includes edge deployment and MLOps foundations. Read the syllabus to distinguish application integration from model serving responsibilities. Choose prerequisites that fit your existing engineering background, and check each listing for availability and expected workload before arranging a sequence of technical study.

Who these courses are for

  • MLOps engineers
  • Model serving engineers
  • Edge deployment developers

Learning questions to explore

  • Compare container and autoscaling deployment topics
  • Explore quantization tradeoffs for inference
  • Plan study of model monitoring and observability

Find your starting point

Build your grounding with AI foundations, then check prerequisites for this track’s available courses.

Available courses are open for enrollment. Waitlisted courses are still being prepared or reviewed.

Compare this track in the course catalog

Related learning: Model Development · AI Infrastructure and HPC · AI in Software Development

Intermediate

For practitioners who use or build with AI. · 2 courses
srv-201 Intermediate Waitlist

MLOps Fundamentals

The working practices that make machine learning reproducible and operable: versioning data, code and models together, tracking experiments, building pipelines, gating releases with CI/CD, and watching models for drift after they ship. Covers both classical ML and the newer LLM-application lifecycle.

14 h · 18 lessons Join the waitlist
srv-210 Intermediate Waitlist

Deploying Models: APIs, Containers and Autoscaling

A practical path from a model file to a production service: designing the inference API, packaging it in a lean GPU-ready container, running it on Kubernetes with KServe, autoscaling it on the right signal, and rolling out new versions safely. Focused on general ML models; LLM-specific engines are covered in srv-310.

14 h · 18 lessons Join the waitlist

Expert

Deep technical work for specialists. · 4 courses
srv-310 Expert Available

LLM Inference and Serving: vLLM, SGLang, TensorRT-LLM and Triton

The engineering of LLM inference from first principles to production: why decode is memory-bound, how to size the KV cache, how continuous batching, PagedAttention, prefix caching, quantization and speculative decoding change the economics, and how to run vLLM, SGLang, TensorRT-LLM and Dynamo at scale. Ends with load testing, Kubernetes autoscaling and a defensible cost per million tokens.

22 h · 19 lessons See price at checkout
srv-320 Expert Waitlist

Quantization and Inference Optimization

The numerics and engineering of making models cheaper to run: number formats from FP16 to FP4, post-training quantization algorithms such as GPTQ, AWQ and SmoothQuant, quantization-aware training, KV cache quantization, and the compiler and kernel work (torch.compile, TensorRT, fused attention, CUDA graphs) that turns smaller numbers into real speed. Every technique is paired with a way to measure what it costs in quality.

20 h · 20 lessons Join the waitlist
srv-330 Expert Waitlist

LLM Observability and Monitoring

How to instrument, monitor and debug LLM systems end to end: distributed traces across prompts, retrieval, tool calls and agent steps; token, latency and cost metrics; online evaluation of live traffic; and the alerting, privacy controls and incident practice that make it operable. Built on OpenTelemetry so the skills transfer across vendors.

18 h · 19 lessons Join the waitlist
srv-340 Expert Waitlist

Edge and On-Device AI

The software side of edge AI: deciding what should run on the device, fitting models into tight memory and power budgets, converting them for ExecuTorch, LiteRT, Core ML, ONNX Runtime and OpenVINO, targeting NPUs and GPUs, running small language models locally, and operating a fleet of devices with secure model updates. Hardware selection is covered in hw-206.

18 h · 20 lessons Join the waitlist

Certification programs using this track

Certified AI Infrastructure Engineer

Designs and operates GPU clusters for training and inference.

  1. GPU Infrastructure for AI
  2. HPC Cluster Design for AI: Compute, Fabric and Storage
  3. Distributed Training at Scale: DDP, FSDP, DeepSpeed and Megatron
  4. LLM Inference and Serving: vLLM, SGLang, TensorRT-LLM and Triton
4 courses · 74 h See price at checkout