Wirewalk Instituteof AI
ven-270 Intermediate Waitlist

NVIDIA NIM and AI Enterprise

For platform and MLOps engineers who need to deploy, license and operate NVIDIA NIM inference microservices and the NVIDIA AI Enterprise software stack on their own GPUs.

The curriculum is being prepared and reviewed. Enrollment is not open yet.

About this course

NVIDIA AI Enterprise is a per-GPU software subscription that bundles supported drivers, operators, frameworks and the NIM inference microservices. NIM packages a model with an optimized serving backend behind an OpenAI-compatible API, so a team can stand up a production endpoint in minutes, but the details matter: model profiles, engine selection, cache volumes, NGC credentials, release branches, and the difference between Developer Program access and a production entitlement.

This course starts with licensing and lifecycle so you know what you are buying and supporting. You will run an LLM NIM with Docker, select profiles for your GPUs, and call it with standard OpenAI clients. On Kubernetes you will layer the GPU Operator, Network Operator and NIM Operator, cache models with NIMCache, deploy NIMService resources, and see where NVIDIA Dynamo adds disaggregated prefill and decode and KV-cache-aware routing. You will assemble retrieval with NeMo Retriever embedding and reranking NIMs, enforce policies with NeMo Guardrails, use AI Blueprints as reference architectures, and fine-tune or serve LoRA adapters. The last module covers benchmarking (TTFT, inter-token latency, throughput under concurrency), Prometheus and DCGM monitoring, and an honest build-versus-buy comparison with self-managed vLLM or SGLang.

What you will be able to do

  • Explain what an NVIDIA AI Enterprise subscription includes, how it is licensed per GPU, and how release branches affect support
  • Distinguish Developer Program access from a production entitlement for NIM and choose correctly for a deployment
  • Deploy an LLM NIM with Docker, select an appropriate model profile and call it through the OpenAI-compatible API
  • Deploy and scale NIM on Kubernetes with the GPU Operator and NIM Operator, and describe when NVIDIA Dynamo is warranted
  • Assemble a RAG pipeline from NeMo Retriever NIMs protected by NeMo Guardrails
  • Benchmark and monitor NIM endpoints for latency, throughput and GPU utilization
  • Produce a defensible build-versus-buy comparison between NIM and self-managed open-source serving

Syllabus

6 modules · 17 lessons · about 12 hours

Module 1: What You Are Buying

Contents, licensing and lifecycle of NVIDIA AI Enterprise.
3 lessons
  1. Inside NVIDIA AI Enterprise: Infrastructure Software, Frameworks and NIM
  2. Per-GPU Licensing, Developer Program Access and Production Entitlement
  3. Release Branches and Lifecycle: Feature, Production and Long-Term Support

Module 2: NIM on a Single Host

Run, configure and call a NIM microservice.
3 lessons
  1. Anatomy of a NIM: Container, Model Profiles and Serving Backends
  2. Running an LLM NIM with Docker: NGC Keys, Model Cache and Profile Selection
  3. The OpenAI-Compatible NIM API and Model-Free NIM

Module 3: NIM on Kubernetes

Operators, custom resources and scale-out serving.
3 lessons
  1. Foundations: GPU Operator, Network Operator and GPU Sharing Options
  2. Deploying with the NIM Operator: NIMCache, NIMService and Autoscaling
  3. Disaggregated Serving and KV-Aware Routing with NVIDIA Dynamo

Module 4: Building Applications from NVIDIA Components

Retrieval, guardrails and reference workflows.
3 lessons
  1. NeMo Retriever Embedding, Reranking and Extraction NIMs for RAG
  2. NeMo Guardrails: Topic, Safety and Jailbreak Rails
  3. NVIDIA AI Blueprints as Reference Architectures

Module 5: Customization

Adapting models and serving the result through NIM.
2 lessons
  1. NeMo Microservices for Fine-Tuning and Evaluation
  2. Nemotron Models and Serving LoRA Adapters with NIM

Module 6: Operating and Justifying NIM

Measure, monitor and decide.
3 lessons
  1. Benchmarking NIM: Concurrency Sweeps, TTFT, Inter-Token Latency and Throughput
  2. Monitoring NIM with Prometheus Metrics and DCGM Exporter
  3. Build vs Buy: NIM Compared with Self-Managed vLLM or SGLang

Exam and certificate

The exam unlocks once you have completed every lesson. It draws 20 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 40 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.

Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.

The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by NVIDIA (AI Enterprise, NIM, NGC, Dynamo, NeMo, Nemotron, GPU Operator), Red Hat (OpenShift), or Kubernetes. Product and company names are trademarks of their respective owners.

More in AI Models and Vendors

All 22 courses in this track
ven-001 Free intro Available

Your First Hour with ChatGPT, Claude and Gemini

A hands-on hour with ChatGPT, Claude and Gemini, told through one small business racing a deadline. Set up an account with a privacy setting you chose, decide what never goes into a personal account, write prompts that produce usable drafts, use files and web search, catch confident mistakes before they go out, and pick the assistant that fits how you work.

1 h · 7 lessons Free intro
ven-110 Basic Available

ChatGPT and the OpenAI Platform for Professionals

A practical, current tour of ChatGPT as a professional tool: choosing a plan and model, prompting well, analyzing files, researching with citations, using images and voice, organizing work in projects and memory, connecting apps and plugins, delegating multi-step work to ChatGPT Work, and knowing which admin and privacy controls matter. Ends with clear guidance on moving a workflow to the OpenAI API.

8 h · 15 lessons See price at checkout
ven-120 Basic Available

Claude for Professionals

Learn Claude by solving one firm's real problem: getting through renewal season with too few analysts and without putting client data in the wrong place. Each module compares the approaches professionals actually choose between, shows a realistic failure and its fix, and ends with a Decision Lab where you make the call under pressure.

12 h · 15 lessons See price at checkout