Wirewalk Instituteof AI
sec-350 Expert Waitlist

Securing AI Infrastructure: GPU Clusters, Model Serving and MLOps Pipelines

For infrastructure, platform and security engineers who run GPU clusters, inference endpoints and MLOps pipelines and must protect model weights, data and compute.

The curriculum is being prepared and reviewed. Enrollment is not open yet.

About this course

AI infrastructure concentrates valuable assets in one place: proprietary model weights, sensitive training data and expensive accelerators. It is also built from components that were designed for trusted research environments, such as distributed compute frameworks, experiment trackers and notebook servers, several of which have had serious vulnerabilities or been found exposed to the internet (MITRE ATLAS added a technique for misconfigured or publicly exposed AI services in its September 2026 release). This course applies infrastructure security practice to that environment, drawing on Wirewalk's HPC and AI infrastructure work.

You will assess GPU multi-tenancy options (MIG, time-slicing, whole-node allocation) and their isolation limits, harden Slurm and Kubernetes for AI workloads, control access on InfiniBand and RoCE fabrics and parallel file systems, and manage node images, drivers and firmware. You will harden inference servers such as vLLM and Triton, put gateways, authentication and quotas in front of endpoints, and protect weights at rest, in transit and in use. The MLOps module secures notebooks, experiment trackers, registries, CI runners and feature stores. You will evaluate GPU confidential computing with attestation and air-gapped or sovereign deployments, design telemetry, map controls to NIST SP 800-53, the draft NIST Cyber AI Profile (IR 8596) and CIS Benchmarks, and finish with a capstone review of a hypothetical 64-node training cluster. The Wirewalk Institute certificate attests to completion and assessment of this course; it is not endorsed by OWASP, MITRE, NIST or any vendor named here.

What you will be able to do

  • Identify the high-value assets and common exposure classes in AI infrastructure
  • Choose GPU multi-tenancy and scheduler configurations that match the required isolation level
  • Harden Slurm, Kubernetes, high-speed fabrics and parallel file systems for shared AI workloads
  • Secure inference servers and endpoints with authentication, quotas and network controls
  • Protect model weights at rest, in transit and in use, including with GPU confidential computing and attestation
  • Secure MLOps components: notebooks, experiment trackers, model registries, CI runners and feature stores
  • Map AI infrastructure controls to NIST SP 800-53, the draft NIST Cyber AI Profile and CIS Benchmarks

Syllabus

6 modules · 18 lessons · about 20 hours

Module 1: The AI Infrastructure Threat Landscape

What attackers want from AI infrastructure and how they usually get in.
3 lessons
  1. High-Value Targets: Weights, Data and Compute
  2. Exposed Services and Vulnerability Classes in Distributed Compute, Trackers and Container Tooling
  3. Shared Responsibility Across Cloud, GPU Cloud and On-Premises Environments

Module 2: Securing GPU Clusters

Isolation, scheduling, fabrics, storage and node lifecycle.
4 lessons
  1. GPU Multi-Tenancy: MIG, Time-Slicing and Isolation Limits
  2. Hardening Slurm and Kubernetes for AI Workloads
  3. Fabric and Storage Access Control: InfiniBand Partitions, RDMA and Parallel File Systems
  4. Node Images, Drivers and Firmware Patch Management

Module 3: Securing Model Serving

Inference servers, endpoints and the weights behind them.
3 lessons
  1. Hardening Inference Servers Such as vLLM and Triton
  2. API Gateways, Authentication, Quotas and Abuse Controls
  3. Protecting Model Weights at Rest, in Transit and in Use

Module 4: Securing MLOps Pipelines

The tooling that trains, tracks and ships models.
3 lessons
  1. Notebooks, Experiment Trackers and Model Registries
  2. CI/CD for Models: Secrets, Runners and Artifact Integrity
  3. Data Pipelines and Feature Stores: Access Control and Integrity

Module 5: Confidential and Sovereign Deployments

Protecting data and models from the platform operator and the outside world.
2 lessons
  1. GPU Confidential Computing and Remote Attestation
  2. Air-Gapped and Sovereign AI Deployments

Module 6: Operations, Controls and Review

Monitoring, control frameworks and an end-to-end review.
3 lessons
  1. Logging and Telemetry for AI Infrastructure
  2. Mapping Controls to NIST SP 800-53, the Draft NIST Cyber AI Profile and CIS Benchmarks
  3. Capstone: Security Review of a Hypothetical 64-Node Training Cluster

Exam and certificate

The exam unlocks once you have completed every lesson. It draws 25 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 60 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.

Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.

The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by NVIDIA, Kubernetes, Slurm, Ray, MLflow, vLLM, NIST, or CIS. Product and company names are trademarks of their respective owners.

More in AI Security: Securing AI Systems

All 13 courses in this track
sec-001 Free intro Available

Using AI Safely at Work: The Essentials

Follow one fictional US distributor through four everyday AI mistakes (a guarantor's credit file uploaded to a personal account, a customer letter promising a fee waiver that does not exist, a vendor email with hidden instructions for the assistant, and a note-taker that sent a customer the internal margin floor) and practice the decisions that prevent or contain each one in three short Decision Labs.

1 h · 7 lessons Free intro
sec-101 Basic Available

Using AI Safely: Data Handling for Every Employee

A plain-language course on handling data safely with AI tools: what happens to what you type or upload, how to classify before you paste, how connected apps and agents change the picture, and how to report a mistake quickly.

6 h · 15 lessons See price at checkout
sec-201 Intermediate Available

AI Security Fundamentals: The OWASP Top 10 for LLMs

A practitioner course on securing applications that use large language models, organized around the 2026 OWASP Top 10 for LLM Applications. Every risk comes with a hypothetical scenario, the root cause, and concrete defenses in code and configuration.

14 h · 18 lessons See price at checkout