Wirewalk Instituteof AI
hw-204 Intermediate Available

Storage Hardware for AI: NVMe, SSD Endurance, Arrays and GPUDirect Storage

For storage and infrastructure engineers who must choose drives, servers and storage systems that keep GPUs fed, survive checkpoint traffic and hold data at petabyte scale.

Level
Intermediate
Study time
14 hours
Lessons
19 in 6 modules
Exam
20 questions

About this course

GPUs that wait on storage burn money, and SSDs that wear out early or stall under mixed writes cause outages that look like software bugs. This course gives engineers the hardware model needed to specify storage for AI. It begins inside the SSD: NAND cell types from TLC to QLC, the flash translation layer, over-provisioning, write amplification, and how endurance ratings (DWPD and TBW) translate into service life under real AI write patterns such as checkpointing. It covers the NVMe protocol, queues and namespaces, EDSFF E1.S, E3.S and E3.L and U.2 form factors, and the drives current in October 2026, from PCIe Gen5 performance drives to the first PCIe Gen6 drives and 122 TB and 245 TB class QLC.

The second half moves out to systems: storage servers and the PCIe and network bandwidth budgets that bound them, parallel filesystems and AI storage platforms (IBM Storage Scale, Lustre-based DDN EXAScaler, VAST, WEKA, Pure Storage, NetApp and others), NVMe over Fabrics, and NVIDIA GPUDirect Storage with cuFile. It explains the emerging context-memory tier for inference KV cache, including NVIDIA's BlueField-4-based Inference Context Memory Storage platform, and labels vendor claims as such. It closes with sizing worked examples for data ingest, checkpoint bursts and inference, and with benchmarking traps that make storage look faster than it is. The course ends with an automated exam and a Wirewalk Institute certificate of completion and assessment; it is not a vendor certification.

What you will be able to do

  • Explain how NAND type, over-provisioning, write amplification and the FTL determine SSD performance consistency and endurance
  • Convert DWPD and TBW ratings into expected service life for a stated AI write workload, including checkpoint bursts
  • Compare NVMe drive classes and EDSFF and U.2 form factors, and select drives for local scratch, performance tiers and capacity tiers
  • Calculate the bandwidth and capacity a storage system must deliver for data loading, checkpointing and inference context at a given cluster size
  • Describe how GPUDirect Storage, NVMe over Fabrics and RDMA change the data path, and identify when they help
  • Compare parallel filesystem and AI storage platform architectures on the hardware characteristics that bound their performance
  • Design a storage benchmark that avoids cache, buffer and concurrency traps, and interpret its results

Syllabus

6 modules · 19 lessons · about 14 hours

Module 1: Inside the SSD

NAND, controllers and the FTL, and why SSD performance is not a single number.
3 lessons
  1. NAND Cells and Dies: SLC, TLC and QLC and Layer Counts
  2. Controllers, the FTL, Over-Provisioning and Write Amplification
  3. Steady-State Versus Fresh-Out-of-Box Performance

Module 2: Endurance and Reliability

What endurance ratings mean, how AI workloads consume them, and how drives fail.
3 lessons
  1. DWPD, TBW and Workload-Based Endurance Arithmetic
  2. Checkpoint Bursts and Other AI Write Patterns
  3. SMART and NVMe Health Logs, Failure Modes and Replacement Policy

Module 3: NVMe Drives and Form Factors in 2026

The protocol, the form factors and the drives that matter today.
4 lessons
  1. NVMe Essentials: Queues, Namespaces and Command Sets
  2. EDSFF E1.S, E3.S and E3.L Versus U.2: Density, Cooling and Serviceability
  3. PCIe Gen5 and Gen6 Performance Drives
  4. High-Capacity QLC: 122 TB and 245 TB Class Drives and Where They Fit

Module 4: Storage Servers, Arrays and Platforms

How drives become systems, and the architectures of AI storage platforms.
3 lessons
  1. Storage Server Anatomy: PCIe, Memory and NIC Budgets
  2. Parallel Filesystems and AI Storage Platforms: Storage Scale, Lustre, VAST, WEKA and Others
  3. Object Storage and Tiering for Datasets and Checkpoints

Module 5: The GPU Data Path

GPUDirect Storage, NVMe over Fabrics and the new context-memory tier for inference.
3 lessons
  1. GPUDirect Storage and cuFile: What Bypassing the Bounce Buffer Buys
  2. NVMe over Fabrics: RDMA and TCP Transports
  3. KV-Cache and Context-Memory Storage Tiers for Inference

Module 6: Sizing and Validation

Worked sizing for training and inference, and benchmarks that tell the truth.
3 lessons
  1. Sizing for Training: Data Ingest and Checkpoint Bandwidth
  2. Sizing for Inference: Model Load Times and Context Storage
  3. Benchmarking Storage Honestly: fio, elbencho, Caches and Concurrency

Exam and certificate

The exam unlocks once you have completed every lesson. It draws 20 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 45 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.

Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.

The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by NVIDIA, Micron, Solidigm, Samsung, Kioxia, Sandisk, SK hynix, DDN, VAST Data, WEKA, Pure Storage, NetApp, IBM, Dell Technologies, HPE, NVM Express, or SNIA. Product and company names are trademarks of their respective owners.

hw-001 Free intro Available

Inside an AI Data Center: GPUs, Networks and Storage in One Hour

A plain-English, one-hour walk through an AI data center: what a model asks of hardware, what is inside a GPU server, how GPUs talk over NVLink, InfiniBand and Ethernet, where the data lives, and why AI racks need so much power and cooling.

1 h · 6 lessons Free intro
hw-101 Basic Available

AI Hardware Fundamentals: GPUs, CPUs, Memory, Networking and Storage

A plain-language tour of the hardware that runs AI: why AI is limited by compute, memory bandwidth and data movement; what GPUs, HBM and precision formats are; how servers, networks, storage, power and cooling fit together; and how to size a simple inference or training system and weigh cloud against buying.

8 h · 20 lessons See price at checkout
hw-201 Intermediate Available

GPU Hardware Deep Dive: Architecture, Memory and Interconnects

An engineer's tour of the modern data center GPU: how SMs and CUs, warps and wavefronts, tensor and matrix cores and the on-chip memory hierarchy work; what FP64 through FP4 and sparsity really buy you; how HBM, PCIe, NVLink, Infinity Fabric, UALink and CXL move data; and how power, cooling and reliability features shape real deployments. Reviewed against vendor sources as of October 2026.

14 h · 21 lessons See price at checkout