Wirewalk Instituteof AI

bld  Track

Courses for building and evaluating AI applications

From first API call to production agents: RAG, tool use, evaluation, guardrails and cost control.

14 courses4 available now1 Basic9 Intermediate4 Expert Filter in the catalog

Choose an AI learning path for your work

Use the application you want to build to narrow the learning path. A document assistant points toward retrieval and embeddings, while a tool using agent calls for orchestration and safety topics. Public syllabuses also cover evaluation, gateways, voice and operational reliability. Compare these subjects with your current development experience before selecting a course. Check individual availability and prerequisites; a listed production topic does not mean a course is open for enrollment.

Who these courses are for

  • Application engineers
  • Conversational AI developers
  • Technical product leads

Learning questions to explore

  • Compare retrieval approaches for a document assistant
  • Plan evaluation topics for an LLM application
  • Explore tool use and agent guardrail design

Find your starting point

Build your grounding with AI foundations, then check prerequisites for this track’s available courses.

Available courses are open for enrollment. Waitlisted courses are still being prepared or reviewed.

Compare this track in the course catalog

Related learning: AI in Software Development · Data for AI · AI Security: Securing AI Systems

Basic

No prior experience assumed. · 1 course
bld-101 Basic Waitlist

No-Code AI Assistants: Custom GPTs, Projects, Gems and Copilot Studio

A hands-on course on building no-code assistants with the builders already in your workplace tools: ChatGPT projects, custom GPTs and their successor plugins, Claude Projects and Skills, Gemini Gems, and Microsoft 365 Copilot Agent Builder and Copilot Studio. You leave with a tested, documented assistant and a plan to share it safely.

7 h · 17 lessons Join the waitlist

Intermediate

For practitioners who use or build with AI. · 9 courses
bld-201 Intermediate Available

Building with LLM APIs Across Vendors

A hands-on, code-first course on the three major LLM APIs side by side: messages, streaming, structured outputs, tool calling, vision, cost, caching, batch, retries, abstraction layers, cloud routes and testing. You finish by building and hardening a small multi-vendor service.

14 h · 18 lessons See price at checkout
bld-210 Intermediate Available

Retrieval-Augmented Generation Systems

A practitioner's course on retrieval-augmented generation: when to use it, how to ingest, chunk, embed and index documents, how to combine BM25 and vector search with reranking, and how to measure, debug and operate the result. Every module includes working Python sketches.

14 h · 16 lessons See price at checkout
bld-215 Intermediate Waitlist

Embeddings and Vector Databases

A deep dive into the two layers under every semantic search system: embedding models and vector databases. Covers how embeddings are trained and benchmarked, Matryoshka truncation and quantization, ANN index internals (HNSW, IVF-PQ, DiskANN), filtering, multi-tenancy and the operational work of re-embedding and capacity planning.

13 h · 20 lessons Join the waitlist
bld-230 Intermediate Available

Evaluating LLM Applications

A practical course on application-level LLM evaluation: turning product requirements into test cases, choosing between code checks, human review and LLM-as-judge, calibrating judges against people, running evals in CI with tools such as Promptfoo and Inspect, and closing the loop with production traces and online experiments.

14 h · 19 lessons See price at checkout
bld-240 Intermediate Waitlist

Conversational and Voice Agents

Build real-time conversational agents for chat and voice. Covers conversation design, dialogue state, speech-to-speech models such as OpenAI's Realtime API and the Gemini Live API, cascaded STT-LLM-TTS pipelines, turn detection and barge-in, WebRTC and SIP telephony with LiveKit, Pipecat and Twilio, latency budgets, and testing voice agents.

14 h · 18 lessons Join the waitlist
bld-250 Intermediate Waitlist

Multimodal Applications: Vision, Documents and Audio

Build application features on multimodal models: image understanding and visual question answering, PDF and scanned-document extraction, chart and screenshot reading, speech-to-text and audio understanding, and video analysis. Compares frontier APIs with open-weight vision-language models and teaches cost control, evaluation and the failure modes specific to non-text inputs.

13 h · 17 lessons Join the waitlist
bld-260 Intermediate Waitlist

Agent Frameworks Compared: LangChain, LlamaIndex and Others

A side-by-side, code-first comparison of the main LLM application frameworks. You build one reference application (a document-grounded assistant with tools) in LangChain 1.x with LangGraph, LlamaIndex, Pydantic AI and Microsoft Agent Framework, then examine DSPy, Haystack, CrewAI and Mastra, and finish with a framework decision record and a migration plan.

14 h · 17 lessons Join the waitlist
bld-270 Intermediate Waitlist

LLM Gateways: Routing, Keys, Quotas and Audit

A hands-on course on the LLM gateway pattern. You deploy LiteLLM Proxy and compare it with Envoy AI Gateway, Kong AI Gateway, Azure API Management's AI gateway policies, Cloudflare AI Gateway and Portkey, then implement virtual keys, routing and fallback, token quotas and budgets, caching, guardrail hooks, logging and audit for a multi-team organization.

12 h · 19 lessons Join the waitlist
bld-280 Intermediate Waitlist

Private AI: Deploying an On-Premises Assistant for Your Organization

An end-to-end build of a private, on-premises AI assistant. You size GPU hardware, choose open-weight models such as gpt-oss, Qwen, Mistral and Gemma, serve them with vLLM, deploy Open WebUI or LibreChat with SSO and role-based access, connect internal documents for retrieval, and run the service with monitoring, governance and a clear support model.

14 h · 20 lessons Join the waitlist

Expert

Deep technical work for specialists. · 4 courses
bld-320 Expert Available

AI Agents: Tool Use, MCP and Multi-Agent Orchestration

An engineering course on building agents that call tools reliably, speak the Model Context Protocol, coordinate with other agents and stay safe, measurable and affordable. Every module pairs concepts with working code across the major vendor SDKs.

20 h · 19 lessons See price at checkout
bld-330 Expert Waitlist

Production LLM Engineering: Reliability, Latency and Cost

The engineering discipline of running LLM-backed features at scale: SLOs and error budgets for probabilistic systems, multi-provider failover and capacity reservations, latency engineering from TTFT to perceived speed, cost engineering with caching, batching and routing, OpenTelemetry GenAI tracing, and safe rollout of prompt and model changes.

20 h · 20 lessons Join the waitlist
bld-340 Expert Waitlist

Guardrails and Safety Engineering for LLM Applications

An engineering course on guardrails as a measured, layered system. Covers policy taxonomies, input and output classifiers (OpenAI moderation, Llama Guard 4, Prompt Guard 2, gpt-oss-safeguard), NeMo Guardrails and Guardrails AI, cloud guardrail services such as Amazon Bedrock Guardrails, Azure AI Content Safety and Google Cloud Model Armor, grounding and hallucination checks, action guardrails for tools, and how to evaluate, tune and operate them.

18 h · 19 lessons Join the waitlist
bld-350 Expert Waitlist

Knowledge Graphs and GraphRAG

An expert course on knowledge graphs for LLM applications. You learn property graphs and RDF, query with Cypher, GQL and SPARQL, build graphs from documents with LLM extraction and entity resolution, implement Microsoft GraphRAG, LazyGraphRAG-style and LightRAG-style retrieval, text-to-Cypher and hybrid graph-vector search, and evaluate when a graph actually beats vector RAG.

20 h · 21 lessons Join the waitlist

Certification programs using this track

Certified AI Application Engineer

Builds production LLM applications across vendors.

  1. Building with LLM APIs Across Vendors
  2. Retrieval-Augmented Generation Systems
  3. AI Agents: Tool Use, MCP and Multi-Agent Orchestration
  4. Evaluating LLM Applications
4 courses · 62 h See price at checkout

Certified AI Systems Developer

Integrates AI into production software across languages.

  1. Python AI Integration: SDKs, Async, Pydantic, Packaging and Testing
  2. Rust for AI: Candle, Burn, ONNX Runtime and High-Performance Services
  3. C++ for AI: LibTorch, ONNX Runtime, TensorRT and CUDA Integration
  4. Building with LLM APIs Across Vendors
4 courses · 75 h See price at checkout