Wirewalk Instituteof AI
dev-209 Intermediate Waitlist

Julia for Scientific Machine Learning

For scientists and engineers who use Julia, or are evaluating it, to combine differential-equation models with neural networks, train them on CPUs and GPUs, and call LLMs from scientific code.

The curriculum is being prepared and reviewed. Enrollment is not open yet.

About this course

Scientific machine learning combines mechanistic models, usually differential equations, with machine-learned components. The result can be more data-efficient, more extrapolable and more interpretable than either alone. Julia's SciML ecosystem is one of the most complete platforms for this work, because its solvers, symbolic modeling tools and automatic differentiation systems are designed to compose.

This course teaches that ecosystem in practice. You will model systems with OrdinaryDiffEq and ModelingToolkit, add neural components with Lux to build universal differential equations and neural ODEs, compute gradients through solvers with SciMLSensitivity using Enzyme, Zygote or Mooncake, and fit them with Optimization.jl. You will try physics-informed neural networks with NeuralPDE, learn interpretable equations back from trained models with DataDrivenDiffEq and SymbolicRegression, and build fast surrogates for expensive simulations. You will use threads, distributed processes and GPUs (CUDA.jl, AMDGPU.jl, KernelAbstractions.jl and Reactant.jl) efficiently, and call LLMs from Julia with PromptingTools.jl and local models through Ollama or LlamaCpp.jl. Finally you will make research code reliable with ReTestItems, Aqua and JET, and package it with Pkg and PackageCompiler or JuliaC. Versions are as of October 2026 (Julia 1.13, ModelingToolkit v11).

What you will be able to do

  • Formulate a mechanistic model in OrdinaryDiffEq or ModelingToolkit and identify which terms are candidates for a learned component
  • Build and train a universal differential equation or neural ODE with Lux, SciMLSensitivity and Optimization.jl
  • Choose an automatic differentiation backend and sensitivity algorithm for a given model size and stiffness, and diagnose gradient failures
  • Recover an interpretable equation from a trained hybrid model with sparse regression or symbolic regression
  • Train and run models efficiently on multithreaded CPUs and NVIDIA or AMD GPUs, avoiding type instability and excess allocation
  • Call hosted and local LLMs from Julia with PromptingTools.jl for structured extraction and code assistance in scientific workflows
  • Test, benchmark and package a SciML project so that its results are reproducible

Syllabus

6 modules · 20 lessons · about 16 hours

Module 1: Julia and SciML Foundations

The language features and modeling tools that SciML builds on.
3 lessons
  1. Julia for scientists: multiple dispatch, type stability and environments
  2. Solving ODEs with OrdinaryDiffEq: problems, solvers, stiffness and tolerances
  3. Acausal modeling with ModelingToolkit

Module 2: Hybrid Models: Universal Differential Equations

Adding neural networks to mechanistic models and training them.
4 lessons
  1. Neural networks in Lux: explicit parameters and states
  2. Neural ODEs and universal differential equations
  3. Gradients through solvers: SciMLSensitivity with Enzyme, Zygote and Mooncake
  4. Training strategies: multiple shooting, optimizer choice and Optimization.jl

Module 3: Physics-informed Learning and Discovery

Using physics as a constraint and recovering equations from data.
3 lessons
  1. Physics-informed neural networks with NeuralPDE
  2. Equation discovery with DataDrivenDiffEq and SymbolicRegression.jl
  3. Surrogate models for expensive simulations with Surrogates.jl and neural operators

Module 4: Performance, Concurrency and GPUs

Making scientific ML fast on the hardware you have.
4 lessons
  1. Profiling and type stability: finding allocations and dynamic dispatch
  2. Multithreading with OhMyThreads and distributed ensembles
  3. GPU computing with CUDA.jl, AMDGPU.jl and KernelAbstractions
  4. Compiling models with Reactant for accelerators

Module 5: LLMs in Scientific Julia Code

Practical language-model use around research code.
3 lessons
  1. PromptingTools.jl: hosted and local models, templates and structured extraction
  2. Local inference with Ollama and LlamaCpp.jl for sensitive research data
  3. AI coding assistants for Julia: what they get wrong and how to check them

Module 6: Reliable and Reproducible Research Software

Testing, packaging and sharing SciML work.
3 lessons
  1. Testing with ReTestItems, Aqua and JET
  2. Reproducible environments, benchmarks and validation against known solutions
  3. Packaging and deployment: Pkg, PackageCompiler and JuliaC

Exam and certificate

The exam unlocks once you have completed every lesson. It draws 20 questions from a larger bank, spread across the modules, with the answer options shuffled for each attempt. You have 40 minutes and need 80% to pass. After a failed attempt you can try again after 24 hours, up to 3 attempts in total. Feedback is given per module, never as the answer key.

Passing earns a certificate of completion and assessment from the Wirewalk Institute of AI with a unique ID that anyone can check at institute.wirewalk.com/verify. It is not an accredited qualification or a vendor certification. How certification works.

The Wirewalk Institute of AI is independent. This course teaches publicly documented products and is not affiliated with or endorsed by JuliaLang, SciML (DifferentialEquations.jl, ModelingToolkit.jl, SciMLSensitivity.jl), Lux.jl, Flux.jl, Enzyme.jl, Reactant.jl, NVIDIA (CUDA.jl), AMD (AMDGPU.jl), JuliaHub, OpenAI, Anthropic, or Ollama. Product and company names are trademarks of their respective owners.

More in AI in Software Development

All 19 courses in this track
dev-001 Free intro Available

Your First AI API Call: A One-Hour Hands-On Start

A free, one-hour, hands-on start built on one realistic job: sorting a property manager's 1,150 monthly maintenance requests. You get an API key the safe way, make real calls with curl and an official Python SDK, run them over forty work orders, read stop reasons, usage and errors, estimate the monthly cost, and decide whether the script is ready. Exercises run on your own provider account for well under a dollar.

1 h · 7 lessons Free intro
dev-201 Intermediate Available

Python AI Integration: SDKs, Async, Pydantic, Packaging and Testing

A code-first course on integrating LLMs into Python the way production code needs it: uv projects and secrets, the OpenAI, Anthropic and Google GenAI SDKs side by side, async concurrency and streaming, Pydantic structured outputs and tools, retries, local models, embeddings and RAG, FastAPI and pandas integration, testing and evals with pytest, observability, cost tracking and deployment.

15 h · 19 lessons See price at checkout
dev-202 Intermediate Waitlist

Perl and AI: Modernizing Scripts and Text Pipelines with LLM APIs

Call OpenAI, Anthropic, Gemini and local Ollama models from Perl with real CPAN modules, add streaming, concurrency and validated JSON output to text pipelines, and use AI coding assistants to modernize legacy Perl behind characterization tests.

12 h · 18 lessons Join the waitlist