Wirewalk Instituteof AI

dat  Track

Data engineering and quality training for AI

Pipelines, unstructured data, labeling, synthetic data and data quality for AI systems.

5 courses3 Intermediate2 Expert Filter in the catalog

Choose an AI learning path for your work

Begin with the data work that limits your AI project. Documents may need an extraction pipeline, training sets may need annotation, and reused data may need clearer lineage. Public course topics cover these areas alongside synthetic data and quality governance. Compare the syllabus with your data sources and responsibilities to choose a suitable starting point. Read prerequisites and individual availability before planning study, especially when a specialist topic depends on engineering experience.

Who these courses are for

  • Data engineers
  • Annotation operations leads
  • Data governance analysts

Learning questions to explore

  • Compare document processing pipeline topics
  • Explore annotation quality and labeling operations
  • Identify lineage and quality checks for AI data

Find your starting point

This curriculum is planned; no courses in this track are open yet. Explore available AI foundation courses while you compare the planned syllabuses.

Available courses are open for enrollment. Waitlisted courses are still being prepared or reviewed.

Compare this track in the course catalog

Related learning: Building AI Applications · Model Development · Governance, Risk and Compliance

Intermediate

For practitioners who use or build with AI. · 3 courses
dat-201 Intermediate Waitlist

Data Engineering for AI

How data pipelines for AI differ from analytics pipelines, and how to build them: lakehouse storage with Parquet and Iceberg or Delta, distributed processing with Spark, Ray Data and DuckDB, text cleaning, filtering and MinHash deduplication at corpus scale, dataset versioning, orchestration with Airflow or Dagster, and feeding GPUs efficiently at training time.

15 h · 18 lessons Join the waitlist
dat-210 Intermediate Waitlist

Document Processing and Unstructured Data Pipelines

Build production pipelines for unstructured documents: format detection and text extraction, layout analysis and reading order, OCR and vision-language parsers, table and form extraction, schema-driven field extraction with LLMs, human review loops, and running it all at scale with measured accuracy and cost.

14 h · 19 lessons Join the waitlist
dat-220 Intermediate Waitlist

Data Labeling and Annotation Operations

Run annotation as an operation with measurable quality: task design and guidelines, labeling tools such as Label Studio, CVAT and Argilla, in-house versus vendor workforces, inter-annotator agreement, gold questions and adjudication, model-assisted and active-learning workflows, and the human preference and rubric labeling used for LLM post-training and evaluation.

12 h · 18 lessons Join the waitlist

Expert

Deep technical work for specialists. · 2 courses
dat-310 Expert Waitlist

Synthetic Data Generation

An expert course on generating and validating synthetic data: LLM-generated instruction, reasoning and tool-use data (Self-Instruct, Evol-Instruct, persona-driven and verifier-filtered generation), distillation, synthetic evaluation sets, tabular synthesis with SDV and differential privacy, fidelity, utility and privacy metrics, model-collapse risk, and the license terms that govern using model outputs.

18 h · 19 lessons Join the waitlist
dat-320 Expert Waitlist

Data Quality, Lineage and Governance for AI

An expert course on making AI data trustworthy and auditable: AI-specific quality dimensions, data contracts and automated tests with Great Expectations, Soda and dbt, column- and dataset-level lineage with OpenLineage and catalogs such as DataHub and Unity Catalog, dataset documentation with datasheets and Croissant, and the data obligations in the EU AI Act, GDPR and copyright opt-out regimes.

18 h · 20 lessons Join the waitlist