Ensure you have followed the setup guide from Readme.md before starting.
All starter files live in dagscode/ -- Airflow does not watch that folder. To work on an exercise, copy the starter file into the dags/ folder that Airflow scans:
cp dagscode/<path>/<file>_starter.py dags/<path>/After copying, the DAG file processor picks it up within 30 seconds. Refresh the Airflow UI and the DAG will appear.
To peek at a finished solution:
cp dagscode/<path>/<file>_solution.py dags/<path>/Concepts
- Exercise 00 -- Your First DAG
- Exercise 01 -- Task Dependencies
- Exercise 02 -- Branching and Trigger Rules
- Exercise 03 -- Task Context
- Exercise 04 -- XCom
- Exercise 05 -- Retries
- Exercise 06 -- Connections and Hooks
- Exercise 07 -- Sensors
- Exercise 08 -- Scheduling
- Exercise 09 -- Assets
BookShop Pipeline (a real data pipeline, concept by concept)
- Exercise 10 -- Ingest the Books Catalog
- Exercise 11 -- Daily Sales Ingest
- Exercise 12 -- Validate Sales + Human-in-the-Loop
- Exercise 13 -- Genre Report