🛠️ Data Engineering Zoomcamp 2026

My homework solutions and projects for the Data Engineering Zoomcamp 2026 — a free course by DataTalks.Club covering the modern data engineering stack.

---

📚 Homework Solutions

#	Module	Topic	Tech Stack
1	Module1	Docker & SQL	Docker, PostgreSQL, Terraform, GCP
2	Module2	Workflow Orchestration	Kestra
3	Module3	Data Warehouse	BigQuery, dlt
4	Module4	Analytics Engineering	dbt, dimensional modeling
5	Module5	Data Platforms	Bruin
6	Module6	Batch Processing	Apache Spark (PySpark)
7	Module7	Streaming	PyFlink, Redpanda
🧪	Workshop	dlt Workshop	dlt, DuckDB, REST API

Each module folder contains a homework.md with the questions, my answers, and the code/queries used to derive them.

🚀 Capstone Project

SoCal NOD Tracker — Foreclosure Early-Warning Pipeline

An end-to-end pipeline tracking Notice of Default (NOD) filings across 6 Southern California counties — a leading indicator of foreclosure activity.

Daily CSVs → Kestra DAG → GCS (data lake) → BigQuery (raw) → dbt (marts) → Looker Studio

Stack: Terraform · Kestra · Google Cloud Storage · BigQuery · dbt · Looker Studio

See the full project README for architecture, reproduction steps, and the dashboard.

🧰 Tools & Technologies

Layer	Tools
Containerization	Docker, Docker Compose
Orchestration	Kestra
Data Lake	Google Cloud Storage
Data Warehouse	BigQuery, PostgreSQL, DuckDB
Ingestion	dlt
Transformation	dbt, Bruin
Batch Processing	Apache Spark / PySpark
Streaming	Apache Flink (PyFlink), Redpanda
Infrastructure as Code	Terraform
Visualization	Looker Studio

📂 Repository Structure

.
├── Module1/        # Docker & SQL
├── Module2/        # Workflow Orchestration (Kestra)
├── Module3/        # Data Warehouse (BigQuery, dlt)
├── Module4/        # Analytics Engineering (dbt)
├── Module5/        # Data Platforms (Bruin)
├── Module6/        # Batch Processing (Spark)
├── Module7/        # Streaming (PyFlink, Redpanda)
├── Workshop/       # dlt Workshop
└── project1/       # Capstone: SoCal NOD Tracker

🎓 About the Course

The Data Engineering Zoomcamp is a free, hands-on course covering data engineering fundamentals: containerization, workflow orchestration, data warehousing, analytics engineering, batch processing, and streaming.

👤 Author

Michael — @HighviewOne

📄 License

Released under the MIT License.

_{⭐ If you find this useful, consider giving it a star!}