Modern Data Engineering Guide
How data gets from a raw source to trusted, query-ready tables, in 12 chapters: storage and file formats, SQL engines, modeling, Spark, ingestion and CDC, dbt, orchestration, streaming, and the lakehouse.
- Year
- 2026
Docusaurus · TypeScript · React · MDX · Mermaid
Project notes
- 12 chapters from foundations through storage and formats, SQL and query engines, modeling and warehousing, Spark, ingestion and CDC, dbt, orchestration, Kafka streaming, the lakehouse, data quality and governance, and career
- Each topic is taught as a concept first (columnar storage, desired-state pipelines, exactly-once delivery) and then mapped to the current tools: Snowflake, BigQuery, dbt, Airflow, Kafka, Iceberg, and Delta
- Built on the shared guide-kit design system with checkpoint quizzes and deployed on Vercel