We start Module 3 on Data Warehousing and BigQuery
Reminder: the previous homework deadline is in less than 24 hours.
This module covers:
🔸 Data warehouse fundamentals and BigQuery basics
🔸 Query performance and internals (partitioning, clustering, best practices)
🔸 Machine learning in BigQuery, including SQL for ML
🔸 Deploying models from BigQuery using Docker
Learn here: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/03-data-warehouse
We're finalizing Homework 3 and will notify you when it's ready.
Reminder: the previous homework deadline is in less than 24 hours.
This module covers:
🔸 Data warehouse fundamentals and BigQuery basics
🔸 Query performance and internals (partitioning, clustering, best practices)
🔸 Machine learning in BigQuery, including SQL for ML
🔸 Deploying models from BigQuery using Docker
Learn here: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/03-data-warehouse
We're finalizing Homework 3 and will notify you when it's ready.
GitHub
data-engineering-zoomcamp/03-data-warehouse at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼 - DataTalksClub/data-engineering-zoomcamp
❤23😁2👍1👎1
Reminder: today at 17:00 CET (in 10 hours from now) we have a live stream
We will share the link 5-10 minutes before the start
See you soon!
We will share the link 5-10 minutes before the start
See you soon!
❤21🔥3
homework 3:
https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2026/03-data-warehouse/homework.md
have fun!
https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2026/03-data-warehouse/homework.md
have fun!
GitHub
data-engineering-zoomcamp/cohorts/2026/03-data-warehouse/homework.md at main · DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼 - DataTalksClub/data-engineering-zoomcamp
❤17👎1
Yesterday I (Alexey) answered some of your questions that we left unanswered during the launch stream
https://www.youtube.com/watch?v=C-akHAp3XM0
https://www.youtube.com/watch?v=C-akHAp3XM0
YouTube
Data Engineering Zoomcamp 2026 - Q&A Bonus Session
In this Data Engineering Zoomcamp Q&A Bonus Session, Alexey Grigorev (Founder of DataTalks.Club) dives into a Slido backlog of over 300 community questions. He shares expert insights on the logistics of the 2026 bootcamp, the financial sustainability of free…
❤17
We start Module 4 on Analytics Engineering (dbt)
Reminder: the previous homework deadline is in less than 24 hours.
This module focuses on transforming warehouse data into analytical models using dbt.
You’ll build a dbt project on NYC yellow and green taxi data (2019-2020) and cover analytics engineering fundamentals, data modeling, and dbt in practice.
Setup options:
• Local: DuckDB + dbt Core (free, no prerequisites)
• Cloud: BigQuery + dbt Cloud (requires Module 3)
👉🏼 Materials
Homework 4:
• Homework assignment
• Submit here
Deadlone for this homework: 17 February 12 AM CET
Big thanks to Juan Manuel Perafan for updating this module, originally recorded by Victoria Perez Mola!
Reminder: the previous homework deadline is in less than 24 hours.
This module focuses on transforming warehouse data into analytical models using dbt.
You’ll build a dbt project on NYC yellow and green taxi data (2019-2020) and cover analytics engineering fundamentals, data modeling, and dbt in practice.
Setup options:
• Local: DuckDB + dbt Core (free, no prerequisites)
• Cloud: BigQuery + dbt Cloud (requires Module 3)
👉🏼 Materials
Homework 4:
• Homework assignment
• Submit here
Deadlone for this homework: 17 February 12 AM CET
Big thanks to Juan Manuel Perafan for updating this module, originally recorded by Victoria Perez Mola!
❤19👍5
We received a few reported cases of people misusing the "Learning in Public" scoring. These course participants were submitting links that were not social media posts sharing their progress, but rather random links they found on the internet while researching topics.
This is against the rules. As a consequence, these two participants can no longer earn points for "Learning in Public." I still want to encourage them to continue the practice because it is for their own benefit, but we are against misusing the system just for the sake of getting points. That is why the "Learning in Public" rewards have been disabled for them.
If you come across anyone on the leaderboard who is misusing this system by posting links that are not their personal posts about what they are learning in the course, please report it in the course channel.
This is against the rules. As a consequence, these two participants can no longer earn points for "Learning in Public." I still want to encourage them to continue the practice because it is for their own benefit, but we are against misusing the system just for the sake of getting points. That is why the "Learning in Public" rewards have been disabled for them.
If you come across anyone on the leaderboard who is misusing this system by posting links that are not their personal posts about what they are learning in the course, please report it in the course channel.
👍56❤5
This week, we're starting Module 5: Data Platforms.
Reminder: the previous homework deadline is in less than 24 hours
In this module, you'll learn how modern data platforms manage the full data lifecycle, from ingestion to transformation, orchestration, data quality, and metadata.
We'll use Bruin as a practical example of a unified data platform. You'll install it, create a project, and build an end-to-end pipeline using NYC taxi data with a three-layer architecture: ingestion, staging, and reporting.
You'll also set up connections, configure pipelines in YAML, run Python and SQL assets, and see how orchestration and data quality fit into a single workflow.
Homework:
• Homework 5
• Deadline: 1st March, 12:00 AM CET
🎁 Bonus: Bruin is offering a Claude Pro subscription to participants who complete their final project using Bruin.
Reminder: the previous homework deadline is in less than 24 hours
In this module, you'll learn how modern data platforms manage the full data lifecycle, from ingestion to transformation, orchestration, data quality, and metadata.
We'll use Bruin as a practical example of a unified data platform. You'll install it, create a project, and build an end-to-end pipeline using NYC taxi data with a three-layer architecture: ingestion, staging, and reporting.
You'll also set up connections, configure pipelines in YAML, run Python and SQL assets, and see how orchestration and data quality fit into a single workflow.
Homework:
• Homework 5
• Deadline: 1st March, 12:00 AM CET
🎁 Bonus: Bruin is offering a Claude Pro subscription to participants who complete their final project using Bruin.
👍19❤10🔥7🙈1
Reminder: tomorrow we’re running a hands-on workshop on AI-Assisted Data Ingestion with dlt as part of the Data Engineering Zoomcamp.
Date: Tuesday, February 17
Time: 4:30 PM CET
Place: Live on YouTube
Join Aashish Nair, who’ll lead the session, to build a reliable ingestion pipeline into a data warehouse (for example, Snowflake) using dlt from dltHub.
We’ll go through:
• Extracting data from APIs, files, and databases
• Normalizing it into consistent schemas
• Writing it to a warehouse
• Using LLMs to accelerate pipeline development
• Validating data and schema changes with the dlt dashboard and dlt MCP
By the end, you’ll understand how to design maintainable ingestion pipelines and use AI and validation tools to build them faster.
Register to get the join link:
https://luma.com/hzis1yzp
Date: Tuesday, February 17
Time: 4:30 PM CET
Place: Live on YouTube
Join Aashish Nair, who’ll lead the session, to build a reliable ingestion pipeline into a data warehouse (for example, Snowflake) using dlt from dltHub.
We’ll go through:
• Extracting data from APIs, files, and databases
• Normalizing it into consistent schemas
• Writing it to a warehouse
• Using LLMs to accelerate pipeline development
• Validating data and schema changes with the dlt dashboard and dlt MCP
By the end, you’ll understand how to design maintainable ingestion pipelines and use AI and validation tools to build them faster.
Register to get the join link:
https://luma.com/hzis1yzp
Luma
From APIs to Warehouses: AI-Assisted Data Ingestion with dlt · Luma
This hands-on workshop focuses on building reliable data ingestion pipelines to data warehouses (for example, Snowflake) using dlt (data load tool), enhanced…
👍11❤9🔥7👎1
We're starting the workshop!
Stream: https://www.youtube.com/watch?v=5eMytPBgmVs
Code: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2026/workshops/dlt.md
watch now or later in recording
Stream: https://www.youtube.com/watch?v=5eMytPBgmVs
Code: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2026/workshops/dlt.md
watch now or later in recording
YouTube
From APIs to Warehouses: AI-Assisted Data Ingestion with dlt - Aashish Nair
In this workshop, Aashish from dltHub demonstrates a new standard for data engineering. We move away from manual scripting and toward an AI-assisted workflow that uses the open-source dlt (data load tool) library to build robust, self-healing pipelines in…
❤8👍7🙉1
On Monday at 16:00 CET we will have a live session
Add it to your calendar! We will share the link to the stream 5-10 minutes before the start
If you want a reminder, I created a luma event: https://luma.com/m258fy6w
Add it to your calendar! We will share the link to the stream 5-10 minutes before the start
If you want a reminder, I created a luma event: https://luma.com/m258fy6w
Luma
Data Engineering Zoomcamp 2026 office hours · Luma
Office hours in Data Engineering zoomcap
❤11
This week, we continue working on Module 5: Data Platforms.
In this module, you'll learn how modern data platforms handle the data lifecycle, including ingestion, transformation, orchestration, and data quality.
Using Bruin as a practical example, you'll install the platform, create a project, and build an end-to-end pipeline with NYC taxi data. The pipeline will include three layers: ingestion, staging, and reporting.
You can submit Homework 5 before March 1.
In this module, you'll learn how modern data platforms handle the data lifecycle, including ingestion, transformation, orchestration, and data quality.
Using Bruin as a practical example, you'll install the platform, create a project, and build an end-to-end pipeline with NYC taxi data. The pipeline will include three layers: ingestion, staging, and reporting.
You can submit Homework 5 before March 1.
👍7❤3🔥2
We also recently had a workshop with dlt on AI-assisted data ingestion.
Watch the recording and check out the code if you missed it.
Practice what you learned in the homework assignment, and submit it here.
Watch the recording and check out the code if you missed it.
Practice what you learned in the homework assignment, and submit it here.
👍5❤3🔥3
Today at 16:00 CET (in 90 minutes) we have office hours
You can use this link if you want to ask any question in advance:
https://app.sli.do/event/r22cR71X67cQ7gHacVu7LG
See you soon!
You can use this link if you want to ask any question in advance:
https://app.sli.do/event/r22cR71X67cQ7gHacVu7LG
See you soon!
app.sli.do
Join Slido: Enter #code to vote and ask questions
Participate in a live poll, quiz or Q&A. No login required.
❤4
We're starting in 4 minutes:
Stream: https://www.youtube.com/watch?v=o28p3Y2CS9A
Questions: https://app.sli.do/event/r22cR71X67cQ7gHacVu7LG
Watch now or later in recording
Stream: https://www.youtube.com/watch?v=o28p3Y2CS9A
Questions: https://app.sli.do/event/r22cR71X67cQ7gHacVu7LG
Watch now or later in recording
YouTube
Data Engineering Zoomcamp 2026 - Office Hours (Bruin and Data Platforms)
In this session, Alexey Grigorev is joined by Arsalan from the Bruin team to discuss the evolution of data platforms. We explore how Bruin integrates ingestion, transformation, orchestration, and data quality into a single interface, offering an alternative…
❤4
This is the link I promised to share:
https://getbruin.com/zoomcamp-project/
You get a chance to win Claude Code subscription if you use Bruin in your project
https://getbruin.com/zoomcamp-project/
You get a chance to win Claude Code subscription if you use Bruin in your project
Bruin
Data Engineering Project Competition | Bruin
The Bruin Project Competition is closed and winners have been announced.
👍12❤3
The course management platform is currently down
I'm working on restoring it
I'm working on restoring it
❤19🙏3🔥1
Update: I've spent one hour on a call with AWS and they said they needed more time to restore the database.
Hopefully tomorrow it'll get sorted out
Hopefully tomorrow it'll get sorted out
❤21👍10😨9
The course management platform is back!
If you submitted any homework yesterday, the data may be lost. Please check your homework submissions.
Apologies for the inconvenience!
I'm working on the incident report and will publish it soon. TLDR: don't let your AI agents do
If you submitted any homework yesterday, the data may be lost. Please check your homework submissions.
Apologies for the inconvenience!
I'm working on the incident report and will publish it soon. TLDR: don't let your AI agents do
terraform apply -auto-approve❤25🤣19🔥3