Hi everyone!

We have 496 submissions for homework 2. The form is finally closed. Thanks everyone for your hard work!

The solution: https://www.youtube.com/watch?v=L04lvYqNlc0

Here's the updated leaderboard: https://docs.google.com/spreadsheets/d/e/2PACX-1vTbL00GcdQp0bJt9wf1ROltMq7s3qyxl-NYF7Pvk79Jfxgwfn9dNWmPD_yJHTDq_Wzvps8EIr6cOKWm/pubhtml

We also recalculated the learning in public scores for 1b homework, it should have been capped at 1 point, not 7

Have fun with week 3 materials and homework!

Hi everyone!

This week we won't be able to have office hours at the regular time slot. We will record the answers to your questions asynchronously during the week

Ask your questions here: https://app.sli.do/event/rbNtvscFPbrjtaXeHEhhmT

Also, Jeff recorded answers to Prefect questions remaining from the last office hours here: https://share.descript.com/view/bKi2UoDlxIl (we'll upload this video to YouTube soon)

We'll publish the homework for week 4 soon, and while it's being prepared, the form for submitting week 3 homework will remain open

Homework 3 deadline is extended by 2 days till Wednesday. Have fun!

We're starting (started yesterday) week 4 - analytics engineering and dbt!

- course materials: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/week_4_analytics_engineering
- homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/week_4_analytics_engineering/homework.md

Also, next week, we'll have a workshop that builds on the materials of this week - we will see how to use PipeRider and dbt to detect errors in models and data

The workshop is a part of the course, but optional, and there will be optional homework too. If you can't attend it live, you can watch it later at any convenient time

If you need a reminder, you can sign up here: https://eventbrite.com/e/535584366257

Many of you noticed that there are some discrepancies in the homework answers. We're working on addressing it. For now, please just take note of your answers and submit them later, when we update the form

Hi everyone!

We've updated the answer options for homework 4 and extended the deadline till next Saturday.

If the answer you get still doesn't match any options - don't worry. Just select the option that is closest to your answer and move on

Here's the link to the homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/week_4_analytics_engineering/homework.md

Have fun!

Hi everyone 👋

Here are the answers to some of your office hours questions:

https://www.loom.com/share/2c2ba74f3e0b40828c1ea3c09276395e

Today we won't have live office hours again, but as always you can ask your questions using this link:

https://app.sli.do/event/rbNtvscFPbrjtaXeHEhhmT

And also remember that on Wednesday we will have a workshop:

https://eventbrite.com/e/535584366257

Workshop live stream: https://www.youtube.com/watch?v=O-tyUOQccSs

(You can watch it later in recording too)

Answer to office hours questions about bdt from Victoria: https://www.youtube.com/watch?v=ODYg_r72qaE

Remember that you can always ask any question using this link: https://app.sli.do/event/rbNtvscFPbrjtaXeHEhhmT. We won't have live office hours next week too, so keep your questions coming and we will record another video with the answers.

The dbt homework form is due today 22:00 CET but since it's Saturday, we might accidentally forget to close it in time.

If you finished with your dbt homework, don't forget that you can also experiment with PipeRider and there's homework for it too: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/workshops/piperider.md

We also updated the deadline calendar - shifted everything by one week: https://docs.google.com/spreadsheets/d/e/2PACX-1vSm_klXN3BzrRr7EjpEu_TDTZIQRkoEcCJriF3JdZgk6kPEHD1mxDQn8JvpEzCDpndQB-jE8red3NJj/pubhtml

Hi everyone!

We closed the form for homework 4 and updated the leaderboard. Some of you noticed that the homework this year was the same as last year - so the solution is the same (but the answers are different, we published the correct answers in the homework file)

https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/week_4_analytics_engineering/homework.md#solution

Also, we updated week 5 slightly:

First, the navigation is now fixed in the week folder: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/week_5_batch_processing

And second, we finally prepared and uploaded the missing video (5.6.4)

Homework for week 5: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/week_5_batch_processing/homework.md

Have fun!

And don't forget about the PipeRider workshop - the tool is great, check it out if you haven't

Hi everyone!

We're extending the deadline for week 5 homework by 3 days - the new due date is Thursday 10 March, 22:00 CE

Here is the recording with answers to your questions: https://www.loom.com/share/a603ebe8660f488a9f6cc9db5023c4e1

As usual, you can ask more questions using this link: https://app.sli.do/event/rbNtvscFPbrjtaXeHEhhmT

Also, we're starting a new week about streaming and Kafka. Check the week 6 folder for more information

Have fun!

Hi everyone!

A few announcements:

We're extending the deadline for week #6 by one week - the updated deadline is the next Monday.

There are also videos that use Python for week #6, but unfortunately we had technical problems when recording the videos and the sound is not great. The subtitles for these videos are good though, so you can use them - and also check the code

We know that some of you already started working on your projects (it's a really good idea, especially if you finished week 6). The form for submitting the project is already open, you can find the link here:

https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/project.md

And as always, you can ask any questions using the office hours slido link: https://app.sli.do/event/rbNtvscFPbrjtaXeHEhhmT
We will be recording answers to your questions soon

We also extended the deadline for the piperider workshop - you have one more week to finish the homework

https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/workshops/piperider.md

Also PipeRider will give us swag for completing the homework. There are only 12 swag packages, so we will choose the winners randomly.

Have fun!

Now it's time to put everything you learned to practice!

We're starting to work on the project! You can learn more about the requirements here: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/week_7_project/README.md

To submit your project, use the links here: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/project.md

Also, if you want to check the projects from the last year, you can find them here

https://docs.google.com/spreadsheets/d/e/2PACX-1vShnv8T4iY_5NA8h0nySIS8Wzr-DZGGigEikIW4ZMSi9HlvhaEB4RhwmepVIuIUGaQHS90r5iHR2YXV/pubhtml# (note that there are two tabs there - each with different projects)

have fun!

We're extending the deadline for submitting your project till Monday 22:00 CET. Use this time wisely and have fun

Hi everyone!

Great work on the projects! Now it's time to evaluate your peers.

We've updated the page with the projects (https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/project.md), now it contains two more links:

- Peer review assignments: https://docs.google.com/spreadsheets/d/e/2PACX-1vRYQ0A9C7AkRK-YPSFhqaRMmuPR97QPfl2PjI8n11l5jntc6YMHIJXVVS0GQNqAYIGwzyevyManDB08/pubhtml?gid=0&single=true
- Evaluation form: https://forms.gle/1bxmgR8yPwV359zb7

To find the projects assigned to you, use the first link (peer review assignments) and find your hash in the first column. You will see three rows: you need to evaluate each of these projects. For each project, you need to submit the form once, so in total, you will make three submissions.

Use this as an opportunity to learn from your peers - and you will learn a lot.

But also remember - if you don't do peer review, you will fail your projects.

Have fun!

Also - the form for submitting project attempt #2 is open, so if you didn't have time to work on your project yet, now you can do it.

We've finally evaluated the homework for piperider

Here's the updated leaderboard: https://docs.google.com/spreadsheets/d/e/2PACX-1vTbL00GcdQp0bJt9wf1ROltMq7s3qyxl-NYF7Pvk79Jfxgwfn9dNWmPD_yJHTDq_Wzvps8EIr6cOKWm/pubhtml

We're working on recording the video with the solutions and selecting the swag winners from those who submitted the homework.

Great work on the projects!

Here is the feedback: https://docs.google.com/spreadsheets/d/e/2PACX-1vQuMt9m1XlPrCACqnsFTXTV_KGiSnsl9UjL7kdTMsLJ8DLu3jNJlPzoUKG6baxc8APeEQ8RaSP1U2VX/pubhtml?gid=27207346&single=true

The updated leaderboard: https://docs.google.com/spreadsheets/d/e/2PACX-1vTbL00GcdQp0bJt9wf1ROltMq7s3qyxl-NYF7Pvk79Jfxgwfn9dNWmPD_yJHTDq_Wzvps8EIr6cOKWm/pubhtml

Dave recorded the solution to the PipeRider homework. You can check it here: https://www.youtube.com/watch?v=inNrUys7W8U&list=PL3MmuxUbc_hJjEePXIdE-LVUx_1ZZjYGW

We have two announcements

First, the deadline for the project is extended by one week. The new due date is the 4th of May

Also, we have generated the certificates for those who completed the first project. Here's an example: https://certificate.datatalks.club/dezoomcamp/2023/fe629854d45c559e9c10b3b8458ea392fdeb68a9.pdf

Instructions how to get a certificate: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cerficates.md

Later (hopefully not too late) you will receive an email with your personal link, but for now you can generate this link yourself. Pay attention to the hash - it's not the same as in the leaderboard