1.4 Project Preview

This project-based course leverages the popular Chicago Crime dataset, providing hands-on experience in data engineering. By working with real-world data, you'll gain practical skills in designing and implementing effective data pipelines.

Using Mage you will:

1. Ingest crime data from the Chicago Data Portal

2. Transform data using Mage SQL blocks

3. Load data into a BigQuery data warehouse or data warehouse of your choice

4. Create a trigger to run daily batches

Figure 1: Final project data architecture

Utilizing Mage, participants will learn to collect, transform, and orchestrate robust data pipelines, tackling real-world data challenges. By the end of the course, you'll be equipped with the skills to build scalable and efficient data infrastructures that support advanced analytics and drive informed decision-making.