Foundations.
This introductory course takes you from zero to fully operational - covering setup, building your first pipelines, and integrating with CI/CD. In just a few lessons, you’ll have the skills and confidence to run Mage like a pro and bring your data workflows to life.
Introduction
Learn the essentials to start building and delivering with Mage
Setup
Get up and running as quickly and easily as possible
Configurations
Take total control of the platform with in-depth config controls
Blocks
Harness building blocks to create, enhance, and customize workflows
Triggers
Deliver data exactly where it need to go, exactly when it needs it
CI/CD
Deploy piplines at scale and keep them running efficiently
SQL Blocks
Leverage familiar conventions to shape data with agency
Final Project
Put into practive everything you have learned to create a real-world project
Full syllabus
1.1 What is data engineering?
1.2 How does Mage fit into data engineering
1.3 Introduction to blocks
1.4 Project Preview
1.5 Knowledge check
2.1 Cluster Management
2.2 Adding users
2.3 Creating workspaces
2.4 Creating pipelines
2.5 Practical exercise
2.6 Knowledge check
3.1 Environment Variables
3.2 Secrets
3.3 Google Cloud Platform service account file
3.4 io_config.yml file
3.5 Practical exercise
3.6 Practical exercise
3.7 Knowledge check
4.1 Data loaders
4.2 Transformers
4.3 Data exporter
4.4 Scratchpad
4.5 Sensor
4.6 dbt
4.7 Power ups
4.8 Add on blocks
4.9 R Blocks
4.10 Adding blocks
4.11 Practical exercise
4.12 Knowledge check
5.1 Introduction to triggers
5.2 Run settings
5.3 Schedule trigger
5.4 API trigger
5.5 Trigger multiple pipelines
5.6 Practice exercise
5.7 Knowledge check
6.1 Introduction to CICD
6.2 Git commands
6.3 Set up Deployments
6.4 Version Control Application
6.5 Deploy code
6.6 Practical Exercise
6.7 Knowledge check
7.1 Introduction to SQL blocks
7.2 Use Mage SQL UI
7.3 Use raw SQL
7.4 Practice exercise
7.5 Knowledge check
8.1 Building a Star Schema
8.2 Part 1: Build the Dimension Tables
8.3 Part 2: Build the Fact Table
8.4 Wrap-up