Foundations.
This introductory course takes you from zero to fully operational - covering setup, building your first pipelines, and integrating with CI/CD. In just a few lessons, you’ll have the skills and confidence to run Mage like a pro and bring your data workflows to life.
Introduction
Learn the essentials to start building and delivering with Mage
Setup
Get up and running as quickly and easily as possible
Blocks
Harness building blocks to create, enhance, and customize workflows
Configurations
Take total control of the platform with in-depth config controls
CI/CD
Deploy piplines at scale and keep them running efficiently
SQL Blocks
Leverage familiar conventions to shape data with agency
Triggers
Deliver data exactly where it need to go, exactly when it needs it
Final Project
Put into practive everything you have learned to create a real-world project
Full syllabus
1.1 What is data engineering?
1.2 How does Mage fit into data engineering
1.3 Introduction to blocks
1.4 Project Preview
1.5 Knowledge check
2.1 Cluster Management
2.2 Adding users
2.3 Creating workspaces
2.4 Creating pipelines
2.5 Practical exercise
3.1 Data loaders
3.2 Transformers
3.3 Data exporter
3.4 Scratchpad
3.5 Sensor
3.6 dbt
3.7 Power ups
3.8 Add on blocks
3.9 R Blocks
3.10 Adding blocks
3.12 Knowledge check
4.1 Environment Variables
4.2 Secrets
4.3 Practical exercise
4.4 io_config.yml file
4.5 Google Cloud Platform service account file
4.6 Practical exercise
4.7 Knowledge check
5.1 Introduction to CICD
5.2 Git commands
5.3 Set up Deployments
5.4 Version Control Application
5.5 Deploy code
5.6 Practical Exercise
5.7 Knowledge check
6.1 Introduction to SQL blocks
6.2 Use Mage SQL UI
6.3 Use raw SQL
6.4 Practice exercise
6.5 Knowledge check
7.1 Introduction to triggers
7.2 Run settings
7.3 Schedule trigger
7.4 API trigger
7.5 Trigger multiple pipelines
7.6 Practice exercise
7.7 Knowledge check
8.1 Intro to medallion architecture
8.2 Configure project
8.3 Sync code to repo
8.4 create data_loader
8.5 SQL data transformations
8.6 Create daily trigger
8.7 Knowledge Check
Certification