2.5 Practical exercise

Lesson

2.5 Practical exercise

This exercise walks you through creating your first pipeline in Mage Pro. You'll set up a basic batch pipeline that demonstrates the creation workflow and establishes the foundation for data processing work.

Prerequisites

  • Access to a Mage Pro cluster workspace

Step-by-step exercise

Step 1: Navigate to the Pipelines page and begin creating a new pipeline

Step 2: Choose the type of pipeline that would collect data on a daily schedule

Step 3: Configure the basic settings of the pipeline

  • Set name to "my first pipeline"

  • Add description: "Learning exercise: Basic pipeline for data processing"

  • Add tags: "learning" and "exercise"

Step 4: Create the pipeline

Conclusion

You've created the foundation for a data pipeline that will serve as your framework for learning data processing concepts. This pipeline is now ready to receive the blocks that will perform actual data transformations in future exercises. The creation process you just completed represents the starting point for all data engineering projects in Mage Pro.