5.6 Practical Exercise

Lesson

5.6 Practical Exercise

Scenario

You've successfully built your 311 data pipeline in Mage Pro with an API data loader and bronze layer SQL transformer. Now it's time to sync this working pipeline to your GitHub repository for version control and deployment.

Exercise Requirements

Use the Git Terminal to:

  • Check the status of your pipeline files

  • Checkout to a git feature branch

  • Stage all your pipeline files for version control

  • Commit your changes with a professional message

  • Push your code to GitHub

  • Verify your pipeline appears in the repository

Step-by-step implementation

Step 1: Access the Git Terminal

  1. Navigate to "Version control" from the left menu

  2. Verify you're in the correct project directory

  3. Check what files are ready to be committed

  4. Checkout to a Git feature branch not main or master

Step 2: Stage your pipeline files Add all your pipeline files to version control and verify what's been staged.

Step 3: Create your first commit Write a professional commit message that describes your 311 pipeline:

  • Mention it's an initial commit

  • Describe the API data loader component

  • Note the bronze layer SQL transformer

  • Reference the BigQuery integration

Step 4: Push to GitHub Send your committed changes to your GitHub repository. Consider creating a feature branch for best practices.

Step 5: Verify in GitHub

  1. Open your GitHub repository in a browser

  2. Confirm your pipeline files are visible

  3. Check that your commit message appears in the history

Expected results

  • Your 311 pipeline code is now version controlled in GitHub

  • Professional commit history with descriptive messages

  • Repository is ready for team collaboration and deployment

  • Deployment interface shows your recent commits