Stranger Things release 👾🩸

Powered by curiosity. Guided by connection.

The Stranger Things release opens a new dimension in Mage Pro - where data flows across realms, power meets precision, and pipelines gain a supernatural edge. From real-time MSSQL CDC streaming to GCS-backed Delta Lake exports, this update makes every workflow feel alive... and a little stranger.

Flip your pipelines upside down. 🔄

🚀 New Features

1. MSSQL CDC support

   

   Capture SQL Server database changes in real-time using Mage Pro's CDC streaming source with built-in schema tracking and primary key detection. Connect to CDC-enabled tables and instantly stream structured change records into your pipelines.
   📜 Doc: https://docs.mage.ai/guides/streaming/sources/mssql-cdc

2. Support exporting to GCS Delta Lake in streaming pipelines
   Stream real-time data directly into GCS-backed Delta Lake tables with Mage Pro's native Delta format integration. Get lakehouse capabilities with ACID transactions, schema evolution, and time travel - no custom code required.
   📜 Doc: https://docs.mage.ai/guides/streaming/destinations/google-cloud-storage#delta-lake-configuration

3. Support automated Git push jobs
   Adds first-class support for automatically pushing changes to Git repositories as part of pipeline execution. Mage pipelines can now be configured to push files to a remote repository with customizable commit messages, branches, and remotes, enabling GitOps-style workflows.
   📜 Doc: https://docs.mage.ai/guides/data-sync/git-client#setting-up-automated-git-push-jobs

4. Provide ARM-based and multi-Python Mage Pro images
   Mage Pro now provides ARM-based container images and images built with Python 3.11 and Python 3.12, enabling better performance, lower cost, and broader compatibility.

   These images are available across all Mage Pro deployment options, including:

   • SaaS

   • Hybrid cloud

   • Private cloud

   • On-prem deployments

5. Delete pipeline runs from Pipeline Trigger view
   Allows users to directly delete pipeline runs from the trigger interface for improved operational control.

🏗 Deployment Enhancements

• Enhanced deployment creation and logs
  Improves deployment visibility with clearer status reporting and more actionable logs.

• Fix errors when connecting to Git providers for deployments
  Increases reliability of Git-based deployments in enterprise environments.

🧩 Workspace Enhancements

• Add workspace update command
  Enables controlled workspace updates via CLI or automation.

• Support setting workspace environment variable patterns
  Allows regex-based inheritance of environment variables across workspaces.

• Enhance inputs for workspace lifecycle configuration
  Improves clarity and usability of workspace lifecycle management settings.

• Support prefix as workspace path type
  Provides more flexible workspace routing and path definitions.

• Fix NoneType issues when inheriting annotations
  Prevents runtime errors when workspace-level annotations are inherited or overridden.

• Auto-update workspace management cluster status
  Fixes delays where the workspace management cluster status did not immediately update to pending after UI-driven changes (e.g. updating environment variables or stopping a cluster).

🔌 Data Integration Enhancements

• Handle generated columns in Postgres CDC
  Correctly processes generated columns in CDC pipelines.

• Fix data integration transformer schema issues
  Improves schema consistency and reliability across transformations.

• Support refreshing Xero tokens
  Ensures long-running Xero integrations remain authenticated.

• Fix type errors when loading data integration catalog metadata
  Prevents runtime failures caused by metadata type mismatches.

⚙️ Other Enhancements & Bug Fixes

• Retry pipeline runs by run ID
  Allows retrying a pipeline run by referencing a previous run. The new run inherits and merges variables from the original run, ensuring consistent execution context while allowing overrides. Retries are securely restricted to the same pipeline.

• Support hiding variables in UI for large pipeline runs
  Improves UI performance by avoiding rendering and transferring large variable payloads when inspecting pipeline runs.

• Support reconnecting to DB when connection is closed
  Improves stability for long-running pipelines.

• Fix pipeline executor getting stuck
  Resolves edge cases where executors could hang indefinitely.

• Speed up kernel execution
  Reduces kernel startup and execution overhead.

• Make NumPy compatible with v2
  Ensures forward compatibility with upcoming Python ecosystems.

• Improve UI performance

  • Faster theme building via caching and optimized object operations

  • Improved file editor performance

• Fix various UI issues

  • Block settings updates

  • Pipeline UUID filtering

  • General stability and polish

• Improve Microsoft Entra (Azure AD) sign-in error display
  Provides clearer error feedback during authentication failures.

⚡ The Upside Down of Data Starts Here

The Stranger Things release blends flexibility, streaming power, and operational precision into one platform.

Update Mage Pro today and bring your data stack to life from the other side. 👾