Aloha to the Lilo & Stitch release! This update brings a wave of new features and playful enhancements to help you build smarter, more flexible data workflows. Here’s what’s new and improved:

🔌 Custom Data Integration Sources & Destinations

Plug in any data source or destination you can imagine! With our new custom integration framework, you’re no longer limited to built-in connectors. Build and connect to your unique data sources or sinks with ease.

📜 Read the docs

🐍 Show Proper Error Lines in Pipeline Editor

Debugging just got easier. The pipeline editor now highlights the exact lines where errors occur, so you can spot and fix issues in your notebook blocks instantly.

🔄 Support Returning Any Data Types in Blocks

Mage Pro now supports returning any data type from blocks — not just dataframes or JSON-serializable objects:

• Beyond DataFrames and JSON: Blocks can now return native Python objects, complex types, or custom classes without restrictions.

• Greater flexibility: Supports a wider range of machine learning models, intermediate computation results, and custom data structures directly from block outputs.

🌐 New Data integration sources: FB & IG

Stay tuned for fresh connectors! We’re expanding our library with even more data integration sources and destinations, making it easier to connect Mage to your entire data ecosystem.

• Facebook pages: Seamlessly ingest data from your Facebook Pages for richer social insights.

  • 📜 Facebook page docs

• Instagram: Connect to Instagram and pull in data to power your social analytics.

  • 📜 Instagram docs

📊 Pipeline Run / Block Run Job-Level Resource Monitoring

Track resource usage in real time. Our upcoming monitoring tools will let you see CPU, memory, and other metrics for each pipeline and block run—helping you optimize performance and control costs.

🧑‍💻 New AI Sidekick (WIP)

Meet your upcoming AI assistant - a work-in-progress feature that will help you build, debug, and optimize pipelines faster than ever. Get ready for smarter suggestions, contextual help, and a whole new level of productivity.

📚 Datahub Catalog Integration (WIP)

Discover and manage your data assets more easily with upcoming DataHub catalog integration, bringing powerful metadata management to Mage.

🧩 Pipeline/Block Level Virtual Environments & requirements.txt (WIP)

Isolate dependencies like never before. Soon, you’ll be able to specify virtual environments and requirements.txt files at the pipeline or block level, ensuring clean, reproducible, and conflict-free workflows.

The Lilo & Stitch release is all about flexibility, visibility, and a touch of magic. With custom connectors, better error tracking, new social data sources, and a sneak peek at our AI sidekick and resource monitoring, Mage is more powerful and adaptable than ever. Mahalo for being part of our journey—happy building! 🤙