1 مستودع
The practice of managing the lifecycle, versioning, and monitoring of data pipelines in production environments.
Distinct from Data Product Deployers: None of the candidates cover the holistic management of deployment, version control, and monitoring for production data pipelines.
Explore 1 awesome GitHub repository matching data & databases · Production Data Engineering. Refine with filters or upvote what's useful.
Mage AI is a Python-based data pipeline orchestrator and self-hosted data integrated development environment. It is designed for building, scheduling, and monitoring data workflows using a block-based pipeline design and interactive notebook interface. The platform distinguishes itself by integrating generative AI capabilities, allowing users to connect large language model providers via API to incorporate artificial intelligence into automated data streams. It also functions as an Apache Spark data processor, managing the kernels and infrastructure required for high-volume analytics and larg
Manages the full lifecycle of data pipelines, including versioning and monitoring in production environments.