2 个仓库
Specialized formats and schemas used to organize data during the initial extraction phase of a pipeline.
Explore 2 awesome GitHub repositories matching data & databases · Extraction Data Structures. Refine with filters or upvote what's useful.
Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process
Structures batch data during extraction, including frame metadata, image arrays, and alignment status.
Mage AI 是一个基于 Python 的数据流水线编排器和自托管数据集成开发环境。它旨在通过基于块的流水线设计和交互式笔记本界面来构建、调度和监控数据工作流。 该平台通过集成生成式 AI 功能脱颖而出,允许用户通过 API 连接大语言模型提供商,将人工智能纳入自动化数据流中。它还作为一个 Apache Spark 数据处理器,管理高性能分析和大规模数据处理所需的内核和基础设施。 该系统涵盖了广泛的数据工程功能,包括 ETL 工作流自动化、dbt 模型管理和数据流发现。它提供了通过 Git 进行版本控制集成、容器化部署以及基于角色的访问控制的工具,以管理跨开发和生产环境的流水线。监控通过系统性能遥测和流水线执行调试进行处理。
Retrieves structural metadata for selected data streams to define the format of all incoming information.