6 个仓库
Tools that transform heterogeneous data sources into a consistent internal schema.
Distinguishing note: Focuses on schema transformation for API responses rather than general database management or ETL pipelines.
Explore 6 awesome GitHub repositories matching data & databases · Data Normalization Layers. Refine with filters or upvote what's useful.
This library provides a unified interface for interacting with hundreds of global cryptocurrency exchanges. It serves as a standardized framework for building automated trading systems, allowing developers to fetch real-time market data, manage account balances, and execute orders across multiple financial platforms through a single, predictable set of methods. The project distinguishes itself by abstracting the complexities of diverse exchange-specific application programming interfaces into a consistent internal schema. It includes a modular authentication layer that automatically handles c
Converts heterogeneous exchange response formats into a consistent internal schema for easier cross-platform data analysis.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Designs schemas and federation strategies to support data-intensive applications across distributed environments.
jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab
Provides normalization of human-readable disk sizes and date strings into standardized formats like bytes and epoch timestamps.
FinRL-Trading is a modular framework designed for the development, training, and deployment of quantitative trading strategies using reinforcement learning and autonomous agent workflows. It provides a comprehensive infrastructure for managing the entire lifecycle of financial models, from data ingestion and strategy generation to live market execution. The platform distinguishes itself through a multi-agent architecture that coordinates specialized tasks such as sentiment analysis, risk assessment, and collaborative research. By utilizing a standardized environment abstraction, it allows rei
Transforms heterogeneous financial data from multiple providers into a consistent internal schema for strategy compatibility.
DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m
Provides a transformation layer that converts tool-specific data into a common internal schema.
该仓库是一个云架构设计的综合参考库,为构建可扩展、安全且高性能的环境提供标准化指导和技术蓝图。它作为一个中心化知识库,涵盖了针对云原生解决方案量身定制的工程模式、迁移策略和基础设施框架。 该平台通过一个组件驱动的文档系统脱颖而出,该系统利用元数据驱动的分类来组织复杂的架构指导。通过采用静态网站生成器,该项目将基于 Markdown 的内容编译成结构化的、全球分布式的 Web 体验,并通过分布式源代码管理促进同行评审和版本控制。 内容涵盖了广泛的技术领域,包括数据分析平台设计、生成式人工智能工作流编排以及混合云基础设施管理。它还提供了用于实施安全着陆区、建立云安全治理以及执行企业级采用策略的框架。
Provides architectural guidance for designing end-to-end data platforms and business intelligence solutions.