6 repositorios
Tools that transform heterogeneous data sources into a consistent internal schema.
Distinguishing note: Focuses on schema transformation for API responses rather than general database management or ETL pipelines.
Explore 6 awesome GitHub repositories matching data & databases · Data Normalization Layers. Refine with filters or upvote what's useful.
This library provides a unified interface for interacting with hundreds of global cryptocurrency exchanges. It serves as a standardized framework for building automated trading systems, allowing developers to fetch real-time market data, manage account balances, and execute orders across multiple financial platforms through a single, predictable set of methods. The project distinguishes itself by abstracting the complexities of diverse exchange-specific application programming interfaces into a consistent internal schema. It includes a modular authentication layer that automatically handles c
Converts heterogeneous exchange response formats into a consistent internal schema for easier cross-platform data analysis.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Designs schemas and federation strategies to support data-intensive applications across distributed environments.
jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab
Provides normalization of human-readable disk sizes and date strings into standardized formats like bytes and epoch timestamps.
FinRL-Trading is a modular framework designed for the development, training, and deployment of quantitative trading strategies using reinforcement learning and autonomous agent workflows. It provides a comprehensive infrastructure for managing the entire lifecycle of financial models, from data ingestion and strategy generation to live market execution. The platform distinguishes itself through a multi-agent architecture that coordinates specialized tasks such as sentiment analysis, risk assessment, and collaborative research. By utilizing a standardized environment abstraction, it allows rei
Transforms heterogeneous financial data from multiple providers into a consistent internal schema for strategy compatibility.
DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m
Provides a transformation layer that converts tool-specific data into a common internal schema.
Este repositorio sirve como una biblioteca de referencia integral para el diseño de arquitectura en la nube, proporcionando orientación estandarizada y blueprints técnicos para construir entornos escalables, seguros y de alto rendimiento. Funciona como una base de conocimiento centralizada para patrones de ingeniería, estrategias de migración y frameworks de infraestructura adaptados para soluciones cloud-native. La plataforma se distingue por un sistema de documentación impulsado por componentes que utiliza clasificación basada en metadatos para organizar la orientación arquitectónica compleja. Al emplear un generador de sitios estáticos, el proyecto compila contenido basado en markdown en una experiencia web estructurada y distribuida globalmente que facilita la revisión por pares y el control de versiones a través de gestión de fuentes distribuida. El contenido cubre un amplio espectro de dominios técnicos, incluyendo diseño de plataformas de análisis de datos, orquestación de flujos de trabajo de inteligencia artificial generativa y gestión de infraestructura de nube híbrida. Además, proporciona frameworks para implementar zonas de aterrizaje seguras, establecer gobernanza de seguridad en la nube y ejecutar estrategias de adopción a nivel empresarial.
Provides architectural guidance for designing end-to-end data platforms and business intelligence solutions.