6 repository-uri
Tools that transform heterogeneous data sources into a consistent internal schema.
Distinguishing note: Focuses on schema transformation for API responses rather than general database management or ETL pipelines.
Explore 6 awesome GitHub repositories matching data & databases · Data Normalization Layers. Refine with filters or upvote what's useful.
This library provides a unified interface for interacting with hundreds of global cryptocurrency exchanges. It serves as a standardized framework for building automated trading systems, allowing developers to fetch real-time market data, manage account balances, and execute orders across multiple financial platforms through a single, predictable set of methods. The project distinguishes itself by abstracting the complexities of diverse exchange-specific application programming interfaces into a consistent internal schema. It includes a modular authentication layer that automatically handles c
Converts heterogeneous exchange response formats into a consistent internal schema for easier cross-platform data analysis.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Designs schemas and federation strategies to support data-intensive applications across distributed environments.
jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab
Provides normalization of human-readable disk sizes and date strings into standardized formats like bytes and epoch timestamps.
FinRL-Trading is a modular framework designed for the development, training, and deployment of quantitative trading strategies using reinforcement learning and autonomous agent workflows. It provides a comprehensive infrastructure for managing the entire lifecycle of financial models, from data ingestion and strategy generation to live market execution. The platform distinguishes itself through a multi-agent architecture that coordinates specialized tasks such as sentiment analysis, risk assessment, and collaborative research. By utilizing a standardized environment abstraction, it allows rei
Transforms heterogeneous financial data from multiple providers into a consistent internal schema for strategy compatibility.
DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m
Provides a transformation layer that converts tool-specific data into a common internal schema.
Acest repository servește drept bibliotecă de referință cuprinzătoare pentru designul arhitecturii cloud, oferind ghidare standardizată și blueprint-uri tehnice pentru construirea de medii scalabile, securizate și de înaltă performanță. Funcționează ca o bază de cunoștințe centralizată pentru tipare de inginerie, strategii de migrare și framework-uri de infrastructură adaptate pentru soluții cloud-native. Platforma se distinge printr-un sistem de documentație bazat pe componente care utilizează clasificarea bazată pe metadate pentru a organiza ghidarea arhitecturală complexă. Prin utilizarea unui generator de site-uri statice, proiectul compilează conținutul bazat pe markdown într-o experiență web structurată și distribuită global, care facilitează peer review-ul și version control-ul prin gestionarea distribuită a surselor. Conținutul acoperă un spectru larg de domenii tehnice, inclusiv designul platformelor de analiză a datelor, orchestrarea fluxurilor de lucru de inteligență artificială generativă și gestionarea infrastructurii cloud hibride. De asemenea, oferă framework-uri pentru implementarea zonelor de aterizare securizate (landing zones), stabilirea guvernanței securității cloud și executarea strategiilor de adopție la nivel enterprise.
Provides architectural guidance for designing end-to-end data platforms and business intelligence solutions.