6 dépôts
Tools that transform heterogeneous data sources into a consistent internal schema.
Distinguishing note: Focuses on schema transformation for API responses rather than general database management or ETL pipelines.
Explore 6 awesome GitHub repositories matching data & databases · Data Normalization Layers. Refine with filters or upvote what's useful.
This library provides a unified interface for interacting with hundreds of global cryptocurrency exchanges. It serves as a standardized framework for building automated trading systems, allowing developers to fetch real-time market data, manage account balances, and execute orders across multiple financial platforms through a single, predictable set of methods. The project distinguishes itself by abstracting the complexities of diverse exchange-specific application programming interfaces into a consistent internal schema. It includes a modular authentication layer that automatically handles c
Converts heterogeneous exchange response formats into a consistent internal schema for easier cross-platform data analysis.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Designs schemas and federation strategies to support data-intensive applications across distributed environments.
jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab
Provides normalization of human-readable disk sizes and date strings into standardized formats like bytes and epoch timestamps.
FinRL-Trading is a modular framework designed for the development, training, and deployment of quantitative trading strategies using reinforcement learning and autonomous agent workflows. It provides a comprehensive infrastructure for managing the entire lifecycle of financial models, from data ingestion and strategy generation to live market execution. The platform distinguishes itself through a multi-agent architecture that coordinates specialized tasks such as sentiment analysis, risk assessment, and collaborative research. By utilizing a standardized environment abstraction, it allows rei
Transforms heterogeneous financial data from multiple providers into a consistent internal schema for strategy compatibility.
DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m
Provides a transformation layer that converts tool-specific data into a common internal schema.
Ce dépôt sert de bibliothèque de référence complète pour la conception d'architecture cloud, fournissant des conseils standardisés et des blueprints techniques pour construire des environnements évolutifs, sécurisés et performants. Il fonctionne comme une base de connaissances centralisée pour les modèles d'ingénierie, les stratégies de migration et les frameworks d'infrastructure adaptés aux solutions cloud-native. La plateforme se distingue par un système de documentation piloté par les composants qui utilise une classification basée sur les métadonnées pour organiser des conseils architecturaux complexes. En employant un générateur de site statique, le projet compile le contenu basé sur Markdown en une expérience web structurée et distribuée mondialement qui facilite la revue par les pairs et le contrôle de version via une gestion de source distribuée. Le contenu couvre un large spectre de domaines techniques, incluant la conception de plateformes d'analyse de données, l'orchestration de workflows d'intelligence artificielle générative et la gestion d'infrastructure cloud hybride. Il fournit en outre des frameworks pour implémenter des zones d'atterrissage (landing zones) sécurisées, établir une gouvernance de sécurité cloud et exécuter des stratégies d'adoption à l'échelle de l'entreprise.
Provides architectural guidance for designing end-to-end data platforms and business intelligence solutions.