6 Repos
Tools that transform heterogeneous data sources into a consistent internal schema.
Distinguishing note: Focuses on schema transformation for API responses rather than general database management or ETL pipelines.
Explore 6 awesome GitHub repositories matching data & databases · Data Normalization Layers. Refine with filters or upvote what's useful.
This library provides a unified interface for interacting with hundreds of global cryptocurrency exchanges. It serves as a standardized framework for building automated trading systems, allowing developers to fetch real-time market data, manage account balances, and execute orders across multiple financial platforms through a single, predictable set of methods. The project distinguishes itself by abstracting the complexities of diverse exchange-specific application programming interfaces into a consistent internal schema. It includes a modular authentication layer that automatically handles c
Converts heterogeneous exchange response formats into a consistent internal schema for easier cross-platform data analysis.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Designs schemas and federation strategies to support data-intensive applications across distributed environments.
jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab
Provides normalization of human-readable disk sizes and date strings into standardized formats like bytes and epoch timestamps.
FinRL-Trading is a modular framework designed for the development, training, and deployment of quantitative trading strategies using reinforcement learning and autonomous agent workflows. It provides a comprehensive infrastructure for managing the entire lifecycle of financial models, from data ingestion and strategy generation to live market execution. The platform distinguishes itself through a multi-agent architecture that coordinates specialized tasks such as sentiment analysis, risk assessment, and collaborative research. By utilizing a standardized environment abstraction, it allows rei
Transforms heterogeneous financial data from multiple providers into a consistent internal schema for strategy compatibility.
DevLake is a DevOps data platform and analytics tool designed to orchestrate data pipelines that ingest, transform, and sync metadata from external development tools into a unified database. It functions as a system for collecting and normalizing data from source control, CI/CD pipelines, and issue trackers into a standardized schema to enable consistent software delivery analytics. The platform distinguishes itself by transforming tool-specific data into a common domain model, allowing for the calculation of engineering metrics via SQL. It provides specialized frameworks for measuring DORA m
Provides a transformation layer that converts tool-specific data into a common internal schema.
Dieses Repository dient als umfassende Referenzbibliothek für Cloud-Architektur-Design und bietet standardisierte Anleitungen sowie technische Blaupausen für den Aufbau skalierbarer, sicherer und hochperformanter Umgebungen. Es fungiert als zentrale Wissensdatenbank für Engineering-Patterns, Migrationsstrategien und Infrastruktur-Frameworks, die auf Cloud-native Lösungen zugeschnitten sind. Die Plattform zeichnet sich durch ein komponentengetriebenes Dokumentationssystem aus, das metadatengesteuerte Klassifizierung zur Organisation komplexer architektonischer Anleitungen nutzt. Durch den Einsatz eines Static-Site-Generators kompiliert das Projekt Markdown-basierte Inhalte in eine strukturierte, global verteilte Web-Erfahrung, die Peer-Review und Versionskontrolle durch verteiltes Source-Management erleichtert. Die Inhalte decken ein breites Spektrum technischer Domänen ab, einschließlich Design von Datenanalyse-Plattformen, Orchestrierung von Workflows für generative KI und Management hybrider Cloud-Infrastrukturen. Zudem bietet es Frameworks für die Implementierung sicherer Landing Zones, die Etablierung von Cloud-Security-Governance und die Ausführung unternehmensweiter Adoptionsstrategien.
Provides architectural guidance for designing end-to-end data platforms and business intelligence solutions.