2 repos
Architectural patterns and frameworks for building modular, decoupled data ingestion and transformation workflows.
Distinguishing note: Focuses on the architectural pattern of decoupling data stages rather than specific database storage or analytics tools.
Explore 2 awesome GitHub repositories matching software engineering & architecture · Data Processing Pipelines. Refine with filters or upvote what's useful.
This project is an algorithmic trading platform designed to automate financial market analysis and the execution of investment strategies. It provides an end-to-end environment for processing real-time market data through automated decision models, allowing for the triggering of financial transactions based on predefined quantitative signals and risk parameters without manual intervention. The platform distinguishes itself through a modular pipeline architecture that decouples data ingestion, signal generation, and trade execution, facilitating the iterative refinement of investment models. I
Implements a modular pipeline architecture that separates data ingestion, signal generation, and trade execution for iterative model refinement.
Nushell is a cross-platform shell and programming language designed to treat all input and output as structured data rather than raw text streams. By enforcing data types and command signatures, it provides a consistent environment for building robust, pipeline-oriented workflows. The shell allows users to chain commands that pass structured objects between stages, enabling complex data processing and automation tasks that remain predictable across different operating systems. What distinguishes the project is its focus on interactive data exploration and modular extensibility. Users can quer
Processes data by passing structured objects through a series of connected commands that transform input into output.