awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
matz avatar

matz/streem

0
View on GitHub↗
4,598 stars·234 forks·C·MIT·25 views

Streem

Streem is a stream-based programming language and data pipeline orchestrator. It provides a domain-specific language for defining concurrent data flows, allowing users to link data sources to destinations through a sequence of operations that transform and filter individual stream elements.

The system uses a custom script syntax to define data-flow connections and pipeline definitions. This allows for the orchestration of concurrent data processing where multiple pipeline stages execute simultaneously to move data elements through the system.

The platform covers functional data transformation and stage-based composition, applying specific functions to modify or filter items as they pass through a sequential chain of linked operations.

Features

  • Data Pipeline Orchestration - Links data sources to destinations using a domain language to process elements through a sequence of operations.
  • Stream-Based Languages - Ships a custom programming language and script syntax dedicated to defining concurrent data flows and pipeline processing.
  • Collection Element Transformations - Applies a function to each element in a pipeline to modify or filter data before passing it to the next stage.
  • Concurrent Data Processors - Handles multiple pieces of information simultaneously by passing them through a pipeline of independent functions.
  • Concurrent Stream Processing - Executes multiple pipeline stages simultaneously to move data elements through the system with higher throughput.
  • Data Flow Definitions - Provides a domain-specific language to declaratively specify the routing and connection of data sources and processing components.
  • Data Pipeline Orchestrators - Implements a platform for automating complex sequences of data processing and transformation tasks.
  • Stream and Pipeline Orchestration - Offers an engine for managing the flow, transformation, and execution of continuous data streams.
  • Per-Element Effect Execution - Executes a function for every individual item passing through a pipeline to modify or filter the data.
  • Data Transformation Functions - Applies specific functions to individual items in a stream to modify or filter information.
  • Concurrent Data Pipelines - Moves data through multiple simultaneous stages to increase throughput via functional transformations.
  • Value-Flow Pipelines - Processes individual data elements through a sequential chain of linked operations from source to destination.
  • Data Flow Scripting - Connects processing stages using a stream script to manage how information moves concurrently through the system.
  • Domain Specific Language Parsers - Converts custom script syntax into an internal representation of connected processing stages for execution.
  • Functional Transformations - Applies pure functions to each item in a stream to modify or filter data before the next stage.
  • Domain Specific Languages - Provides a specialized language to simplify the definition and management of complex data flow workflows.
  • Concurrent Task Execution - Manages the simultaneous movement of data through multiple pipeline stages to increase processing throughput.
  • Flow-Based Programming Models - Defines how data flows through a sequence of connected processing stages using a specialized language.
  • Pipeline Definitions - Parses custom script syntax into an internal graph of connected processing stages to automate data flow setup.
  • Functional Stream Transformations - Applies mapping or filtering functions to individual items as they pass through a sequential chain.
  • Data Flow Orchestrators - Manages the movement of information from a source to a destination through a series of linked operations.
  • Data Transformation Pipelines - Builds a series of operations to move data from a source to a destination while transforming and filtering it.
  • Stage Composition - Connects discrete processing units into a larger pipeline by piping the output of one function into the input of another.
  • Pipeline Execution Models - Processes data by passing elements through a sequence of independent functions that transform and filter information.

Star history

Star history chart for matz/streemStar history chart for matz/streem

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Projects sharing features with Streem

These projects share indexed features with Streem. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • bitfield/scriptbitfield avatar

    bitfield/script

    6,991View on GitHub↗

    This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It provides a concurrent data pipeline system for chaining sources, filters, and sinks to process text and JSON streams. The library distinguishes itself through a comprehensive toolkit for shell-like operations, including a text processing engine for regular expression filtering and frequency analysis, a filesystem utility toolkit for recursive search and path manipulation, and an integrated HTTP client wrapper for building data pipelines that fetch web content. The capability s

    Gocatcurlcut
    View on GitHub↗6,991
  • apache/nifiapache avatar

    apache/nifi

    5,976View on GitHub↗

    Apache NiFi is a flow-based programming platform that enables the visual design, monitoring, and management of data pipelines. At its core, it provides a web-based visual dataflow designer where users build directed graphs of processors to route, transform, and mediate data movement between any source and destination without writing custom code. The system records fine-grained data provenance for every data item from ingestion to delivery, supporting audit, debugging, and replay of data lineage. The platform distinguishes itself through a zero-master cluster architecture that distributes proc

    Javaapachehacktoberfestjava
    View on GitHub↗5,976
  • prefecthq/prefectPrefectHQ avatar

    PrefectHQ/prefect

    21,640View on GitHub↗

    Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep

    Pythonautomationdatadata-engineering
    View on GitHub↗21,640
  • orchest/orchestorchest avatar

    orchest/orchest

    4,138View on GitHub↗

    Orchest is a data pipeline orchestrator and containerized workflow manager. It provides a platform for designing, scheduling, and executing complex data processing sequences through a combination of a graphical interface and scripting. The platform distinguishes itself by using containers to manage software dependencies, ensuring consistent execution across different environments. It features a polyglot task scheduler capable of triggering jobs written in multiple programming languages and includes a version control system that tracks historical snapshots of project configurations and code.

    TypeScriptairflowclouddag
    View on GitHub↗4,138
Compare all 30 related projects→

Frequently asked questions

What does matz/streem do?

Streem is a stream-based programming language and data pipeline orchestrator. It provides a domain-specific language for defining concurrent data flows, allowing users to link data sources to destinations through a sequence of operations that transform and filter individual stream elements.

What are the main features of matz/streem?

The main features of matz/streem are: Data Pipeline Orchestration, Stream-Based Languages, Collection Element Transformations, Concurrent Data Processors, Concurrent Stream Processing, Data Flow Definitions, Data Pipeline Orchestrators, Stream and Pipeline Orchestration.

Which projects share features with matz/streem?

Projects with overlapping indexed features include: bitfield/script — This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It… apache/nifi — Apache NiFi is a flow-based programming platform that enables the visual design, monitoring, and management of data… prefecthq/prefect — Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as… orchest/orchest — Orchest is a data pipeline orchestrator and containerized workflow manager. It provides a platform for designing,… iterative/dvc — DVC is a data versioning tool and pipeline orchestrator designed to track large datasets and machine learning models.… holistics/dbml — DBML is a domain-specific language and schema definition language used for documenting database architecture and…