awesome-repositories.com
Blog
MCP
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektÜber unsRanking-MethodikPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
matz avatar

matz/streem

0
View on GitHub↗
4,598 Stars·234 Forks·C·MIT·9 Aufrufe

Streem

Streem ist eine streambasierte Programmiersprache und ein Daten-Pipeline-Orchestrator. Sie bietet eine domänenspezifische Sprache zur Definition paralleler Datenflüsse, die es Benutzern ermöglicht, Datenquellen über eine Sequenz von Operationen, die einzelne Streamelemente transformieren und filtern, mit Zielen zu verknüpfen.

Das System verwendet eine benutzerdefinierte Skriptsyntax zur Definition von Datenflussverbindungen und Pipeline-Definitionen. Dies ermöglicht die Orchestrierung paralleler Datenverarbeitung, bei der mehrere Pipeline-Stufen gleichzeitig ausgeführt werden, um Datenelemente durch das System zu bewegen.

Die Plattform deckt funktionale Datentransformation und stufenbasierte Komposition ab, wobei spezifische Funktionen angewendet werden, um Elemente zu modifizieren oder zu filtern, während sie eine sequenzielle Kette verknüpfter Operationen durchlaufen.

Features

  • Data Pipeline Orchestration - Links data sources to destinations using a domain language to process elements through a sequence of operations.
  • Stream-Based Languages - Ships a custom programming language and script syntax dedicated to defining concurrent data flows and pipeline processing.
  • Collection Element Transformations - Applies a function to each element in a pipeline to modify or filter data before passing it to the next stage.
  • Concurrent Data Processors - Handles multiple pieces of information simultaneously by passing them through a pipeline of independent functions.
  • Concurrent Stream Processing - Executes multiple pipeline stages simultaneously to move data elements through the system with higher throughput.
  • Data Flow Definitions - Provides a domain-specific language to declaratively specify the routing and connection of data sources and processing components.
  • Data Pipeline Orchestrators - Implements a platform for automating complex sequences of data processing and transformation tasks.
  • Stream and Pipeline Orchestration - Offers an engine for managing the flow, transformation, and execution of continuous data streams.
  • Per-Element Effect Execution - Executes a function for every individual item passing through a pipeline to modify or filter the data.
  • Data Transformation Functions - Applies specific functions to individual items in a stream to modify or filter information.
  • Concurrent Data Pipelines - Moves data through multiple simultaneous stages to increase throughput via functional transformations.
  • Value-Flow Pipelines - Processes individual data elements through a sequential chain of linked operations from source to destination.
  • Data Flow Scripting - Connects processing stages using a stream script to manage how information moves concurrently through the system.
  • Domain Specific Language Parsers - Converts custom script syntax into an internal representation of connected processing stages for execution.
  • Functional Transformations - Applies pure functions to each item in a stream to modify or filter data before the next stage.
  • Domain Specific Languages - Provides a specialized language to simplify the definition and management of complex data flow workflows.
  • Concurrent Task Execution - Manages the simultaneous movement of data through multiple pipeline stages to increase processing throughput.
  • Flow-Based Programming Models - Defines how data flows through a sequence of connected processing stages using a specialized language.
  • Pipeline Definitions - Parses custom script syntax into an internal graph of connected processing stages to automate data flow setup.
  • Functional Stream Transformations - Applies mapping or filtering functions to individual items as they pass through a sequential chain.
  • Data Flow Orchestrators - Manages the movement of information from a source to a destination through a series of linked operations.
  • Data Transformation Pipelines - Builds a series of operations to move data from a source to a destination while transforming and filtering it.
  • Stage Composition - Connects discrete processing units into a larger pipeline by piping the output of one function into the input of another.
  • Pipeline Execution Models - Processes data by passing elements through a sequence of independent functions that transform and filter information.

Star-Verlauf

Star-Verlauf für matz/streemStar-Verlauf für matz/streem

KI-Suche

Entdecke weitere awesome Repositories

Beschreibe in einfachen Worten, was du brauchst — die KI bewertet tausende kuratierte Open-Source-Projekte nach Relevanz.

Start searching with AI

Open-Source-Alternativen zu Streem

Ähnliche Open-Source-Projekte, sortiert nach der Anzahl der gemeinsamen Funktionen mit Streem.
  • bitfield/scriptAvatar von bitfield

    bitfield/script

    6,991Auf GitHub ansehen↗

    This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It provides a concurrent data pipeline system for chaining sources, filters, and sinks to process text and JSON streams. The library distinguishes itself through a comprehensive toolkit for shell-like operations, including a text processing engine for regular expression filtering and frequency analysis, a filesystem utility toolkit for recursive search and path manipulation, and an integrated HTTP client wrapper for building data pipelines that fetch web content. The capability s

    Gocatcurlcut
    Auf GitHub ansehen↗6,991
  • apache/nifiAvatar von apache

    apache/nifi

    5,976Auf GitHub ansehen↗

    Apache NiFi is a flow-based programming platform that enables the visual design, monitoring, and management of data pipelines. At its core, it provides a web-based visual dataflow designer where users build directed graphs of processors to route, transform, and mediate data movement between any source and destination without writing custom code. The system records fine-grained data provenance for every data item from ingestion to delivery, supporting audit, debugging, and replay of data lineage. The platform distinguishes itself through a zero-master cluster architecture that distributes proc

    Javaapachehacktoberfestjava
    Auf GitHub ansehen↗5,976
  • prefecthq/prefectAvatar von PrefectHQ

    PrefectHQ/prefect

    21,640Auf GitHub ansehen↗

    Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep

    Pythonautomationdatadata-engineering
    Auf GitHub ansehen↗21,640
  • orchest/orchestAvatar von orchest

    orchest/orchest

    4,138Auf GitHub ansehen↗

    Orchest is a data pipeline orchestrator and containerized workflow manager. It provides a platform for designing, scheduling, and executing complex data processing sequences through a combination of a graphical interface and scripting. The platform distinguishes itself by using containers to manage software dependencies, ensuring consistent execution across different environments. It features a polyglot task scheduler capable of triggering jobs written in multiple programming languages and includes a version control system that tracks historical snapshots of project configurations and code.

    TypeScriptairflowclouddag
    Auf GitHub ansehen↗4,138
Alle 30 Alternativen zu Streem anzeigen→

Häufig gestellte Fragen

Was macht matz/streem?

Streem ist eine streambasierte Programmiersprache und ein Daten-Pipeline-Orchestrator. Sie bietet eine domänenspezifische Sprache zur Definition paralleler Datenflüsse, die es Benutzern ermöglicht, Datenquellen über eine Sequenz von Operationen, die einzelne Streamelemente transformieren und filtern, mit Zielen zu verknüpfen.

Was sind die Hauptfunktionen von matz/streem?

Die Hauptfunktionen von matz/streem sind: Data Pipeline Orchestration, Stream-Based Languages, Collection Element Transformations, Concurrent Data Processors, Concurrent Stream Processing, Data Flow Definitions, Data Pipeline Orchestrators, Stream and Pipeline Orchestration.

Welche Open-Source-Alternativen gibt es zu matz/streem?

Open-Source-Alternativen zu matz/streem sind unter anderem: bitfield/script — This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It… apache/nifi — Apache NiFi is a flow-based programming platform that enables the visual design, monitoring, and management of data… prefecthq/prefect — Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as… orchest/orchest — Orchest is a data pipeline orchestrator and containerized workflow manager. It provides a platform for designing,… iterative/dvc — DVC is a data versioning tool and pipeline orchestrator designed to track large datasets and machine learning models.… holistics/dbml — DBML is a domain-specific language and schema definition language used for documenting database architecture and…