Awesome GitHub RepositoriesStream Filters

FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f

This project is a command-line processor designed for the parsing, filtering, and transformation of structured data streams. It functions as a declarative programming environment that treats data as immutable streams, allowing users to perform complex structural modifications through the composition of small, reusable functions. By utilizing a recursive tree traversal engine, the system enables the navigation, inspection, and modification of deeply nested hierarchical data structures. The engine distinguishes itself through a stream-oriented architecture that processes input records one by on

Wagtail is an open-source content management system built on the Django web framework. It provides a structured, tree-based approach to content modeling, allowing developers to define custom page types and reusable content components that are managed through a highly customizable administrative interface. The platform distinguishes itself through its flexible, block-based content composition system, which enables editors to assemble complex page layouts dynamically. It also offers robust support for multi-site and multi-lingual environments, allowing organizations to manage distinct websites

NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t

This project is a native Go driver for the MySQL protocol, providing a communication layer that enables applications to interact with relational database management systems. It implements the standard database interface, allowing developers to manage persistent connections, execute queries, and handle transactions within their applications. The driver functions by translating high-level database commands into the specific binary packet format required for communication with MySQL servers. It manages network sessions through a connection pooling mechanism and supports context-aware query cance

Discord Chat Exporter is a tool for extracting messages and media from Discord channels and direct messages into offline files. It functions as a backup utility and archival tool, using authentication tokens to retrieve chat history and metadata for long-term storage or history recovery. The system converts API data into readable documents and supports multi-format export options, including HTML, TXT, CSV, and JSON. It includes capabilities for automated chat backups by creating recurring tasks through the host operating system's task scheduler. The tool provides data management features suc

jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab

Fluent Bit ist ein Cloud-nativer Log-Shipper und einheitlicher Telemetrie-Collector, der als ressourceneffiziente Datenpipeline konzipiert ist. Er nimmt Logs, Metriken und Traces aus mehreren Quellen auf und verarbeitet sie in Echtzeit, bevor die Daten an externe Speicher-Backends weitergeleitet werden. Das Projekt fungiert als Echtzeit-Stream-Prozessor und OpenTelemetry-Log-Prozessor, der in der Lage ist, Daten mithilfe von SQL und bedingter Logik zu transformieren und zu filtern. Es fungiert zudem als verteilter Tracing-Agent, der Traces sampeln kann, um das Datenvolumen zu reduzieren und gleichzeitig vollständige Anforderungspfade zu bewahren. Das System bietet eine zuverlässige Datenübermittlung durch dateisystembasiertes Buffering und zustandsbehaftete Wiederholungslogik, um Datenverlust bei Ausfällen zu verhindern. Seine modulare Architektur unterstützt steckbare Eingabe- und Ausgabe-Plugins, metadatengesteuertes Routing und die Möglichkeit, Funktionen über gemeinsam genutzte Bibliotheken zu erweitern. Die Software kann als Container über verschiedene CPU-Architekturen und Betriebssysteme hinweg bereitgestellt werden.

Redux-Observable ist eine funktionale Middleware für Redux, die Aktions-Streams als Observables behandelt, um komplexe asynchrone Seiteneffekte und Timings zu verwalten. Sie fungiert als asynchroner Aktions-Orchestrator, der Streams von Redux-Aktionen durch Pipelines von Observable-basierten Seiteneffekten in neue Aktionen umwandelt, um Anwendungszustandsänderungen zu koordinieren. Das Projekt ermöglicht das dynamische Laden, Injizieren und Ersetzen von Seiteneffekt-Streams zur Laufzeit. Dies ermöglicht das Hinzufügen von asynchronen Task-Handlern, ohne einen vollständigen Neustart der Anwendung zu erfordern, und unterstützt Code-Splitting sowie Lazy-Loading von Geschäftslogik. Das System bietet Funktionen für die Task-Steuerung, einschließlich Operationsabbruch und Nebenläufigkeitsmanagement, um Race-Conditions zu verhindern. Es enthält zudem Mechanismen für Zustands-Sampling und -Überwachung, Aktions-Typ-Filterung und die Möglichkeit, externe Dienste in Handler zu injizieren, um Geschäftslogik von Implementierungsdetails zu entkoppeln. Verifizierungstools stehen zur Verfügung, um Aktionssequenzen zu simulieren und die resultierende Ausgabe asynchroner Datenströme zu bestätigen.

language-ext is a functional programming framework for C# that provides a suite of immutable data structures and monadic types. It enables the implementation of pure functional programming patterns, utilizing containers to manage side effects, optional values, and error handling. The library is distinguished by its advanced concurrency and state management tools, including a software transactional memory system and lock-free atomic references. It also provides specialized utilities for distributed systems, such as vector clocks for causality tracking and deterministic data conflict resolution

RxKotlin is a reactive programming library and asynchronous stream processor that provides Kotlin language extensions for composing event-based data streams. It serves as a set of Kotlin bindings for RxJava, allowing developers to transform, filter, and flatten sequences of data emitted over time. The library focuses on integrating RxJava patterns into Kotlin projects by applying language-specific conventions and idioms. It utilizes extension functions to simplify reactive programming patterns, reduce boilerplate, and optimize workflows within the reactive ecosystem. The toolkit covers a bro

Proxyman is a cross-platform HTTP debugging proxy that captures, inspects, and modifies HTTP, HTTPS, and WebSocket traffic. It functions as a man-in-the-middle proxy, decrypting SSL/TLS traffic to allow real-time inspection and modification of encrypted requests and responses. The tool is designed for debugging web and mobile applications, with capabilities for API mocking and simulation, scriptable traffic modification, and team collaboration on network logs. What distinguishes Proxyman is its deep integration with mobile and cross-platform development workflows. It provides automated certif

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Data-Juicer is an open-source framework for cleaning, filtering, deduplicating, and transforming multimodal datasets to prepare them for training large language and vision models. It functions as a distributed data pipeline engine that runs processing jobs across Ray clusters, handling billions of samples with automatic operator fusion and adaptive parallelism. The framework provides a library of operators that leverage large language models for semantic extraction, filtering, and data synthesis within processing pipelines. The project distinguishes itself through a YAML-based data recipe sys

collect.js is a dependency-free JavaScript library that provides a fluent, chainable interface for manipulating arrays and objects. It mirrors the Laravel Collection API, offering a consistent set of methods for data transformation across JavaScript and Laravel backend environments. The library stores collection data as plain arrays internally and supports fluent method chaining, where each method returns a new collection instance. The library distinguishes itself by closely replicating the Laravel Collection API in JavaScript, mapping each PHP method to an equivalent JavaScript implementatio

Fast n-dimensional filtering and grouping of records.

Pebble is an embedded key-value storage engine written in Go, designed as a library that provides durable, write-optimized data persistence directly within applications. It organizes data using a log-structured merge-tree (LSM-tree) structure, where writes are first buffered in an in-memory skiplist memtable and persisted to a write-ahead log before being flushed to block-based SSTable files on disk. The engine supports atomic batch commits, configurable write synchronization, and automatic background compaction that merges and rewrites sorted runs to reclaim space and maintain read performanc

oboe.js ist ein Streaming-JSON-Parser und HTTP-Stream-Client für die inkrementelle Datenverarbeitung. Er ermöglicht es Anwendungen, auf einzelne JSON-Objekte zu reagieren, sobald diese von einer Netzwerkanfrage oder einem lesbaren Stream eintreffen, noch bevor der gesamte Download abgeschlossen ist. Die Bibliothek fungiert als JSON-Stream-Transformer und ermöglicht das Modifizieren, Filtern und Mappen von Knoten zur Laufzeit. Sie bietet pfadbasierte Knotenauswahl, um Callbacks bei Übereinstimmung mit bestimmten Mustern auszulösen, und kann Netzwerkverbindungen vorzeitig beenden, sobald die benötigten Daten gefunden wurden, um Bandbreite zu sparen. Um Datensätze zu verarbeiten, die den verfügbaren Arbeitsspeicher übersteigen, nutzt die Bibliothek ein stream-basiertes Speichermanagement, um verarbeitete Knoten zu verwerfen. Sie unterstützt zudem das Zusammenführen historischer Datensätze mit Echtzeit-Updates über langlebige Verbindungen und bietet die Möglichkeit, bei Verbindungsabbrüchen teilweise Daten wiederherzustellen.

Streamdown is a streaming markdown renderer for React that transforms incoming markdown text into sanitized HTML in real time, handling incomplete blocks as they arrive. It parses GitHub-Flavored Markdown syntax including tables, task lists, and footnotes, and renders LaTeX math expressions using KaTeX, Mermaid diagrams as interactive SVGs, and code blocks with Shiki-based syntax highlighting supporting over 200 languages with dual light and dark themes. The renderer includes an XSS-safe HTML sanitizer that strips dangerous tags and validates URLs to prevent injection attacks. What distinguis

ZIO is a functional effect system for the JVM that models asynchronous and concurrent programs as pure, composable values with typed error handling and dependency injection. Its core identity is built on fiber-based concurrency, where lightweight, non-blocking fibers execute millions of concurrent tasks with structured lifecycle management, and a dual-channel error model that separates expected business failures from unexpected system defects at compile time. The system provides effect-typed dependency injection through a layer-based dependency graph, pull-based reactive stream processing with