Awesome GitHub RepositoriesStream Filters

FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f

This project is a command-line processor designed for the parsing, filtering, and transformation of structured data streams. It functions as a declarative programming environment that treats data as immutable streams, allowing users to perform complex structural modifications through the composition of small, reusable functions. By utilizing a recursive tree traversal engine, the system enables the navigation, inspection, and modification of deeply nested hierarchical data structures. The engine distinguishes itself through a stream-oriented architecture that processes input records one by on

Wagtail is an open-source content management system built on the Django web framework. It provides a structured, tree-based approach to content modeling, allowing developers to define custom page types and reusable content components that are managed through a highly customizable administrative interface. The platform distinguishes itself through its flexible, block-based content composition system, which enables editors to assemble complex page layouts dynamically. It also offers robust support for multi-site and multi-lingual environments, allowing organizations to manage distinct websites

NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t

This project is a native Go driver for the MySQL protocol, providing a communication layer that enables applications to interact with relational database management systems. It implements the standard database interface, allowing developers to manage persistent connections, execute queries, and handle transactions within their applications. The driver functions by translating high-level database commands into the specific binary packet format required for communication with MySQL servers. It manages network sessions through a connection pooling mechanism and supports context-aware query cance

Discord Chat Exporter is a tool for extracting messages and media from Discord channels and direct messages into offline files. It functions as a backup utility and archival tool, using authentication tokens to retrieve chat history and metadata for long-term storage or history recovery. The system converts API data into readable documents and supports multi-format export options, including HTML, TXT, CSV, and JSON. It includes capabilities for automated chat backups by creating recurring tasks through the host operating system's task scheduler. The tool provides data management features suc

jc is a tool that transforms plain-text results from command-line utilities, system tools, log formats, and text tables into structured JSON data. It functions as a structured data transformer capable of converting various file formats, including CSV, INI, XML, and YAML, into JSON representations for programmatic use. The project includes a collection of specific parsers for Unix commands and system tools such as df, blkid, and various package managers. It also features specialized converters for web server logs, Common Log Format, and Common Event Format strings. The tool covers broad capab

Fluent Bit هو ناقل سجلات سحابي المنشأ وجامع قياسات موحد مصمم كخط أنابيب بيانات فعال في الموارد. يقوم باستيعاب السجلات، والمقاييس، والتتبعات من مصادر متعددة، ومعالجتها في الوقت الفعلي قبل توجيه البيانات إلى خلفيات التخزين الخارجية. يعمل المشروع كمعالج تدفق في الوقت الفعلي ومعالج سجلات OpenTelemetry، قادر على تحويل وتصفية البيانات باستخدام SQL والمنطق الشرطي. كما يعمل كوكيل تتبع موزع يمكنه أخذ عينات من التتبعات لتقليل حجم البيانات مع الحفاظ على مسارات الطلبات الكاملة. يوفر النظام تسليم بيانات موثوقاً من خلال التخزين المؤقت المدعوم بنظام الملفات ومنطق إعادة المحاولة القائم على الحالة لمنع فقدان البيانات أثناء الانقطاعات. تدعم بنيته النمطية إضافات الإدخال والإخراج القابلة للتوصيل، والتوجيه القائم على البيانات الوصفية، والقدرة على توسيع الوظائف عبر مكتبات مشتركة. يمكن نشر البرنامج كحاوية عبر بنيات CPU وأنظمة تشغيل مختلفة.

Redux-Observable هو وسيط وظيفي لـ Redux يعامل تدفقات الإجراءات ككائنات قابلة للملاحظة (observables) لإدارة الآثار الجانبية غير المتزامنة المعقدة والتوقيت. يعمل كمنسق إجراءات غير متزامن، حيث يحول تدفقات إجراءات Redux إلى إجراءات جديدة من خلال خطوط أنابيب من الآثار الجانبية القائمة على الملاحظة لتنسيق تغييرات حالة التطبيق. يسمح المشروع بالتحميل الديناميكي، والحقن، واستبدال تدفقات الآثار الجانبية في وقت التشغيل. يتيح ذلك إضافة معالجات المهام غير المتزامنة دون الحاجة إلى إعادة تشغيل التطبيق بالكامل، مما يدعم تقسيم الكود والتحميل الكسول لمنطق الأعمال. يوفر النظام قدرات للتحكم في المهام، بما في ذلك إلغاء العمليات وإدارة التزامن لمنع ظروف السباق. كما يتضمن آليات لأخذ عينات الحالة والمراقبة، وتصفية نوع الإجراء، والقدرة على حقن خدمات خارجية في المعالجات لفصل منطق الأعمال عن تفاصيل التنفيذ. تتوفر أدوات التحقق لمحاكاة تسلسلات الإجراءات وتأكيد المخرجات الناتجة عن تدفقات البيانات غير المتزامنة.

language-ext is a functional programming framework for C# that provides a suite of immutable data structures and monadic types. It enables the implementation of pure functional programming patterns, utilizing containers to manage side effects, optional values, and error handling. The library is distinguished by its advanced concurrency and state management tools, including a software transactional memory system and lock-free atomic references. It also provides specialized utilities for distributed systems, such as vector clocks for causality tracking and deterministic data conflict resolution

RxKotlin is a reactive programming library and asynchronous stream processor that provides Kotlin language extensions for composing event-based data streams. It serves as a set of Kotlin bindings for RxJava, allowing developers to transform, filter, and flatten sequences of data emitted over time. The library focuses on integrating RxJava patterns into Kotlin projects by applying language-specific conventions and idioms. It utilizes extension functions to simplify reactive programming patterns, reduce boilerplate, and optimize workflows within the reactive ecosystem. The toolkit covers a bro

Proxyman is a cross-platform HTTP debugging proxy that captures, inspects, and modifies HTTP, HTTPS, and WebSocket traffic. It functions as a man-in-the-middle proxy, decrypting SSL/TLS traffic to allow real-time inspection and modification of encrypted requests and responses. The tool is designed for debugging web and mobile applications, with capabilities for API mocking and simulation, scriptable traffic modification, and team collaboration on network logs. What distinguishes Proxyman is its deep integration with mobile and cross-platform development workflows. It provides automated certif

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Data-Juicer is an open-source framework for cleaning, filtering, deduplicating, and transforming multimodal datasets to prepare them for training large language and vision models. It functions as a distributed data pipeline engine that runs processing jobs across Ray clusters, handling billions of samples with automatic operator fusion and adaptive parallelism. The framework provides a library of operators that leverage large language models for semantic extraction, filtering, and data synthesis within processing pipelines. The project distinguishes itself through a YAML-based data recipe sys

collect.js is a dependency-free JavaScript library that provides a fluent, chainable interface for manipulating arrays and objects. It mirrors the Laravel Collection API, offering a consistent set of methods for data transformation across JavaScript and Laravel backend environments. The library stores collection data as plain arrays internally and supports fluent method chaining, where each method returns a new collection instance. The library distinguishes itself by closely replicating the Laravel Collection API in JavaScript, mapping each PHP method to an equivalent JavaScript implementatio

Fast n-dimensional filtering and grouping of records.

Pebble is an embedded key-value storage engine written in Go, designed as a library that provides durable, write-optimized data persistence directly within applications. It organizes data using a log-structured merge-tree (LSM-tree) structure, where writes are first buffered in an in-memory skiplist memtable and persisted to a write-ahead log before being flushed to block-based SSTable files on disk. The engine supports atomic batch commits, configurable write synchronization, and automatic background compaction that merges and rewrites sorted runs to reclaim space and maintain read performanc

oboe.js هو محلل JSON للبث (Streaming) وعميل HTTP مصمم لمعالجة البيانات بشكل تزايدي. يسمح للتطبيقات بالتعامل مع كائنات JSON الفردية فور وصولها من طلب شبكة أو بث قابل للقراءة قبل اكتمال التنزيل بالكامل. تعمل المكتبة كمحول لبث JSON، مما يتيح تعديل وتصفية وتعيين العقد (Nodes) أثناء التنقل. وتتميز باختيار العقد بناءً على المسار لتشغيل دوال الاستدعاء (Callbacks) عند مطابقة أنماط معينة، ويمكنها إنهاء اتصال الشبكة مبكراً بمجرد العثور على البيانات المطلوبة لتوفير النطاق الترددي. للتعامل مع مجموعات بيانات أكبر من ذاكرة النظام المتاحة، تستخدم المكتبة إدارة ذاكرة قائمة على البث للتخلص من العقد التي تمت معالجتها. كما تدعم دمج السجلات التاريخية مع التحديثات في الوقت الفعلي من خلال اتصالات طويلة الأمد، وتوفر القدرة على استعادة البيانات الجزئية في حال انقطاع الاتصال.

Streamdown is a streaming markdown renderer for React that transforms incoming markdown text into sanitized HTML in real time, handling incomplete blocks as they arrive. It parses GitHub-Flavored Markdown syntax including tables, task lists, and footnotes, and renders LaTeX math expressions using KaTeX, Mermaid diagrams as interactive SVGs, and code blocks with Shiki-based syntax highlighting supporting over 200 languages with dual light and dark themes. The renderer includes an XSS-safe HTML sanitizer that strips dangerous tags and validates URLs to prevent injection attacks. What distinguis

ZIO is a functional effect system for the JVM that models asynchronous and concurrent programs as pure, composable values with typed error handling and dependency injection. Its core identity is built on fiber-based concurrency, where lightweight, non-blocking fibers execute millions of concurrent tasks with structured lifecycle management, and a dual-channel error model that separates expected business failures from unexpected system defects at compile time. The system provides effect-typed dependency injection through a layer-based dependency graph, pull-based reactive stream processing with