7 Repos
Conversion of asynchronous effect blueprints into continuous streams of values.
Distinct from Stream Processing: Specifically addresses the lifting of functional effects into streams, not general data ingestion architectures.
Explore 7 awesome GitHub repositories matching data & databases · Effect-to-Stream Conversion. Refine with filters or upvote what's useful.
node-fetch ist eine leichtgewichtige HTTP-Client-Bibliothek, die die browser-standardisierte Fetch API für Node.js implementiert. Sie bietet eine auf Promises basierende Schnittstelle für asynchrone Netzwerkanfragen, um Daten aus serverseitigen Umgebungen abzurufen oder zu senden. Das Projekt ist auf speichereffiziente Datenverarbeitung durch die Nutzung von Request- und Response-Streaming spezialisiert. Dies ermöglicht die inkrementelle Verarbeitung großer Netzwerk-Payloads über native System-Streams, um Speichererschöpfung zu vermeiden. Die Bibliothek deckt ein breites Spektrum an Netzwerkfunktionen ab, einschließlich der Verwendung benutzerdefinierter HTTP-Agenten für DNS- und SSL-Konfiguration, Request-Abbruch mittels Abort-Signalen sowie die Handhabung verschiedener Inhaltskodierungen und Formular-Datenübermittlungen.
Converts raw binary data from the network layer into standard Node.js streams for asynchronous processing.
Fluent Bit ist ein Cloud-nativer Log-Shipper und einheitlicher Telemetrie-Collector, der als ressourceneffiziente Datenpipeline konzipiert ist. Er nimmt Logs, Metriken und Traces aus mehreren Quellen auf und verarbeitet sie in Echtzeit, bevor die Daten an externe Speicher-Backends weitergeleitet werden. Das Projekt fungiert als Echtzeit-Stream-Prozessor und OpenTelemetry-Log-Prozessor, der in der Lage ist, Daten mithilfe von SQL und bedingter Logik zu transformieren und zu filtern. Es fungiert zudem als verteilter Tracing-Agent, der Traces sampeln kann, um das Datenvolumen zu reduzieren und gleichzeitig vollständige Anforderungspfade zu bewahren. Das System bietet eine zuverlässige Datenübermittlung durch dateisystembasiertes Buffering und zustandsbehaftete Wiederholungslogik, um Datenverlust bei Ausfällen zu verhindern. Seine modulare Architektur unterstützt steckbare Eingabe- und Ausgabe-Plugins, metadatengesteuertes Routing und die Möglichkeit, Funktionen über gemeinsam genutzte Bibliotheken zu erweitern. Die Software kann als Container über verschiedene CPU-Architekturen und Betriebssysteme hinweg bereitgestellt werden.
Converts external text configurations into static array definitions during the build process.
This project is a sample library and implementation guide for using RxJava to manage asynchronous data streams and concurrent tasks in Android applications. It provides a collection of reference implementations for reactive programming, focusing on functional operators to transform and combine asynchronous data flows. The library demonstrates specific Android architectural patterns, such as implementing decoupled event buses for component communication and coordinating parallel network requests. It includes concrete examples of mobile-specific patterns including search input debouncing, list
Implements patterns for converting single-use data sequences into shared streams to allow multiple subscribers.
Bacon.js is a JavaScript functional reactive programming library used for coordinating complex asynchronous data flows. It functions as an observable event stream framework and an asynchronous data flow orchestrator, allowing developers to model events as declarative streams and properties. The library distinguishes itself through its ability to manage reactive state and synchronize timing across multiple sources. It provides specialized mechanisms for atomic state synchronization to prevent glitches in derived properties and offers advanced coordination strategies such as asynchronous stream
Provides a comprehensive set of utilities to generate event streams from DOM events, promises, callbacks, and polling functions.
go-flutter is a runtime and embedding library that enables Flutter applications to run natively on Windows, macOS, and Linux using Go and GLFW. It implements the Flutter Embedding API to render Flutter UIs on desktop platforms, providing a cross-platform desktop runtime that bridges Go and Dart code through standard Flutter method and event channels. The project includes a plugin framework that supports bidirectional communication between Go and Dart, allowing Go code to invoke Dart handlers and expose Go methods for Dart to call, with optional synchronous replies. It also provides event stre
Stream data from Go to Dart whenever an event occurs, using an EventChannel.
KurrentDB is an event-native database designed for event sourcing and event-driven architectures. It stores events as immutable, ordered records in streams, preserving a complete audit trail and enabling temporal queries. The database uses gRPC for all client-server and inter-node communication, providing efficient binary serialization and bidirectional streaming, and supports atomic multi-stream writes that ensure consistency across multiple streams in a single transaction. The database distinguishes itself with a built-in JavaScript projection engine that transforms, filters, and aggregates
Transforms and writes events from source streams into new streams using user-defined JavaScript functions.
R3 is a reactive extensions library and asynchronous data pipeline framework. It provides a system for composing asynchronous data streams, managing reactive state, and coordinating event sequences using observable patterns. The project distinguishes itself with a deterministic testing toolkit that mocks time and frame updates to ensure reproducible unit tests for asynchronous logic. It also includes observability tools for tracking active subscriptions and generating stack traces to identify memory leaks, alongside centralized exception routing for pipeline recovery. The framework covers a
Transforms standard event triggers into reactive streams to compose them with other asynchronous data sequences.