21 Repos
Utilities for tailing and filtering live data streams.
Explore 21 awesome GitHub repositories matching data & databases · Real-time Stream Monitors. Refine with filters or upvote what's useful.
This project is a general-purpose command-line filter that provides an interactive interface for processing standard input streams. It enables real-time fuzzy searching, data selection, and transformation, allowing users to navigate complex information or file systems directly within their terminal. By utilizing a pipe-oriented architecture, it integrates into existing shell pipelines and workflows to facilitate efficient data exploration. What distinguishes this tool is its highly extensible, event-driven design that allows for deep integration with external processes. It supports asynchrono
Filters live data streams in real-time to provide an interactive interface for monitoring and selecting output.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Captures and displays a real-time feed of all incoming requests to the server for debugging and auditing.
Guidance is a generative AI orchestration framework designed to manage complex interactions with language models by embedding programmatic control directly into the prompt generation process. It functions as a prompt programming environment that allows developers to interleave raw text with executable logic, enabling the construction of sophisticated, multi-step agentic workflows. The framework distinguishes itself through grammar-constrained token sampling and stateful stream interception, which restrict the model's output distribution based on formal language rules. By enforcing these const
Monitors and modifies token generation in real time to enforce logical constraints on model output.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Delivers generated tokens incrementally to the user interface as they are produced to provide real-time feedback.
This project is a cross-platform media aggregator and streaming API wrapper designed to retrieve live broadcast data from various video platforms. It functions as a unified interface for fetching direct playback URLs and real-time chat logs, enabling the development of custom broadcast monitoring and interactive streaming applications. The tool distinguishes itself by providing a consistent data extraction layer that normalizes disparate video source formats into a unified structure. By parsing stream links through targeted network requests, it allows developers to integrate live broadcast me
Extracts metadata and real-time chat information from streaming services to facilitate broadcast monitoring.
webpack-dashboard is a terminal-based build monitor and asset viewer designed for the Webpack development process. It provides a command line interface to track compilation status, monitor development server activity, and organize build errors for debugging. The tool integrates as a Webpack plugin to intercept compilation events and extract asset metadata. It utilizes a terminal-UI layout engine and state-driven rendering to display build progress and logs in a structured grid of dynamic windows. The system includes capabilities for real-time build log visualization and asset filtering using
Captures and filters standard output streams from the build process to provide instant display updates.
This project is a Python wrapper for the TA-Lib C library, serving as a financial technical analysis library and quantitative trading tool. It provides a collection of mathematical functions designed to analyze market price movements, identify trading signals, and recognize candlestick patterns within financial data. The library focuses on the computation of trend, momentum, and volume metrics. It includes specialized tools for candlestick pattern recognition to detect recurring price action shapes in both historical and real-time data. The system integrates with NumPy arrays to process cont
Streams live price updates to calculate technical indicators incrementally for low-latency financial tracking.
DouyinLiveRecorder is a multi-platform live stream recorder designed to monitor and save broadcasts from various global streaming platforms to local storage. It functions as an automated stream watchdog that continuously tracks broadcast statuses to initiate recording immediately when a stream goes live. The tool is a proxy-aware capture system capable of routing network requests through external servers to access and record content restricted to specific geographic regions. It utilizes platform-specific resolvers to map API patterns to stream identifiers, ensuring content can be archived fro
Employs multi-threaded concurrent workers to monitor the live status of multiple broadcast addresses in real time.
Crucix is an open-source intelligence system comprising an OSINT aggregator, a geospatial intelligence dashboard, and an LLM intelligence agent. It functions as a real-time signal monitor and automated alerting system designed to collect, analyze, and visualize geopolitical, economic, and satellite data from diverse open-source intelligence sources. The system utilizes large language models to synthesize intelligence feeds, generate actionable trade ideas, and classify signal priority with confidence scores. It features a geospatial visualization interface that plots intelligence events, such
Processes live financial data streams to track market indexes, cryptocurrency prices, and macroeconomic indicators.
Flyte is a Kubernetes-based machine learning orchestrator and containerized pipeline manager designed for coordinating AI workflows and data pipelines. It functions as an engine for defining and executing resilient pipelines, utilizing a data lineage tracker to maintain immutable execution states and ensure reproducible outputs. The platform distinguishes itself by packaging individual tasks into separate containers to ensure dependency isolation and environment consistency. It provides specialized capabilities for machine learning, including the transformation of trained models into scalable
Provides real-time tailing and filtering of logs generated by active workflow runs for monitoring and debugging.
Mediasoup is a selective forwarding unit used for real-time media routing. It enables the development of low-latency audio and video communication systems by routing streams between participants without transcoding. The project provides embedded media routing logic that can be integrated directly into an application. It supports simulcast and quality layering, allowing the system to adapt resolution and bitrate based on real-time bandwidth estimations to maintain connection stability. The capability surface includes media track management for audio, video, and screen capture, as well as bidi
Tracks and displays performance metrics and active speaker data for all media participants in a session.
open source、high performance、industrial rtsp streaming server,a lot of optimization on streaming relay,KeyFrame cache,RESTful,and web management,also EasyDarwin support distributed load balancing,a simple streaming media cloud platform architecture.
Tracks whether a stream source is connected or disconnected and surfaces that state in the management interface.
bililive-go is an automated broadcast archivist and recording tool designed specifically for Bilibili live streams. It functions as a monitoring service that tracks broadcast status and automatically captures live video content to local storage based on target identifiers. The system features a web-based manager that allows for the remote configuration of recording targets and global settings via a browser interface. It supports the simultaneous recording of multiple streams and provides real-time status alerts through external messaging services when broadcasts start, end, or encounter error
Acts as a background process tracking broadcast status and sending real-time start/end notifications.
Dieses Projekt enthält technische Dokumentationen und Referenzleitfäden für den Spot-Handel, einschließlich Spezifikationen für REST-, WebSocket- und FIX-Protokolle. Es dient als umfassende Ressource für die Integration mit Spot-Handels-Endpunkten, um Trades auszuführen, Kontodaten abzufragen und Marktstatistiken abzurufen. Das Projekt zeichnet sich dadurch aus, dass es Konnektivität auf institutionellem Niveau durch den Financial Information eXchange Standard und Simple Binary Encoding unterstützt, um Latenz und Payload-Größe zu reduzieren. Es enthält zudem eine dedizierte Sandbox-Umgebung zur Validierung von Handelslogik und Strategien ohne finanzielles Risiko. Die Dokumentation deckt eine breite Palette an Funktionen ab, einschließlich Echtzeit-Marktdaten-Streaming, umfassendem Order- und Trade-Lifecycle-Management sowie Kontomonitoring. Sie beschreibt zudem komplexe Ordertypen, Smart-Order-Routing und strikte Handelsregeln bezüglich Preis- und Mengenvalidierung. Das Repository enthält detaillierte API-Referenzen, einen Leitfaden zur FIX-Protokoll-Integration und eine WebSocket-Marktdatenspezifikation, um Entwickler während der Implementierung zu orientieren.
Monitors the connectivity and termination signals of real-time financial user data streams.
exllamav2 ist eine Hochleistungs-Inferenzbibliothek, die für das lokale Ausführen von Large Language Models auf Consumer-GPUs entwickelt wurde. Sie bietet einen GPU-beschleunigten Runner und Quantisierungstools, um die Modellausführung ohne Abhängigkeit von Cloud-Computing-Diensten zu ermöglichen. Das Projekt verfügt über ein Quantisierungs-Dienstprogramm, das Modelle in gemischte Bitraten zwischen zwei und acht Bit komprimiert, um den VRAM-Bedarf zu reduzieren. Es zeichnet sich durch einen gebatchten Textgenerator aus, der gruppierte Anfragen verarbeitet und Cache-Daten dedupliziert, um den Durchsatz zu erhöhen. Die Bibliothek deckt ein breites Funktionsspektrum ab, einschließlich asynchronem Token-Streaming für Echtzeit-Ausgabe, benutzerdefinierter GPU-Kernel-Ausführung für lineare Algebra-Operationen und lokalem Memory-Mapping für den Zugriff auf Modellgewichte mit geringer Latenz.
Provides components that deliver generated tokens incrementally to the user interface using asynchronous operations.
Console ist ein webbasiertes Management-Tool zur Überwachung und Administration von Kafka-Clustern. Es bietet eine grafische Oberfläche zur Verwaltung von Topics, Consumer-Groups und Echtzeit-Datenströmen. Das Projekt umfasst dedizierte Manager für Kafka Connect und die Schema Registry, was das Deployment von Daten-Connectoren und die Governance von Datenschemata ermöglicht. Es bietet ein Cluster-Dashboard zur Verfolgung von Broker-Gesundheit, Speichernutzung und Rack-Status sowie eine Schnittstelle für rollenbasierte Zugriffskontrolle und die Prüfung von Audit-Logs. Die Plattform deckt das Durchsuchen und Filtern von Daten, die Koordination von Consumer-Groups und den Aufbau von Datenpipelines ab. Zudem unterstützt sie die Überwachung von Datentransformationsaufgaben und die Verwaltung von Nutzerberechtigungen über eine zentralisierte Policy-Engine.
Implements tools to track and monitor broker-side streaming tasks for data filtering and transcoding.
PRAW is a Python wrapper for the Reddit API, functioning as a REST API client and social media data crawler. It provides a programmatic interface to fetch data, manage account content, and interact with the platform. The library implements a comprehensive OAuth 2.0 client supporting multiple authorization flows, including password, implicit, and refresh tokens, as well as read-only guest access. It distinguishes itself through a rate-limit-aware request scheduler that tracks server-side throttling to prevent API quota exhaustion and employs lazy-loading resource objects to fetch data only whe
Monitors communities in real-time to iterate over new posts as they are submitted.
Tribeca ist eine Node.js-Kryptowährungs-Handelsplattform für Hochfrequenzhandel und automatisiertes Market Making. Sie fungiert als Low-Latency-Execution-Engine, die den Prozess der Liquiditätsbereitstellung und das Erfassen von Preisspannen über mehrere Kryptobörsen hinweg automatisiert. Das System nutzt eine Konnektivitätsschicht, um Echtzeit-Marktdaten zu streamen und Trades über persistente Netzwerkverbindungen auszuführen. Es verwendet eine adapterbasierte Integration, um diverse Venue-APIs in ein einheitliches Format zu normalisieren, was koordinierte Aktivitäten über verschiedene Kryptobörsen hinweg ermöglicht. Die Plattform enthält einen algorithmischen Backtester zur Validierung von Strategien anhand historischer Daten sowie ein visuelles Kontroll-Dashboard zur Überwachung aktiver Positionen und Quotierungsparameter. Weitere Funktionen umfassen ereignisgesteuerte Order-Ausführung, zustandsbasiertes Positions-Tracking und persistente Datenbankspeicherung zur Prüfung von Handelsaufzeichnungen.
Implements a real-time streaming system to track financial indicators and account status via a web interface.
Dinky is a real-time data platform for developing, deploying, and operating streaming applications based on Apache Flink. It functions as a SQL streaming IDE and a real-time data pipeline orchestrator, providing a web-based environment for writing and verifying queries with integrated logic plan visualization and lineage tracking. The platform acts as a distributed cluster manager, allowing the registration, monitoring, and administration of multiple processing clusters from a centralized interface. It also serves as a change data capture integration tool, synchronizing real-time database cha
Provides real-time previewing of table contents and custom functions to verify streaming processing logic.
Curlie is a terminal-based HTTP client and debugging tool used for executing network requests and interacting with REST APIs. It provides a command line interface for sending requests using simplified syntax, with a specific focus on interacting with JSON services. The tool distinguishes itself by converting simplified interactive requests into standard curl commands for external reproduction and sharing. It also features unbuffered data streaming to monitor server responses in real time as they arrive. The project covers a broad range of API testing capabilities, including request prototypi
Provides capabilities for tailing and observing unbuffered server responses as they arrive in real time.