21 repositorios
Utilities for tailing and filtering live data streams.
Explore 21 awesome GitHub repositories matching data & databases · Real-time Stream Monitors. Refine with filters or upvote what's useful.
This project is a general-purpose command-line filter that provides an interactive interface for processing standard input streams. It enables real-time fuzzy searching, data selection, and transformation, allowing users to navigate complex information or file systems directly within their terminal. By utilizing a pipe-oriented architecture, it integrates into existing shell pipelines and workflows to facilitate efficient data exploration. What distinguishes this tool is its highly extensible, event-driven design that allows for deep integration with external processes. It supports asynchrono
Filters live data streams in real-time to provide an interactive interface for monitoring and selecting output.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Captures and displays a real-time feed of all incoming requests to the server for debugging and auditing.
Guidance is a generative AI orchestration framework designed to manage complex interactions with language models by embedding programmatic control directly into the prompt generation process. It functions as a prompt programming environment that allows developers to interleave raw text with executable logic, enabling the construction of sophisticated, multi-step agentic workflows. The framework distinguishes itself through grammar-constrained token sampling and stateful stream interception, which restrict the model's output distribution based on formal language rules. By enforcing these const
Monitors and modifies token generation in real time to enforce logical constraints on model output.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Delivers generated tokens incrementally to the user interface as they are produced to provide real-time feedback.
This project is a cross-platform media aggregator and streaming API wrapper designed to retrieve live broadcast data from various video platforms. It functions as a unified interface for fetching direct playback URLs and real-time chat logs, enabling the development of custom broadcast monitoring and interactive streaming applications. The tool distinguishes itself by providing a consistent data extraction layer that normalizes disparate video source formats into a unified structure. By parsing stream links through targeted network requests, it allows developers to integrate live broadcast me
Extracts metadata and real-time chat information from streaming services to facilitate broadcast monitoring.
webpack-dashboard is a terminal-based build monitor and asset viewer designed for the Webpack development process. It provides a command line interface to track compilation status, monitor development server activity, and organize build errors for debugging. The tool integrates as a Webpack plugin to intercept compilation events and extract asset metadata. It utilizes a terminal-UI layout engine and state-driven rendering to display build progress and logs in a structured grid of dynamic windows. The system includes capabilities for real-time build log visualization and asset filtering using
Captures and filters standard output streams from the build process to provide instant display updates.
This project is a Python wrapper for the TA-Lib C library, serving as a financial technical analysis library and quantitative trading tool. It provides a collection of mathematical functions designed to analyze market price movements, identify trading signals, and recognize candlestick patterns within financial data. The library focuses on the computation of trend, momentum, and volume metrics. It includes specialized tools for candlestick pattern recognition to detect recurring price action shapes in both historical and real-time data. The system integrates with NumPy arrays to process cont
Streams live price updates to calculate technical indicators incrementally for low-latency financial tracking.
DouyinLiveRecorder is a multi-platform live stream recorder designed to monitor and save broadcasts from various global streaming platforms to local storage. It functions as an automated stream watchdog that continuously tracks broadcast statuses to initiate recording immediately when a stream goes live. The tool is a proxy-aware capture system capable of routing network requests through external servers to access and record content restricted to specific geographic regions. It utilizes platform-specific resolvers to map API patterns to stream identifiers, ensuring content can be archived fro
Employs multi-threaded concurrent workers to monitor the live status of multiple broadcast addresses in real time.
Crucix is an open-source intelligence system comprising an OSINT aggregator, a geospatial intelligence dashboard, and an LLM intelligence agent. It functions as a real-time signal monitor and automated alerting system designed to collect, analyze, and visualize geopolitical, economic, and satellite data from diverse open-source intelligence sources. The system utilizes large language models to synthesize intelligence feeds, generate actionable trade ideas, and classify signal priority with confidence scores. It features a geospatial visualization interface that plots intelligence events, such
Processes live financial data streams to track market indexes, cryptocurrency prices, and macroeconomic indicators.
Flyte is a Kubernetes-based machine learning orchestrator and containerized pipeline manager designed for coordinating AI workflows and data pipelines. It functions as an engine for defining and executing resilient pipelines, utilizing a data lineage tracker to maintain immutable execution states and ensure reproducible outputs. The platform distinguishes itself by packaging individual tasks into separate containers to ensure dependency isolation and environment consistency. It provides specialized capabilities for machine learning, including the transformation of trained models into scalable
Provides real-time tailing and filtering of logs generated by active workflow runs for monitoring and debugging.
Mediasoup is a selective forwarding unit used for real-time media routing. It enables the development of low-latency audio and video communication systems by routing streams between participants without transcoding. The project provides embedded media routing logic that can be integrated directly into an application. It supports simulcast and quality layering, allowing the system to adapt resolution and bitrate based on real-time bandwidth estimations to maintain connection stability. The capability surface includes media track management for audio, video, and screen capture, as well as bidi
Tracks and displays performance metrics and active speaker data for all media participants in a session.
open source、high performance、industrial rtsp streaming server,a lot of optimization on streaming relay,KeyFrame cache,RESTful,and web management,also EasyDarwin support distributed load balancing,a simple streaming media cloud platform architecture.
Tracks whether a stream source is connected or disconnected and surfaces that state in the management interface.
bililive-go is an automated broadcast archivist and recording tool designed specifically for Bilibili live streams. It functions as a monitoring service that tracks broadcast status and automatically captures live video content to local storage based on target identifiers. The system features a web-based manager that allows for the remote configuration of recording targets and global settings via a browser interface. It supports the simultaneous recording of multiple streams and provides real-time status alerts through external messaging services when broadcasts start, end, or encounter error
Acts as a background process tracking broadcast status and sending real-time start/end notifications.
Este proyecto proporciona documentación técnica y guías de referencia para el trading al contado (spot trading), incluyendo especificaciones para protocolos REST, WebSocket y FIX. Sirve como un recurso integral para integrarse con endpoints de trading al contado para ejecutar operaciones, consultar datos de cuenta y obtener estadísticas de mercado. El proyecto se distingue por admitir conectividad de grado institucional a través del estándar Financial Information eXchange (FIX) y codificación binaria simple para reducir la latencia y el tamaño de la carga útil. También incluye un entorno de sandbox dedicado para validar la lógica y las estrategias de trading sin riesgo financiero. La documentación cubre una amplia gama de capacidades, incluyendo streaming de datos de mercado en tiempo real, gestión integral del ciclo de vida de órdenes y operaciones, y monitoreo de cuentas. También detalla tipos de órdenes complejos, enrutamiento inteligente de órdenes y reglas de trading estrictas con respecto a la validación de precio y cantidad. El repositorio contiene referencias detalladas de API, una guía de integración del protocolo FIX y una especificación de datos de mercado WebSocket para orientar a los desarrolladores durante la implementación.
Monitors the connectivity and termination signals of real-time financial user data streams.
exllamav2 es una librería de inferencia de alto rendimiento diseñada para ejecutar modelos de lenguaje grandes localmente en GPUs de grado consumidor. Proporciona un runner acelerado por GPU y herramientas de cuantización para permitir la ejecución de modelos sin depender de servicios de computación en la nube. El proyecto cuenta con una utilidad de cuantización que comprime modelos en bitrates mixtos de entre dos y ocho bits para reducir los requisitos de VRAM. Se distingue por un generador de texto por lotes que maneja solicitudes agrupadas y deduplica datos de caché para aumentar el rendimiento. La librería cubre una amplia superficie de capacidades, incluyendo streaming de tokens asíncrono para salida en tiempo real, ejecución de kernels de GPU personalizados para operaciones de álgebra lineal y mapeo de memoria local para acceso de baja latencia a los pesos del modelo.
Provides components that deliver generated tokens incrementally to the user interface using asynchronous operations.
Console es una herramienta de gestión basada en web para monitorear y administrar clústeres de Kafka. Proporciona una interfaz gráfica para gestionar temas, grupos de consumidores y flujos de datos en tiempo real. El proyecto incluye gestores dedicados para Kafka Connect y el Schema Registry, permitiendo el despliegue de conectores de datos y la gobernanza de esquemas de datos. Cuenta con un panel de control del clúster para realizar un seguimiento de la salud de los brokers, el uso de almacenamiento y el estado del rack, junto con una interfaz para el control de acceso basado en roles y la inspección de registros de auditoría. La plataforma cubre la navegación y filtrado de datos, la coordinación de grupos de consumidores y la construcción de tuberías de datos. También admite el monitoreo de tareas de transformación de datos y la gestión de permisos de usuario a través de un motor de políticas centralizado.
Implements tools to track and monitor broker-side streaming tasks for data filtering and transcoding.
PRAW es un wrapper de Python para la API de Reddit, que funciona como cliente de API REST y crawler de datos de redes sociales. Proporciona una interfaz programática para obtener datos, gestionar el contenido de la cuenta e interactuar con la plataforma. La librería implementa un cliente OAuth 2.0 completo que admite múltiples flujos de autorización, incluyendo contraseñas, tokens implícitos y de actualización, así como acceso de invitado de solo lectura. Se distingue por un planificador de solicitudes consciente de los límites de tasa (rate-limit) que rastrea la limitación del lado del servidor para evitar el agotamiento de la cuota de la API, y emplea objetos de carga diferida (lazy-loading) para obtener datos solo cuando se acceden a atributos específicos. Sus capacidades cubren la gestión de comunidades y usuarios, streaming de envíos en tiempo real mediante generadores y la extracción de hilos de discusión anidados. El conjunto de herramientas también incluye gestión de contenido para crear publicaciones y comentarios, junto con opciones de configuración de red para sesiones personalizadas y enrutamiento mediante proxy.
Monitors communities in real-time to iterate over new posts as they are submitted.
Tribeca es una plataforma de trading de criptomonedas en Node.js diseñada para trading de alta frecuencia y creación de mercado automatizada. Funciona como un motor de ejecución de baja latencia que automatiza el proceso de proporcionar liquidez y capturar spreads de precios a través de múltiples exchanges de criptomonedas. El sistema emplea una capa de conectividad para transmitir datos de mercado en tiempo real y ejecutar operaciones a través de conexiones de red persistentes. Utiliza una integración basada en adaptadores para normalizar diversas API de plataformas en un formato unificado, permitiendo una actividad coordinada a través de varios exchanges de criptomonedas diferentes. La plataforma incluye un backtester algorítmico para validar estrategias contra datos históricos y un panel de control visual para monitorear posiciones activas y parámetros de cotización. Las capacidades adicionales cubren la ejecución de órdenes basada en eventos, el seguimiento de posiciones basado en estados y el almacenamiento persistente en base de datos para auditar registros de trading.
Implements a real-time streaming system to track financial indicators and account status via a web interface.
Dinky is a real-time data platform for developing, deploying, and operating streaming applications based on Apache Flink. It functions as a SQL streaming IDE and a real-time data pipeline orchestrator, providing a web-based environment for writing and verifying queries with integrated logic plan visualization and lineage tracking. The platform acts as a distributed cluster manager, allowing the registration, monitoring, and administration of multiple processing clusters from a centralized interface. It also serves as a change data capture integration tool, synchronizing real-time database cha
Provides real-time previewing of table contents and custom functions to verify streaming processing logic.
Curlie is a terminal-based HTTP client and debugging tool used for executing network requests and interacting with REST APIs. It provides a command line interface for sending requests using simplified syntax, with a specific focus on interacting with JSON services. The tool distinguishes itself by converting simplified interactive requests into standard curl commands for external reproduction and sharing. It also features unbuffered data streaming to monitor server responses in real time as they arrive. The project covers a broad range of API testing capabilities, including request prototypi
Provides capabilities for tailing and observing unbuffered server responses as they arrive in real time.