21 dépôts
Utilities for tailing and filtering live data streams.
Explore 21 awesome GitHub repositories matching data & databases · Real-time Stream Monitors. Refine with filters or upvote what's useful.
This project is a general-purpose command-line filter that provides an interactive interface for processing standard input streams. It enables real-time fuzzy searching, data selection, and transformation, allowing users to navigate complex information or file systems directly within their terminal. By utilizing a pipe-oriented architecture, it integrates into existing shell pipelines and workflows to facilitate efficient data exploration. What distinguishes this tool is its highly extensible, event-driven design that allows for deep integration with external processes. It supports asynchrono
Filters live data streams in real-time to provide an interactive interface for monitoring and selecting output.
This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha
Captures and displays a real-time feed of all incoming requests to the server for debugging and auditing.
Guidance is a generative AI orchestration framework designed to manage complex interactions with language models by embedding programmatic control directly into the prompt generation process. It functions as a prompt programming environment that allows developers to interleave raw text with executable logic, enabling the construction of sophisticated, multi-step agentic workflows. The framework distinguishes itself through grammar-constrained token sampling and stateful stream interception, which restrict the model's output distribution based on formal language rules. By enforcing these const
Monitors and modifies token generation in real time to enforce logical constraints on model output.
This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation
Delivers generated tokens incrementally to the user interface as they are produced to provide real-time feedback.
This project is a cross-platform media aggregator and streaming API wrapper designed to retrieve live broadcast data from various video platforms. It functions as a unified interface for fetching direct playback URLs and real-time chat logs, enabling the development of custom broadcast monitoring and interactive streaming applications. The tool distinguishes itself by providing a consistent data extraction layer that normalizes disparate video source formats into a unified structure. By parsing stream links through targeted network requests, it allows developers to integrate live broadcast me
Extracts metadata and real-time chat information from streaming services to facilitate broadcast monitoring.
webpack-dashboard is a terminal-based build monitor and asset viewer designed for the Webpack development process. It provides a command line interface to track compilation status, monitor development server activity, and organize build errors for debugging. The tool integrates as a Webpack plugin to intercept compilation events and extract asset metadata. It utilizes a terminal-UI layout engine and state-driven rendering to display build progress and logs in a structured grid of dynamic windows. The system includes capabilities for real-time build log visualization and asset filtering using
Captures and filters standard output streams from the build process to provide instant display updates.
This project is a Python wrapper for the TA-Lib C library, serving as a financial technical analysis library and quantitative trading tool. It provides a collection of mathematical functions designed to analyze market price movements, identify trading signals, and recognize candlestick patterns within financial data. The library focuses on the computation of trend, momentum, and volume metrics. It includes specialized tools for candlestick pattern recognition to detect recurring price action shapes in both historical and real-time data. The system integrates with NumPy arrays to process cont
Streams live price updates to calculate technical indicators incrementally for low-latency financial tracking.
DouyinLiveRecorder is a multi-platform live stream recorder designed to monitor and save broadcasts from various global streaming platforms to local storage. It functions as an automated stream watchdog that continuously tracks broadcast statuses to initiate recording immediately when a stream goes live. The tool is a proxy-aware capture system capable of routing network requests through external servers to access and record content restricted to specific geographic regions. It utilizes platform-specific resolvers to map API patterns to stream identifiers, ensuring content can be archived fro
Employs multi-threaded concurrent workers to monitor the live status of multiple broadcast addresses in real time.
Crucix is an open-source intelligence system comprising an OSINT aggregator, a geospatial intelligence dashboard, and an LLM intelligence agent. It functions as a real-time signal monitor and automated alerting system designed to collect, analyze, and visualize geopolitical, economic, and satellite data from diverse open-source intelligence sources. The system utilizes large language models to synthesize intelligence feeds, generate actionable trade ideas, and classify signal priority with confidence scores. It features a geospatial visualization interface that plots intelligence events, such
Processes live financial data streams to track market indexes, cryptocurrency prices, and macroeconomic indicators.
Flyte is a Kubernetes-based machine learning orchestrator and containerized pipeline manager designed for coordinating AI workflows and data pipelines. It functions as an engine for defining and executing resilient pipelines, utilizing a data lineage tracker to maintain immutable execution states and ensure reproducible outputs. The platform distinguishes itself by packaging individual tasks into separate containers to ensure dependency isolation and environment consistency. It provides specialized capabilities for machine learning, including the transformation of trained models into scalable
Provides real-time tailing and filtering of logs generated by active workflow runs for monitoring and debugging.
Mediasoup is a selective forwarding unit used for real-time media routing. It enables the development of low-latency audio and video communication systems by routing streams between participants without transcoding. The project provides embedded media routing logic that can be integrated directly into an application. It supports simulcast and quality layering, allowing the system to adapt resolution and bitrate based on real-time bandwidth estimations to maintain connection stability. The capability surface includes media track management for audio, video, and screen capture, as well as bidi
Tracks and displays performance metrics and active speaker data for all media participants in a session.
open source、high performance、industrial rtsp streaming server,a lot of optimization on streaming relay,KeyFrame cache,RESTful,and web management,also EasyDarwin support distributed load balancing,a simple streaming media cloud platform architecture.
Tracks whether a stream source is connected or disconnected and surfaces that state in the management interface.
bililive-go is an automated broadcast archivist and recording tool designed specifically for Bilibili live streams. It functions as a monitoring service that tracks broadcast status and automatically captures live video content to local storage based on target identifiers. The system features a web-based manager that allows for the remote configuration of recording targets and global settings via a browser interface. It supports the simultaneous recording of multiple streams and provides real-time status alerts through external messaging services when broadcasts start, end, or encounter error
Acts as a background process tracking broadcast status and sending real-time start/end notifications.
Ce projet fournit une documentation technique et des guides de référence pour le trading au comptant (spot trading), incluant des spécifications pour les protocoles REST, WebSocket et FIX. Il sert de ressource complète pour l'intégration avec les endpoints de trading au comptant afin d'exécuter des transactions, d'interroger les données de compte et de récupérer les statistiques de marché. Le projet se distingue par la prise en charge d'une connectivité de qualité institutionnelle via le standard Financial Information eXchange (FIX) et un encodage binaire simple pour réduire la latence et la taille de la charge utile. Il inclut également un environnement sandbox dédié pour valider la logique et les stratégies de trading sans risque financier. La documentation couvre un large éventail de capacités, notamment le streaming de données de marché en temps réel, la gestion complète du cycle de vie des ordres et des transactions, et la surveillance des comptes. Elle détaille également les types d'ordres complexes, le routage intelligent des ordres et les règles de trading strictes concernant la validation des prix et des quantités. Le dépôt contient des références API détaillées, un guide d'intégration du protocole FIX et une spécification de données de marché WebSocket pour orienter les développeurs lors de l'implémentation.
Monitors the connectivity and termination signals of real-time financial user data streams.
exllamav2 is a high-performance inference library designed for running large language models locally on consumer-grade GPUs. It provides a GPU-accelerated runner and quantization tools to enable model execution without reliance on cloud-based computing services. The project features a quantization utility that compresses models into mixed bitrates between two and eight bits to reduce video RAM requirements. It distinguishes itself through a batched text generator that handles grouped requests and deduplicates cache data to increase throughput. The library covers a broad capability surface in
Provides components that deliver generated tokens incrementally to the user interface using asynchronous operations.
Console est un outil de gestion basé sur le web pour surveiller et administrer les clusters Kafka. Il fournit une interface graphique pour gérer les topics, les groupes de consommateurs et les flux de données en temps réel. Le projet inclut des gestionnaires dédiés pour Kafka Connect et le Schema Registry, permettant le déploiement de connecteurs de données et la gouvernance des schémas de données. Il dispose d'un tableau de bord de cluster pour suivre la santé des brokers, l'utilisation du stockage et l'état des racks, ainsi qu'une interface pour le contrôle d'accès basé sur les rôles et l'inspection des journaux d'audit. La plateforme couvre la navigation et le filtrage des données, la coordination des groupes de consommateurs et la construction de pipelines de données. Elle prend également en charge la surveillance des tâches de transformation de données et la gestion des autorisations des utilisateurs via un moteur de politique centralisé.
Implements tools to track and monitor broker-side streaming tasks for data filtering and transcoding.
PRAW est un wrapper Python pour l'API Reddit, fonctionnant comme un client API REST et un crawler de données de réseaux sociaux. Il fournit une interface programmatique pour récupérer des données, gérer le contenu d'un compte et interagir avec la plateforme. La bibliothèque implémente un client OAuth 2.0 complet prenant en charge plusieurs flux d'autorisation, y compris les mots de passe, les jetons implicites et de rafraîchissement, ainsi que l'accès invité en lecture seule. Elle se distingue par un planificateur de requêtes conscient des limites de débit qui suit le bridage côté serveur pour éviter l'épuisement du quota API, et utilise des objets de ressources à chargement différé pour ne récupérer les données que lorsque des attributs spécifiques sont accédés. Les capacités couvrent la gestion des communautés et des utilisateurs, le streaming de soumissions en temps réel via des générateurs, et l'extraction de fils de discussion imbriqués. L'ensemble d'outils inclut également la gestion de contenu pour créer des posts et des commentaires, ainsi que des options de configuration réseau pour les sessions personnalisées et le routage via proxy.
Monitors communities in real-time to iterate over new posts as they are submitted.
Tribeca est une plateforme de trading de cryptomonnaies Node.js conçue pour le trading haute fréquence et le market making automatisé. Elle fonctionne comme un moteur d'exécution à faible latence qui automatise le processus de fourniture de liquidité et de capture des spreads de prix sur plusieurs échanges de cryptomonnaies. Le système emploie une couche de connectivité pour diffuser des données de marché en temps réel et exécuter des transactions via des connexions réseau persistantes. Il utilise une intégration basée sur des adaptateurs pour normaliser les API de divers sites en un format unifié, permettant une activité coordonnée sur plusieurs plateformes de cryptomonnaies différentes. La plateforme inclut un backtester algorithmique pour valider les stratégies par rapport aux données historiques et un tableau de bord de contrôle visuel pour surveiller les positions actives et les paramètres de cotation. Les capacités supplémentaires couvrent l'exécution d'ordres pilotée par les événements, le suivi de position basé sur l'état et le stockage persistant en base de données pour l'audit des enregistrements de trading.
Implements a real-time streaming system to track financial indicators and account status via a web interface.
Dinky is a real-time data platform for developing, deploying, and operating streaming applications based on Apache Flink. It functions as a SQL streaming IDE and a real-time data pipeline orchestrator, providing a web-based environment for writing and verifying queries with integrated logic plan visualization and lineage tracking. The platform acts as a distributed cluster manager, allowing the registration, monitoring, and administration of multiple processing clusters from a centralized interface. It also serves as a change data capture integration tool, synchronizing real-time database cha
Provides real-time previewing of table contents and custom functions to verify streaming processing logic.
Curlie is a terminal-based HTTP client and debugging tool used for executing network requests and interacting with REST APIs. It provides a command line interface for sending requests using simplified syntax, with a specific focus on interacting with JSON services. The tool distinguishes itself by converting simplified interactive requests into standard curl commands for external reproduction and sharing. It also features unbuffered data streaming to monitor server responses in real time as they arrive. The project covers a broad range of API testing capabilities, including request prototypi
Provides capabilities for tailing and observing unbuffered server responses as they arrive in real time.