awesome-repositories.com
Blog
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektÜber unsRanking-MethodikPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

12 Repos

Awesome GitHub RepositoriesTelemetry Data Pipelines

Systems designed for the high-volume ingestion, processing, and streaming of real-time sensor and event data.

Distinguishing note: Focuses on high-throughput ingestion and streaming pipelines for telemetry, distinct from general-purpose database management.

Explore 12 awesome GitHub repositories matching data & databases · Telemetry Data Pipelines. Refine with filters or upvote what's useful.

Awesome Telemetry Data Pipelines GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • clickhouse/clickhouseAvatar von ClickHouse

    ClickHouse/ClickHouse

    48,229Auf GitHub ansehen↗

    ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through ad

    Processes millions of events per second from streaming sources to enable real-time analytics and monitoring.

    C++aianalyticsbig-data
    Auf GitHub ansehen↗48,229
  • apache/skywalkingAvatar von apache

    apache/skywalking

    24,839Auf GitHub ansehen↗

    SkyWalking is an application performance monitoring system and observability platform designed to collect and analyze metrics, traces, and logs from distributed microservices. It functions as a distributed tracing platform and a telemetry data pipeline that ingests and aggregates observability data from various language agents. The project features an AI-powered anomaly detector that uses machine learning to calculate metric baselines and identify irregular URI patterns. It includes an eBPF performance profiler for diagnosing CPU and network bottlenecks at the kernel level and generates inter

    Implements a high-performance engine for the ingestion, processing, and aggregation of multi-source observability data.

    Javaapmdapperdistributed-tracing
    Auf GitHub ansehen↗24,839
  • openobserve/openobserveAvatar von openobserve

    openobserve/openobserve

    17,937Auf GitHub ansehen↗

    OpenObserve is a unified observability data platform designed to ingest, store, and analyze logs, metrics, and traces. It functions as a cloud-native monitoring tool that centralizes telemetry from diverse sources, including standard collectors and cloud service providers, into a single, scalable system. By utilizing a columnar storage engine backed by object storage, the platform enables efficient long-term data retention and high-performance analytical querying. The platform distinguishes itself through deep integration with artificial intelligence, allowing users to query data using natura

    Ingests, transforms, and routes telemetry data streams from cloud services and standard collectors.

    TypeScriptanalyticsapmdatadog
    Auf GitHub ansehen↗17,937
  • influxdata/telegrafAvatar von influxdata

    influxdata/telegraf

    17,619Auf GitHub ansehen↗

    Telegraf is a modular, cross-platform telemetry pipeline designed to collect, process, and route metrics from diverse infrastructure, applications, and hardware. It functions as a server-side middleware that normalizes heterogeneous data into a unified format, enabling consistent monitoring across complex environments. By utilizing a plugin-driven architecture, the agent manages the entire lifecycle of telemetry data from initial ingestion to final transmission. The project distinguishes itself through a declarative, configuration-driven execution model that allows users to define complex dat

    Ingests metrics from various sources, applies transformations, and routes them to multiple configured output destinations.

    Gogolanghacktoberfestinfluxdb
    Auf GitHub ansehen↗17,619
  • microsoft/sql-server-samplesAvatar von microsoft

    microsoft/sql-server-samples

    11,122Auf GitHub ansehen↗

    This is a reference implementation library providing a collection of code samples, Transact-SQL scripts, and schemas for SQL Server, Azure SQL, and Azure Synapse. It focuses on providing standardized implementation patterns and reference code for building relational databases and cloud data warehouses. The library distinguishes itself by offering specialized guides and examples for deploying database instances within containerized environments and Azure cloud services. It includes specific reference databases and language extensions for integrating machine learning services and advanced analy

    Provides specialized ingestion pipelines for streaming real-time sensor data into relational tables.

    Auf GitHub ansehen↗11,122
  • wandb/clientAvatar von wandb

    wandb/client

    11,128Auf GitHub ansehen↗

    This project is a collection of utilities designed for machine learning experiment tracking, data versioning, and the observability of large language model applications. It provides a client for recording hyperparameters and metrics during training to visualize performance trends and compare different model versions. The tool includes a model evaluation framework that uses custom scorers and automated judges to assess the quality of generated text outputs. It also provides observability tools to monitor and debug the execution flow and runtime behavior of language model applications. The sys

    Ships a telemetry data pipeline using REST-based HTTP requests to transmit model performance data to a centralized backend.

    Python
    Auf GitHub ansehen↗11,128
  • getsentry/sentry-javascriptAvatar von getsentry

    getsentry/sentry-javascript

    8,693Auf GitHub ansehen↗

    This project is a JavaScript error tracking SDK and application performance monitoring tool. It captures runtime exceptions and crashes across web browsers, server-side environments, and edge computing contexts. The SDK includes a session replay tool that records visual user interactions to reproduce bugs. To ensure telemetry delivery, it provides a tunneling proxy that routes monitoring data through custom endpoints to bypass browser-level ad blockers. The toolkit also features a source map processor that translates minified stack traces back into original source code. Additionally, it cove

    Implements a telemetry pipeline to collect errors and performance spans for asynchronous transmission.

    TypeScriptangularcrash-reportingember
    Auf GitHub ansehen↗8,693
  • podman-desktop/podman-desktopAvatar von podman-desktop

    podman-desktop/podman-desktop

    7,722Auf GitHub ansehen↗

    Podman Desktop is a graphical user interface for building, managing, and deploying containers and Kubernetes clusters from a local workstation. It serves as a container engine manager and a Kubernetes cluster dashboard, providing a visual environment for tasks typically handled via the command line. The project includes a container extension framework that allows users to integrate additional tools and capabilities into the management environment through a plugin system and extension catalog. The software covers the full container lifecycle, including image building and pushing to registries

    Collects anonymous usage data and error reports asynchronously to monitor application stability without blocking the UI.

    TypeScriptcontainercontainersdesktop
    Auf GitHub ansehen↗7,722
  • yalantis/side-menu.androidAvatar von Yalantis

    Yalantis/Side-Menu.Android

    5,212Auf GitHub ansehen↗

    Side-Menu.Android ist eine wiederverwendbare UI-Komponente für Android-Anwendungen, die eine ausziehbare Navigationsleiste (Slide-out Navigation Drawer) bereitstellt. Sie wurde entwickelt, um Entwicklern dabei zu helfen, Anwendungsbereiche und Benutzeroptionen in einem strukturierten, verborgenen Panel zu organisieren, das eine saubere Schnittstelle für den primären Inhaltsbereich beibehält. Die Komponente zeichnet sich durch ihre visuelle Präsentation aus, die den Material Design-Richtlinien folgt, um eine konsistente und intuitive Benutzererfahrung zu gewährleisten. Sie verfügt über eine datengesteuerte Menühierarchie, die eine logische Gruppierung von Navigationselementen ermöglicht, und integriert flüssige kreisförmige Reveal-Animationen, um polierte visuelle Übergänge beim Öffnen oder Schließen des Menüs zu bieten. Durch die Kapselung komplexer Layout- und Interaktionslogik in eine einzige, modulare Klasse vereinfacht die Bibliothek die Implementierung der Navigation über mehrere Bildschirme hinweg. Sie unterstützt ereignisgesteuerte Übergänge, was es Entwicklern ermöglicht, Menüinteraktionen von Inhaltsaktualisierungen zu entkoppeln, um eine saubere und reaktionsschnelle Anwendungsarchitektur zu wahren.

    Ingests and processes high-volume telemetry data through streaming architectures for real-time analytics.

    Javaandroidanimationdrawer-layout
    Auf GitHub ansehen↗5,212
  • real-stanford/diffusion_policyAvatar von real-stanford

    real-stanford/diffusion_policy

    4,299Auf GitHub ansehen↗

    Diffusion Policy ist ein Robot-Learning-Framework, das Diffusionsmodelle verwendet, um visuelle Beobachtungen auf präzise Aktionstrajektorien abzubilden. Es fungiert als Imitation-Learning-Toolkit und Visuomotor-Policy-Learner und bietet ein System zum Training neuronaler Netze, die menschliches Verhalten durch die Generierung robotischer Bewegungen basierend auf Bild- und Sensordaten replizieren. Das Framework verwendet einen konditionalen Denoising-Prozess, um Sequenzen robotischer Bewegungen zu samplen, was es ermöglicht, multimodale Aktionsverteilungen zu handhaben, bei denen mehrere gültige Trajektorien für einen einzelnen Zustand existieren können. Es nutzt score-basiertes Aktionsmodellieren und einen Roboter-Aktionsgenerator, um präzise Verhaltensweisen für komplexe physische Aufgaben zu erzeugen. Das Projekt deckt eine umfassende Robotik-Datenpipeline ab, einschließlich der Sammlung von menschengeführten Demonstrationen und der Speicherung groß angelegter Trajektorien in komprimierten, gechunkten Formaten. Seine Steuerungsfunktionen umfassen Receding-Horizon-Control via Sliding-Window-Ausführung und asynchrone Aktionsbereitstellung an Hardware-Controller, um hochfrequente Beobachtungsschleifen aufrechtzuerhalten. Das System enthält Tools für das Experiment-Management, wie Workspace-Encapsulation und Modell-Checkpointing, sowie Policy-Evaluierung zum Testen auf physischer oder simulierter Hardware.

    Provides a telemetry data pipeline for batching and streaming high-resolution image and sensor data for training.

    Pythonrobotics
    Auf GitHub ansehen↗4,299
  • riemann/riemannAvatar von riemann

    riemann/riemann

    4,266Auf GitHub ansehen↗

    Riemann is a Clojure-based event stream processor and real-time analytics engine. It functions as a network telemetry pipeline and extensible event router that ingests, transforms, and routes event data from distributed systems. The system uses a domain-specific language to compute metrics and statistical patterns over continuous streams, enabling network trend analysis and real-time alerting. It supports dynamic plugin loading from the classpath and allows for live configuration reloading without interrupting active event streams. Capabilities include centralized telemetry aggregation, even

    Implements a high-volume data pipeline for the ingestion, processing, and forwarding of real-time network telemetry.

    Clojure
    Auf GitHub ansehen↗4,266
  • open-telemetry/opentelemetry-go-contribAvatar von open-telemetry

    open-telemetry/opentelemetry-go-contrib

    1,634Auf GitHub ansehen↗

    This project provides a collection of extensions for the OpenTelemetry Go software development kit, serving as a toolkit for automated instrumentation, context propagation, and telemetry pipeline management. It enables the capture of traces, metrics, and logs across distributed systems by providing unified interfaces that decouple data collection from specific backend storage or analysis platforms. The project distinguishes itself through its ability to inject telemetry collection into popular frameworks and libraries without requiring manual source code modifications. It maintains request co

    Routes telemetry signals through a series of configurable processors that filter, sample, and transform data before final export.

    Go
    Auf GitHub ansehen↗1,634
  1. Home
  2. Data & Databases
  3. Telemetry Data Pipelines