Opentelemetry Collector Contrib

Acest proiect oferă un pipeline de date de observabilitate conceput pentru a colecta, transforma și ruta log-uri, metrici și urme (traces) din surse diverse în formate standardizate pentru analiză. Acesta operează ca o arhitectură de componente bazată pe plugin-uri, folosind receptoare, procesoare și exportatoare modulare pentru a muta datele de telemetrie prin lanțuri de procesare secvențiale.

Sistemul utilizează un model de componente bazat pe interfețe care permite conectori interschimbabili și extensii contribuite de comunitate. Se distinge printr-un limbaj specific domeniului (DSL) pentru filtrarea telemetriei, atribuirea resurselor bazată pe metadate pentru detectarea infrastructurii și rezolvarea dinamică a secretelor din manageri cloud externi.

Colectorul acoperă o gamă largă de capabilități, inclusiv ingestia de telemetrie de la furnizori cloud și baze de date, transformarea și reagregarea datelor și exportul securizat către backend-uri de stocare terțe. Încorporează funcții de gestionare a traficului, cum ar fi rutarea round-robin și partiționarea mesajelor, precum și primitive de securitate pentru gestionarea identității și a accesului prin OAuth2 și OIDC.

Proiectul include un framework de asigurare a calității pentru simularea datelor sintetice, testarea performanței end-to-end și verificarea integrității datelor.

Features

Telemetry Routing - Directs observability data through connectors and processors to transform or filter it before backend delivery.
Observability Pipelines - Collects and transforms logs, metrics, and traces from diverse sources into standardized formats.
Telemetry Signal Processors - Filters and enriches telemetry signals in transit using specialized logic to refine data.
Telemetry Pipeline Security - Implements security measures for observability pipelines, including credential management via authentication extensions.
Interface-Driven Component Models - Defines strict contracts for data ingestion and export to allow community contributors to build interchangeable connectors.
Plugin-Based Architectures - Utilizes a modular architecture of receivers, processors, and exporters that plug into a central telemetry pipeline.
OTLP Telemetry Routing - Directs observability data through custom processors and filters before exporting to backends.
Cloud Resource Metadata Detection - Automatically detects infrastructure environments to attach standardized resource labels to all telemetry signals.
Cloud Resource Monitoring - Ingests performance metrics and resource attributes from cloud providers to track system health.
Distributed Systems Instrumentation - Gathers operational data from databases, container engines, and distributed nodes to centralize visibility.
Metric Transformation Pipelines - Transforms logs, metrics, and traces through a sequential chain of modular components before final delivery.
Telemetry Processing Engines - Transforms and filters telemetry data in transit using specialized processors to refine output.
Observability Data Collection - Provides a standardized way to ingest telemetry from diverse sources using community-contributed connectors.
Telemetry Data Collection - Ingests observability signals from various external sources using supported receivers to centralize data.
Telemetry Exporters - Implements modules for forwarding processed telemetry data to external storage systems and monitoring platforms.
Telemetry Ingestion - Collects logs, metrics, and traces from diverse cloud providers, databases, and operating systems using standard protocols.
Cloud Storage Exporters - Pushes processed telemetry data to AWS S3 buckets using IAM roles and retry logic.
OTTL Filtering - Drops or keeps telemetry data based on specific language conditions and inferred contexts.
Partition-Based Routing - Distributes telemetry messages across Kafka partitions using trace IDs or custom keys for optimized routing.
Schema Generators - Creates structured configuration schemas for receivers and processors to ensure valid data routing.
Container Metrics Scraping - Collects container metrics via the Docker daemon using persistent streams or secure TLS connections.
Telemetry Processing Languages - Uses a domain-specific language to evaluate conditions for conditionally dropping or keeping telemetry data.
External Secret Resolution - Retrieves sensitive configuration values from external cloud secret managers at runtime.
Identity and Access Management - Secures data transmission and access using authentication schemes like OAuth2, OIDC, and Basic Auth.
OIDC Authentication Plugins - Provides integration for delegating identity verification to external OpenID Connect providers.
Secrets Management - Retrieves sensitive configuration data from external providers such as cloud secret managers or storage buckets.
Telemetry Component Configuration Management - Generates configuration schemas from internal structures and loads settings from remote cloud storage providers.
Telemetry Configuration Schemas - Generates structured configuration validation and metadata from internal Go types to ensure consistent settings.
Google Cloud Monitoring Integrations - Provides specialized connectors to fetch and transform monitoring data from Google Cloud APIs into standardized formats.
Telemetry Translation Validation - Captures outgoing telemetry and validates it against expected results to ensure transformation accuracy.
Collector Health Monitors - Executes health checks and exposes profiling data to track the operational status of the pipeline.
Metric Reaggregation - Dynamically reaggregates metrics for supported receivers including database and caching systems.
Synthetic Data Providers - Generates synthetic telemetry data using pluggable providers to stress test collector instances.
End-to-End Testing - Executes benchmarks and stability tests in controlled environments to verify system-wide performance under load.
Collector Components - Extended collection of community-driven receivers, processors, and exporters.
Instrumentation and SDKs - Community-driven collection of receivers, processors, and exporters for the collector.

Istoric stele

open-telemetryopentelemetry-collector-contrib

Name: open-telemetry/opentelemetry-collector-contrib
Author: open-telemetry

View on GitHub

4,758 stele3,680 fork-uriGoApache-2.09 vizualizăriopentelemetry.io

Opentelemetry Collector Contrib

Proiectul include un framework de asigurare a calității pentru simularea datelor sintetice, testarea performanței end-to-end și verificarea integrității datelor.

Features

Telemetry Routing - Directs observability data through connectors and processors to transform or filter it before backend delivery.
Observability Pipelines - Collects and transforms logs, metrics, and traces from diverse sources into standardized formats.
Telemetry Signal Processors - Filters and enriches telemetry signals in transit using specialized logic to refine data.
Telemetry Pipeline Security - Implements security measures for observability pipelines, including credential management via authentication extensions.
Interface-Driven Component Models - Defines strict contracts for data ingestion and export to allow community contributors to build interchangeable connectors.
Plugin-Based Architectures - Utilizes a modular architecture of receivers, processors, and exporters that plug into a central telemetry pipeline.
OTLP Telemetry Routing - Directs observability data through custom processors and filters before exporting to backends.
Cloud Resource Metadata Detection - Automatically detects infrastructure environments to attach standardized resource labels to all telemetry signals.
Cloud Resource Monitoring - Ingests performance metrics and resource attributes from cloud providers to track system health.
Distributed Systems Instrumentation - Gathers operational data from databases, container engines, and distributed nodes to centralize visibility.
Metric Transformation Pipelines - Transforms logs, metrics, and traces through a sequential chain of modular components before final delivery.
Telemetry Processing Engines - Transforms and filters telemetry data in transit using specialized processors to refine output.
Observability Data Collection - Provides a standardized way to ingest telemetry from diverse sources using community-contributed connectors.
Telemetry Data Collection - Ingests observability signals from various external sources using supported receivers to centralize data.
Telemetry Exporters - Implements modules for forwarding processed telemetry data to external storage systems and monitoring platforms.
Telemetry Ingestion - Collects logs, metrics, and traces from diverse cloud providers, databases, and operating systems using standard protocols.
Cloud Storage Exporters - Pushes processed telemetry data to AWS S3 buckets using IAM roles and retry logic.
OTTL Filtering - Drops or keeps telemetry data based on specific language conditions and inferred contexts.
Partition-Based Routing - Distributes telemetry messages across Kafka partitions using trace IDs or custom keys for optimized routing.
Schema Generators - Creates structured configuration schemas for receivers and processors to ensure valid data routing.
Container Metrics Scraping - Collects container metrics via the Docker daemon using persistent streams or secure TLS connections.
Telemetry Processing Languages - Uses a domain-specific language to evaluate conditions for conditionally dropping or keeping telemetry data.
External Secret Resolution - Retrieves sensitive configuration values from external cloud secret managers at runtime.
Identity and Access Management - Secures data transmission and access using authentication schemes like OAuth2, OIDC, and Basic Auth.
OIDC Authentication Plugins - Provides integration for delegating identity verification to external OpenID Connect providers.
Secrets Management - Retrieves sensitive configuration data from external providers such as cloud secret managers or storage buckets.
Telemetry Component Configuration Management - Generates configuration schemas from internal structures and loads settings from remote cloud storage providers.
Telemetry Configuration Schemas - Generates structured configuration validation and metadata from internal Go types to ensure consistent settings.
Google Cloud Monitoring Integrations - Provides specialized connectors to fetch and transform monitoring data from Google Cloud APIs into standardized formats.
Telemetry Translation Validation - Captures outgoing telemetry and validates it against expected results to ensure transformation accuracy.
Collector Health Monitors - Executes health checks and exposes profiling data to track the operational status of the pipeline.
Metric Reaggregation - Dynamically reaggregates metrics for supported receivers including database and caching systems.
Synthetic Data Providers - Generates synthetic telemetry data using pluggable providers to stress test collector instances.
End-to-End Testing - Executes benchmarks and stability tests in controlled environments to verify system-wide performance under load.
Collector Components - Extended collection of community-driven receivers, processors, and exporters.
Instrumentation and SDKs - Community-driven collection of receivers, processors, and exporters for the collector.

Alternative open-source pentru Opentelemetry Collector Contrib

Proiecte open-source similare, clasificate după numărul de funcționalități comune cu Opentelemetry Collector Contrib.

open-telemetry/opentelemetry-go-contrib
open-telemetry/opentelemetry-go-contrib
1,634Vezi pe GitHub
This project provides a collection of extensions for the OpenTelemetry Go software development kit, serving as a toolkit for automated instrumentation, context propagation, and telemetry pipeline management. It enables the capture of traces, metrics, and logs across distributed systems by providing unified interfaces that decouple data collection from specific backend storage or analysis platforms. The project distinguishes itself through its ability to inject telemetry collection into popular frameworks and libraries without requiring manual source code modifications. It maintains request co
Go
Vezi pe GitHub1,634
vectordotdev/vector
vectordotdev/vector
22,071Vezi pe GitHub
Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network
Rusteventsforwarderhacktoberfest
Vezi pe GitHub22,071
open-telemetry/opentelemetry-collector
open-telemetry/opentelemetry-collector
7,175Vezi pe GitHub
The OpenTelemetry Collector is a vendor-agnostic proxy and observability data pipeline that receives, processes, and exports traces, metrics, and logs. It functions as a telemetry ingestion gateway and multi-backend monitoring agent, translating various data formats into a standardized internal representation for consistent processing. The project distinguishes itself through a plugin-based component model, allowing the integration of custom receivers, processors, and exporters without modifying the core codebase. It utilizes a configurable pipeline system where telemetry flows through a sequ
Go
Vezi pe GitHub7,175
open-telemetry/opentelemetry-go
open-telemetry/opentelemetry-go
6,434Vezi pe GitHub
OpenTelemetry Go is a framework for generating and collecting distributed traces, metrics, and logs from Go applications. It provides a standardized telemetry instrumentation API for adding observability markers to code and a corresponding SDK for processing and emitting these signals. The project utilizes a configurable observability pipeline to sample and export telemetry data to external backends using the OTLP wire protocol. It features a pluggable export system and a separation between the public API and the SDK implementation, allowing telemetry to be routed to third-party platforms wit
Gologgingmetricsopentelemetry
Vezi pe GitHub6,434

Vezi toate cele 30 alternative pentru Opentelemetry Collector Contrib

Întrebări frecvente

Ce face open-telemetry/opentelemetry-collector-contrib?

Care sunt principalele funcționalități ale open-telemetry/opentelemetry-collector-contrib?

Principalele funcționalități ale open-telemetry/opentelemetry-collector-contrib sunt: Telemetry Routing, Observability Pipelines, Telemetry Signal Processors, Telemetry Pipeline Security, Interface-Driven Component Models, Plugin-Based Architectures, OTLP Telemetry Routing, Cloud Resource Metadata Detection.

Care sunt câteva alternative open-source pentru open-telemetry/opentelemetry-collector-contrib?

Alternativele open-source pentru open-telemetry/opentelemetry-collector-contrib includ: open-telemetry/opentelemetry-go-contrib — This project provides a collection of extensions for the OpenTelemetry Go software development kit, serving as a… vectordotdev/vector — Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and… open-telemetry/opentelemetry-collector — The OpenTelemetry Collector is a vendor-agnostic proxy and observability data pipeline that receives, processes, and… open-telemetry/opentelemetry-go — OpenTelemetry Go is a framework for generating and collecting distributed traces, metrics, and logs from Go… codeaprendiz/learn-devops — This project is a comprehensive educational repository designed to teach DevOps practices through structured learning… uptrace/uptrace — Uptrace is an OpenTelemetry-based observability platform designed to collect, store, and analyze distributed traces,…