gliderlabs/logspout
Logspout
Logspout es un agregador, reenviador y motor de enrutamiento de logs para contenedores, diseñado para recopilar registros de contenedores Docker y enviarlos a sistemas de registro centralizados externos. Funciona como una utilidad basada en red que redirige la salida de los contenedores a destinos remotos como syslog o endpoints TCP.
El sistema cuenta con un motor de enrutamiento dinámico que permite crear y actualizar configuraciones de enrutamiento de logs y filtros de destino en tiempo real a través de una interfaz HTTP, sin necesidad de reiniciar el servicio. Utiliza una arquitectura basada en adaptadores, lo que permite el desarrollo de módulos de salida personalizados y la creación de imágenes de contenedor adaptadas para soportar destinos propietarios.
La plataforma ofrece capacidades de filtrado de fuentes de logs basadas en nombres, IDs o etiquetas de contenedores, y admite el enrutamiento a múltiples destinos. Incluye utilidades de procesamiento de logs para la agregación multilínea y el formateo basado en plantillas para transformar la salida cruda en JSON estructurado o texto. La transmisión de datos está asegurada mediante cifrado TLS en la capa de transporte, con soporte para autenticación mutua y autoridades de certificación personalizadas.
La observabilidad adicional se proporciona mediante la transmisión de logs en tiempo real a través de WebSockets y codificación HTTP fragmentada, junto con la detección de tiempos de espera de flujo para evitar la pérdida de datos.
Features
- Docker Log Management - Collects logs from Docker containers and forwards them to remote destinations for centralized analysis.
- Log Routing - Directs container standard output and error streams to external destinations using filters based on container names, IDs, and labels.
- Log Aggregators - Streams container logs to remote syslog or TCP endpoints for centralized aggregation.
- Multi-Destination Log Routers - Routes log streams from Docker containers to multiple remote destinations like syslog or TCP.
- Docker Engine API Clients - Consumes real-time log streams directly from the Docker engine using its native API.
- Docker Log Forwarders - Functions as a network-based utility piping Docker container output to external servers.
- Pluggable Output Adapters - Implements an adapter-based architecture to decouple log collection from delivery to various remote protocols.
- Multi-Destination Log Routings - Exports container logs to diverse external endpoints including syslog, TCP, UDP, and TLS transports.
- Destination-Based Log Routing - Filters container logs by ID, name, or labels to forward matching data to specific network adapters and addresses.
- Distributed Log Aggregation - Gathers distributed logs from multiple containers and routes them to a centralized logging system.
- Log Routing Engines - Directs container logs to different destinations in real time using an HTTP interface and metadata filters.
- Dynamic Stream Routing - Filters and routes container log streams to different destinations in real time via an HTTP API.
- Dynamic Configuration Updates - Enables real-time updates of log routing rules and filters via a REST interface.
- Runtime Configurations - Allows updating forwarding destinations and source filters while the service is active.
- Dynamic Route Management - Provides an HTTP interface to modify log routing rules at runtime without requiring a service restart.
- Mutual TLS Transports - Secures log transmission using mutual TLS authentication and custom certificate authority validation.
- Log Transmission Security - Encrypts the transmission of container logs to remote servers using TLS and mutual authentication.
- Custom Log Formatting - Transforms raw container output into structured formats like JSON for compatibility with monitoring tools.
- Container Source Filters - Allows excluding or including specific containers in the log stream by matching names, environment variables, or metadata labels.
- Custom Log Destinations - Allows developers to create custom output modules for routing logs to proprietary destinations.
- Log Output Formatting - Transforms log messages into custom text or JSON formats using templates and metadata.
- Multiline Log Grouping - Aggregates multiple log lines into single records to maintain the structure of stacked traces and formatted blocks.
- Log Streaming - Provides real-time log streaming via WebSockets, JSON, or chunked HTTP encoding for debugging and subscriptions.
- Log Output Templates - Transforms raw container output into structured JSON or text using metadata templates.
- Monitoring and Logging - Log routing and aggregation for containerized environments.
