For a log shipping agent for containers, the first results are elastic/beats, fluent/fluent-bit and fluent/fluentd. apache/hertzbeat and tstack/lnav round out the shortlist. Compare the match explanations and check the project documentation against your requirements.
Collect, forward, and centralize distributed container logs into scalable storage and analysis backends.
Beats is a collection of lightweight, modular agents designed to gather, process, and forward operational telemetry from distributed infrastructure to centralized storage and analysis platforms. These agents function as a distributed data transport layer, decoupling the collection of logs, metrics, and network events from their final delivery destination. By maintaining local state and managing data flow, the system ensures reliable transmission of information across heterogeneous environments. The project distinguishes itself through a modular pipeline architecture that allows for the assemb
Beats is a collection of lightweight agents, notably Filebeat, that natively collect, parse, and forward logs from containerized environments (including Kubernetes) to multiple output backends with structured parsing, buffering, and metadata enrichment — exactly matching the intent for a container log shipper.
Fluent Bit is a cloud-native log shipper and unified telemetry collector designed as a resource-efficient data pipeline. It ingests logs, metrics, and traces from multiple sources, processing them in real-time before routing the data to external storage backends. The project functions as a real-time stream processor and OpenTelemetry log processor, capable of transforming and filtering data using SQL and conditional logic. It also acts as a distributed tracing agent that can sample traces to reduce data volume while preserving full request paths. The system provides reliable data delivery th
Fluent Bit is a lightweight, cloud-native log shipper that collects, parses (JSON, regex), and forwards logs from containers to multiple backends, with built-in Kubernetes metadata enrichment and disk-buffered retries — exactly the kind of resource-efficient aggregator for containerized environments you're looking for.
Fluentd is a unified logging layer and distributed event router that collects, parses, and routes log data from diverse sources to various storage backends. It functions as a log forwarding agent and pipeline orchestrator, transforming raw unstructured log strings into formatted objects using structured log parsing. The project utilizes a plugin-based pipeline architecture to route data through independent input, filter, and output stages. It differentiates itself through tag-based event routing, which uses regular expression patterns to direct specific data streams to their intended destinat
Fluentd is a unified log collector and router that can aggregate logs from containerized environments via plugins, supports multiple output backends, structured parsing, and buffering, but it is heavier than container-optimized alternatives like Fluent Bit, which may not fully satisfy the lightweight requirement.
HertzBeat is an agentless monitoring platform designed to collect performance metrics from network devices, databases, and servers without requiring client software. It functions as an infrastructure monitoring dashboard, an alert management system, and a centralized log aggregator using the OpenTelemetry Protocol. The system utilizes a cloud-edge collection hierarchy to scale data gathering across clusters and isolated networks. It distinguishes itself with a flexible extensibility model, allowing users to define new monitoring workflows through configuration-based metric templates and custo
HertzBeat is a monitoring platform that also functions as a centralized log aggregator via OpenTelemetry, making it a valid choice for collecting and forwarding logs from containerized environments, though its primary identity as a metric monitor and the lack of explicit Kubernetes metadata enrichment or lightweight profile mean it is not the most specialized container log shipper.
lnav is a terminal-based log viewer and analyzer designed for aggregating, filtering, and analyzing multiple log files in a single chronological view. It functions as a console application that can replace the system pager, providing syntax highlighting and document navigation for system or application logs. The project distinguishes itself by mapping unstructured log data to virtual SQLite tables, enabling the use of SQL and PRQL for structured data analysis, aggregations, and relational queries. It further differentiates its capability set through native integration for retrieving and taili
Lnav is a terminal-based log viewer and analyzer for interactive local inspection, not a log shipper that collects and forwards container logs to a centralized backend.
HyperDX is an OpenTelemetry observability platform that provides centralized log management, distributed tracing, and a self-hosted monitoring stack. It functions as a unified system for collecting, indexing, and visualizing logs, metrics, and traces from cloud and container environments. The platform distinguishes itself with specialized tooling for large language model monitoring and session replay, allowing user interactions in the browser to be linked to backend telemetry. It employs schema-less JSON parsing to index structured logs dynamically and uses source maps to resolve minified sta
HyperDX is an OpenTelemetry observability platform with its own log storage and visualization, not a lightweight shipper that forwards logs to an external backend — it is the backend itself, so it doesn't match the "shipper" identity this search demands.
hl is a set of command-line interface tools for filtering, aggregating, streaming, and visualizing structured log data across multiple sources. It functions as a log filter, file aggregator, real-time streamer, and structured log viewer. The project specializes in transforming JSON and logfmt data into human-readable formats for visual analysis. It enables the merging of multiple log files and compressed archives into a single chronologically sorted stream, while supporting live tracking of multiple sources into a unified real-time view. Capabilities include field-based filtering via key-val
hl is a CLI tool for filtering, merging, and viewing structured logs locally rather than a log shipper that forwards logs from containers to a centralized backend, so it lacks container runtime support, Kubernetes metadata enrichment, and output backends for forwarding.
SwiftyBeaver is an extensible logging framework for Swift that routes log output to multiple destinations simultaneously, including the Xcode console, local files, and remote cloud services. It supports recording messages at distinct severity levels with corresponding visual styling, and can attach arbitrary contextual data such as numbers, arrays, or dictionaries to log entries without requiring manual string conversion. The framework distinguishes itself through destination-based log routing, where each output target can have its own independent format and filter configuration managed by a
SwiftyBeaver is a Swift logging framework for app-level logging to multiple destinations, not a container log shipper that collects and forwards logs from Docker or Kubernetes environments to a centralized backend.
Ajenti is a Linux server management panel that provides a centralized web-based dashboard for administering system configurations, services, and hardware resources. It functions as a system monitor and a remote administration tool for managing server infrastructure through a browser. The project includes a web-based terminal emulator for executing shell commands and a file manager for browsing and organizing the server filesystem. It also features a dedicated manager for deploying and controlling the lifecycle of Docker containers. The platform covers a broad range of administrative capabili
Ajenti is a server management panel with Docker log management features, not a dedicated log shipper/aggregator that actively collects and forwards container logs to a centralized backend.
This is a logging framework for Node.js based on the log4j architecture. It provides a system for managing hierarchical loggers and severity thresholds, allowing application events to be recorded and categorized across different levels of importance. The framework is distinguished by its cluster-aware logging, which synchronizes and coordinates output across multiple process clusters into a unified stream. It also includes a dedicated log file rotation manager that automatically rolls files by date or size to prevent disk space exhaustion, and a network log transporter for sending data to rem
log4js-node is a logging framework for Node.js applications, not a dedicated container log shipper—it lacks container runtime support, Kubernetes metadata enrichment, and is meant for in-app use rather than collecting logs from containerized environments.
Dozzle is a web-based dashboard designed for the real-time monitoring and management of Docker container environments. It provides a centralized interface to stream live logs, track resource utilization, and perform administrative tasks across multiple host environments. The platform distinguishes itself by offering an interactive terminal emulator that allows users to execute commands directly within running containers from a browser. It also includes built-in alerting capabilities, enabling users to monitor log streams for specific patterns and receive automated notifications when critical
Dozzle is a real-time Docker log dashboard and container management UI, not a log shipper that forwards logs to an external storage backend — it aggregates logs for live viewing rather than forwarding them to centralized analysis tools.
Consola is a diagnostic logging utility and log output manager that provides a unified interface for Node.js and web browser environments. It functions as a scoped logging framework and a tool for capturing user text, confirmations, and selections through interactive console prompts. The project distinguishes itself through a system for creating specialized logger instances with inherited defaults and unique tags for contextual tracking. It also features a pluggable reporter interface that allows for the redirection of standard output to custom logging destinations and external reporters. Th
Consola is a diagnostic logging library for Node.js and browser applications, not a container log shipper — it lacks the ability to collect logs from containerized environments and forward them to centralized backends.
| Repository | Stars | Language | License | Last push |
|---|---|---|---|---|
| elastic/beats | 12.6K | Go | NOASSERTION | |
| fluent/fluent-bit | 7.9K | C | Apache-2.0 | |
| fluent/fluentd |
| 13.6K |
| Ruby |
| Apache-2.0 |
| apache/hertzbeat | 7.1K | Java | apache-2.0 |
| tstack/lnav | 9.6K | C++ | bsd-2-clause |
| hyperdxio/hyperdx | 9.3K | TypeScript | mit |
| pamburus/hl | 2.9K | Rust | mit |
| swiftybeaver/swiftybeaver | 6.1K | Swift | MIT |
| ajenti/ajenti | 7.9K | Python | MIT |
| log4js-node/log4js-node | 5.8K | JavaScript | NOASSERTION |