Projects sharing features with Logstash

VictoriaMetrics is a high-performance, scalable time series database and observability platform designed for long-term storage and analysis of metric, log, and trace data. It functions as a unified backend for monitoring ecosystems, offering full compatibility with industry-standard protocols and query languages. The system is built to handle massive data volumes through a distributed architecture that supports horizontal scaling and efficient data lifecycle management. The platform distinguishes itself through a storage engine that utilizes consistent hashing for data sharding and log-struct

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Loki is a horizontally scalable, highly available log aggregation engine designed to store and query massive volumes of unstructured log data. It functions as a distributed observability platform that correlates logs, metrics, and traces to provide comprehensive visibility into the health and performance of complex infrastructure. The system distinguishes itself through a distributed query execution model that processes large datasets in parallel across cluster nodes. It utilizes label-based stream indexing and a distributed index to map log data to specific chunks, enabling rapid retrieval w

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Kibana is a browser-based data exploration and visualization platform designed for interacting with information stored in distributed search engines. It serves as a centralized interface for analyzing structured and unstructured data, enabling users to build custom dashboards, generate interactive charts, and map complex datasets to uncover trends and actionable insights. Beyond visualization, the platform functions as a comprehensive management console for infrastructure operations. It provides tools for configuring security policies, managing data indices, and monitoring system health. The

This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha

dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d

Salt is an infrastructure configuration management tool and orchestration framework designed for large-scale system administration. It functions as a remote execution engine that enables administrators to manage, provision, and enforce declarative states across distributed fleets of servers from a central control point. By utilizing a high-performance message bus, the platform allows for the simultaneous execution of administrative tasks and the maintenance of consistent software configurations across thousands of nodes. The system distinguishes itself through a flexible architecture that sup

Cake is a cross-platform build automation system and scripting framework that allows users to define software build pipelines using C# scripts. It functions as a CI/CD pipeline orchestrator and build runner, providing a strongly-typed domain-specific language to simplify the orchestration of compilation, testing, and packaging processes across Windows, Linux, and macOS. The system ensures reproducible build environments by pinning the versions of build tools, modules, and dependencies. It distinguishes itself by enabling a C# scripting workflow with full IDE support, including autocomplete, s

Buildbot is a Python-based continuous integration framework and distributed build orchestrator. It functions as a build automation engine that coordinates the retrieval of source code, the execution of build steps, and the reporting of results through a central controller and a network of remote worker agents. The system is distinguished by a plugin-based extensibility architecture and a master-worker distribution model. It allows for dynamic build modification at runtime and supports a pluggable database backend for persisting system state and historical build data. The project covers a bro

dlt is a Python data ingestion tool and ETL pipeline framework designed to fetch data from diverse sources and persist it into structured destinations. It functions as a schema inference engine that automatically detects data types and flattens nested JSON structures into relational tables, moving data from sources to lakehouses, warehouses, or vector databases. The project distinguishes itself through AI-powered pipeline generation, using large language models to scaffold extraction code and connectors for REST APIs. It also supports multimodal vector storage and specialized population of ve

Echo is a mobile music player designed for playing local audio files on mobile devices through a dedicated user interface. It functions as a local media indexer that scans and catalogs offline music files from device storage to build a searchable library. The application uses a plugin-based architecture to extend functionality without modifying the core code. This system allows for dynamic plugin loading and runtime module injection from installed packages to add capabilities such as lyrics and music tracking. The project incorporates a dynamic asset resolver to map external plugin resources

This project is a self-hosted question and answer platform and knowledge management system. It provides a centralized repository for documented answers and community discussions used to support users and resolve technical issues. The system functions as a plugin-based community forum, utilizing a modular extension system to add custom features and tools. It employs a decoupled architecture with a RESTful API backend to separate business logic from the user interface. The platform covers several domain areas including internal knowledge management, customer help centers, and community Q&A hos

Hearthstone Deck Tracker is a gaming companion application and collection manager for Windows. It serves as a game utility for tracking real-time gameplay data, managing card collections, and analyzing deck performance through match history and win rates. The application features a plugin-based architecture that allows for the addition of third-party logic to introduce custom tracking behaviors and automation triggers. For broadcasters, it provides a chroma-key compatible streaming overlay to display real-time game data on live video feeds. Its capabilities include importing deck lists from

nopCommerce is an open-source ASP.NET Core eCommerce platform and shopping cart designed to manage digital product catalogs, orders, and customer transactions. It provides a complete commerce environment consisting of a customer storefront and a backend administration portal. The system functions as a multi-tenant storefront engine capable of distributing workloads across multiple servers and cloud-native hosting environments. Its architecture is based on a plugin-based framework, allowing for the addition of custom plugins and themes to implement specialized business capabilities and visual

Xboard is a containerized service orchestrator and management platform. It provides a Docker-based administrative dashboard for monitoring and controlling backend system services and configurations through a unified interface for operators and users. The platform utilizes a modular architecture and a dedicated plugin system, allowing for the registration of custom logic and the extension of core administrative functionality. It includes utilities for legacy data migration to transfer records and configurations from previous versions or alternative implementations into the current system sche

Clappr is an HTML5 web media player and plugin-based framework used to render video and audio across different web platforms. It functions as a playback engine supporting adaptive bitrate streaming through HLS and DASH protocols to ensure smooth media delivery. The project is distinguished by a modular architecture that allows developers to extend player functionality and add support for new media formats via a plugin system. It also includes a dedicated controller for managing digital rights management license requests to secure premium content. The player covers a broad range of capabiliti

This project is a self-hosted cloud storage server and content collaboration platform implemented as a PHP web application framework. It functions as a centralized server for storing, synchronizing, and sharing files and data across multiple devices. The system operates as a WebDAV file server and a synchronization server for scheduling and contact information using CalDAV and CardDAV protocols. It features a plugin architecture that allows the server to be extended with additional applications and custom features. The platform provides capabilities for user and group access management, exte

DataX is a distributed data integration framework and plugin-based ETL tool designed for synchronizing large datasets between heterogeneous sources and destinations. It functions as a JDBC data migration engine and offline synchronization tool, enabling the movement of data between relational databases, NoSQL stores, and object storage. The system utilizes a plugin-based connector architecture that decouples reader and writer logic, allowing it to map and transform data types across different storage engines using a standardized internal representation. This design supports heterogeneous data

The OpenTelemetry Collector is a vendor-agnostic proxy and observability data pipeline that receives, processes, and exports traces, metrics, and logs. It functions as a telemetry ingestion gateway and multi-backend monitoring agent, translating various data formats into a standardized internal representation for consistent processing. The project distinguishes itself through a plugin-based component model, allowing the integration of custom receivers, processors, and exporters without modifying the core codebase. It utilizes a configurable pipeline system where telemetry flows through a sequ

Joyagent-jdgenie is an automated data orchestrator designed to centralize the retrieval and processing of information from disparate remote sources. It functions as a framework for building repeatable data pipelines that fetch, clean, and normalize raw input into consistent, structured formats. The system utilizes a schema-driven engine to apply validation rules and structural templates to incoming data, ensuring compatibility across enterprise systems. By employing configuration-based workflow definitions, it allows for the orchestration of modular tasks into automated execution flows, separ

Fluvio is a distributed event streaming platform and cloud-native streaming engine designed for collecting, persisting, and replicating real-time data streams across a distributed cluster. It functions as a real-time data pipeline for building stateful workflows that ingest, enrich, and export data between external sources and sinks. The platform is distinguished by its use of WebAssembly to execute compiled modules for in-line data transformations and filtering. This allows for the execution of custom business logic to reshape information in motion without requiring a restart of the cluster.

Starboard Notebook is a web-based environment designed for literate programming and interactive code execution. It functions as an in-browser notebook system that allows users to combine formatted text with executable code blocks, enabling the creation of dynamic documents and data visualizations without requiring a backend server. The platform is built as an embeddable runtime, allowing developers to integrate interactive, cell-based documentation directly into existing web pages. It distinguishes itself through a modular architecture that supports custom plugin development, enabling the reg

This project serves as a comprehensive technical reference for the architecture and design of data-intensive applications. It provides a structured analysis of the fundamental principles required to build reliable, scalable, and maintainable software systems, covering the core trade-offs inherent in modern data infrastructure. The repository explores the mechanics of distributed data management, including strategies for replication, partitioning, and achieving consensus across multiple nodes. It details the design of storage engines, indexing techniques, and transaction management models, whi

Graylog2-server is an open-source centralized log management system and aggregator. It functions as a log analysis platform designed to collect, index, and analyze log data from multiple sources within a centralized searchable index. The system provides capabilities for enterprise log aggregation and infrastructure monitoring. It enables the gathering of logs from various servers and applications to facilitate log data analysis and root cause troubleshooting across a network. The platform utilizes a distributed indexing pipeline and message-queue based ingestion to handle log streams. It inc

Vencord is a modification framework designed for the desktop and web versions of Discord. It functions as a client-side utility that enables users to extend the platform's native capabilities and modify its visual interface through the injection of custom scripts and stylesheets. The project utilizes a modular architecture that allows for the loading of isolated plugins, which hook into internal application events to introduce new tools and features. By intercepting internal message streams and function calls, the framework enables granular control over the application's behavior, while its s

ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through ad