Awesome GitHub RepositoriesAsynchronous Write Buffering

This project is a comprehensive Java backend engineering guide and technical reference focused on high-concurrency design, distributed systems, and microservices architecture. It provides detailed strategies for decomposing monolithic applications, managing service discovery, and implementing the architectural patterns required for scalable backend environments. The repository distinguishes itself through an extensive collection of big data algorithmic references and database scaling strategies. It covers memory-efficient techniques for analyzing massive datasets, such as Top-K element extrac

Mars is a cross-platform networking SDK and high-performance logging framework. It provides a network reliability layer for managing short and long-lived connections across different operating systems, alongside a diagnostic tool for recording system events to disk with minimal application overhead. The project features a persistent connection manager that maintains bidirectional server links using heartbeats and sequence tracking. It includes a traffic control engine to prevent server request avalanches by limiting the frequency and volume of outgoing requests. To improve connectivity, it ut

Betaflight is open-source flight controller firmware designed to stabilize aircraft and manage sensor data through PID loops and motor control. It serves as a multirotor flight stack that integrates low-level drivers and control algorithms to manage electronic speed controllers, radio receivers, and telemetry hardware. The system focuses on real-time flight stabilization and telemetry routing. It includes a PID stabilization system to calculate motor outputs for aircraft stability and a flight telemetry manager to route real-time information to ground stations and on-screen displays. The fir

RisingWave is a cloud-native streaming database and real-time analytics engine that uses standard SQL to process continuous data streams. It functions as a streaming data lakehouse, combining the capabilities of a streaming SQL database with a platform that integrates streaming ingestion with open table formats. The system is distinguished by its use of the PostgreSQL wire protocol, allowing it to integrate with existing SQL tools and drivers. It employs a decoupled compute and storage architecture, persisting streaming state and materialized views in cloud object storage to enable independen

This is a high-performance C++ HTTP web server designed for delivering static content. It operates as an asynchronous event loop server that combines IO multiplexing with worker thread pools to handle concurrent requests without blocking. The server specializes in TCP connection management, featuring keep-alive sessions, request pipelining, and timer-based timeout tracking for idle sockets. To ensure high throughput, it utilizes double-buffered asynchronous logging and background threads to prevent disk I/O latency from impacting network traffic. The system covers broad capability areas incl

This project is a machine learning experiment tracker and event file generator that enables the recording of scalars, images, and histograms to monitor model performance. It functions as an integration bridge that allows training metrics from PyTorch to be logged into files compatible with the TensorBoard dashboard. The system includes a remote log synchronizer designed to stream experiment data to cloud services. This allows for the remote management and analysis of training results and the comparison of datasets across different training runs. The utility covers a broad range of monitoring

SSHFS is a network filesystem client that maps remote server directories to local mount points. It functions as a userspace implementation of a filesystem, allowing users to access and manage remote files as if they were on a local disk using the SFTP protocol over SSH. The tool distinguishes itself by offering multiple transport options, including encrypted SSH tunnels for security and direct TCP socket connections to bypass encryption for higher throughput. It also supports connectivity via virtual sockets to access directories hosted inside virtual machines. The system includes capabiliti

Consola is a diagnostic logging utility and log output manager that provides a unified interface for Node.js and web browser environments. It functions as a scoped logging framework and a tool for capturing user text, confirmations, and selections through interactive console prompts. The project distinguishes itself through a system for creating specialized logger instances with inherited defaults and unique tags for contextual tracking. It also features a pluggable reporter interface that allows for the redirection of standard output to custom logging destinations and external reporters. Th

Pulse is an Apple platform network logger used for recording and inspecting network traffic and system logs directly within applications. It functions as an on-device network inspector and traffic export tool, allowing for the capture of outgoing requests and the transmission of logs to external systems. The project includes a remote log streamer for the real-time transmission of device logs to an external viewer for live monitoring. It further provides an integrated interface for viewing recorded network requests and system logs on the device without the requirement of an external proxy. Th

xctool est un wrapper en ligne de commande pour xcodebuild conçu pour l'intégration continue iOS et macOS. Il fonctionne comme un exécuteur de tests parallèle, un processeur de journaux de construction et un générateur de rapports pour automatiser le pipeline de construction et de test pour les plateformes Apple. L'outil distribue les bundles de test sur plusieurs cœurs CPU pour réduire le temps d'exécution et offre la possibilité d'exécuter des sous-ensembles ciblés de tests en filtrant pour des schémas, classes ou méthodes spécifiques. Il simplifie la gestion de la construction en permettant aux arguments de ligne de commande d'être persistés et chargés à partir de fichiers de configuration JSON. Il transforme les journaux de construction verbeux en flux d'événements JSON structurés, qui peuvent être convertis en JUnit XML pour la compatibilité avec des outils de reporting externes. Pour améliorer l'observabilité, il utilise un tampon de suppression de journal qui masque la sortie jusqu'à ce qu'une erreur soit détectée, fournissant un texte de console lisible par l'homme et coloré.

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Logan is a cross-platform mobile logging framework that collects, stores, and uploads client-side logs from iOS, Android, Web, and Flutter environments for centralized debugging and analysis. It provides a complete pipeline from client-side log buffering and file-based local storage through to server-side ingestion and a visual browser for inspecting parsed logs. The system uses a structured binary protocol to encode log entries with content, type, timestamp, and thread metadata, enabling consistent parsing across platforms. A log receiving server handles uploaded files, while a web-based int

Fleet is an open-source device management platform that provides centralized control over computing devices running macOS, Linux, Windows, Chromebooks, iOS, and Android. It enables organizations to enroll devices, collect real-time telemetry, enforce security compliance policies, and manage software remotely from a single system. The platform can be deployed as a single binary, run locally for testing, or scaled horizontally across cloud infrastructure on AWS, Kubernetes, GCP, or Render, with support for high availability through database replication and load balancing. The platform distingui

EasyLogger est une bibliothèque de journalisation C/C++ légère et un framework asynchrone conçu pour les systèmes embarqués, les appareils IoT et les objets connectés. Il fonctionne comme un logger efficace en ressources et un gestionnaire de mémoire flash, fournissant des outils pour le débogage bas niveau et l'enregistrement d'événements système avec des besoins minimaux en ROM et RAM. Le projet se distingue par un modèle de journalisation asynchrone qui met en mémoire tampon les messages dans un thread séparé, empêchant les opérations de journalisation de bloquer l'exécution de l'application en temps réel. Il inclut un gestionnaire de mémoire flash spécialisé qui utilise une mémoire tampon circulaire pour conserver les journaux dans un stockage non volatil, garantissant que les données critiques sont préservées lors des redémarrages de l'appareil. La bibliothèque couvre un large éventail de capacités d'observabilité, notamment les assertions système pour la validation d'état, le filtrage de sévérité à la compilation et à l'exécution, et la génération de dumps hexadécimaux binaires bruts. Elle prend en charge l'enrichissement des métadonnées avec des horodatages et des identifiants de thread, ainsi qu'une interface portable pour acheminer les journaux vers des destinations personnalisées telles que des ports série ou des fichiers. Le système garantit l'intégrité des données grâce à la synchronisation des écritures et fournit des mécanismes pour le vidage manuel des tampons et la récupération des journaux stockés.