Awesome GitHub RepositoriesHigh-Throughput Decompression

Zstandard is a lossless data compression library and archive format designed for high compression ratios and fast real-time processing. It functions as a real-time data compressor and multi-threaded compression engine capable of distributing workloads across multiple CPU cores to increase throughput. The system features a dictionary-based compressor that trains on sample data to improve the compression ratio and speed of small files. It also provides long distance pattern matching to identify repeated sequences across large files. The library covers a broad range of capabilities including st

This project provides a lossless compression algorithm and a byte-oriented compression library designed for high-speed data reduction and maximum decompression speed. It functions as a stream-oriented compression engine, a software library for encoding and decoding data blocks, and a command-line tool for managing interoperable compressed frames. The system distinguishes itself through the use of predefined pattern dictionaries to improve compression ratios for small data sets and small packets. It supports multiple processing modes, including high-speed block compression for minimal latency

Thumbor is a dynamic image processing service and proxy server that resizes, crops, and filters images on demand via URL parameters. It functions as a URL-based image manipulator that generates specific image versions from source assets to optimize web delivery. The system includes a smart cropping engine that uses facial feature detection and computer vision to automatically center thumbnails on the most relevant visual content. To prevent unauthorized parameter tampering and malicious requests, it employs signature-based request validation and domain-based source whitelisting. Broad capabi

Ristretto is a high-performance in-memory cache and concurrent key-value store for Go applications. It provides a thread-safe memory store that manages strict memory bounds and employs probabilistic set filters to reduce lookup overhead. The system is distinguished by an admission-policy cache that utilizes frequency sketches and cost-based eviction to maximize hit ratios. It minimizes contention and improves throughput through the use of striped ring buffers and concurrent map sharding. The project covers a broad range of data management capabilities, including time-based expiration, item f

Snappy is a high-performance lossless compression library implemented in C++. It provides data reduction methods that perfectly restore original information, focusing on system-level efficiency and processing velocity across different platforms. The library prioritizes high-speed data compression and decompression over achieving the maximum possible compression ratio. It is designed for real-time stream compression to reduce bandwidth usage without introducing significant processing latency. The implementation covers high-velocity data shrinking and rapid restoration. It includes resilient d

DiskLruCache is a disk-backed key-value cache library for Android and Java environments that stores data on the filesystem within a configurable byte limit. It uses a least-recently-used (LRU) eviction policy to automatically remove old entries when the cache exceeds its allocated size, and maintains a journal file to reconstruct its in-memory state after a process restart. The cache provides atomic write operations that first write new data to a temporary file before atomically renaming it, preventing partial or corrupted reads during concurrent access. It returns frozen snapshots of cache e

Mozjpeg is a high-performance C library for encoding, decoding, and transcoding JPEG images. It serves as a binary-compatible, drop-in replacement for standard JPEG libraries, maintaining existing function signatures to improve compression efficiency without requiring changes to application logic. The library functions as an image optimizer that reduces file sizes through lossless progressive encoding and coefficient optimization. It utilizes trellis-based quantization and SIMD-accelerated processing to optimize the trade-off between visual quality and file size. Its broader capabilities inc

webfunny_monitor is an open-source frontend monitoring and analytics platform that tracks page load performance, JavaScript errors, and user behavior. It serves as a comprehensive tool for measuring page load speed, API response times, client-side errors, and custom user events, with real-time dashboards that stream aggregated metrics via WebSocket for sub-second updates. The project distinguishes itself through its architectural approach: events are collected asynchronously via lightweight HTTP beacons and batched before transmission, while a memory-bounded local storage buffer ensures relia

Aceasta este o bibliotecă de cache în memorie thread-safe pentru Go, care elimină automat elementele cel puțin recent utilizate (LRU) atunci când capacitatea este atinsă. Oferă un cache de memorie de dimensiune fixă conceput pentru a menține o amprentă de memorie constantă prin eliminarea celor mai vechi intrări pe măsură ce sosesc date noi. Sistemul include un manager de evacuare care execută callback-uri personalizate atunci când intrările sunt eliminate pentru a facilita curățarea resurselor. De asemenea, suportă expirarea bazată pe timp, permițând eliminarea automată a elementelor după o durată de viață specificată (TTL). Biblioteca acoperă capabilități generale de caching, inclusiv inspecția cache-ului pentru verificarea existenței cheilor, curățarea completă a cache-ului și strategii pentru optimizarea ratelor de hit prin prevenirea deplasării datelor frecvent accesate de către noile rafale de date. Toate operațiunile de citire și scriere sunt sincronizate pentru a permite accesul concurent în mai multe rutine.