Awesome GitHub RepositoriesStorage Space Optimization

LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters

Sled is an embedded key-value store and ACID-compliant database designed for high-performance data persistence. It functions as a log-structured storage engine that organizes data using B+ trees to support efficient range queries and prefix scans. The engine implements a zero-copy data store model, utilizing epoch-based reclamation to provide direct references to cached values without memory allocations. It distinguishes itself through a combination of write-ahead logging, page cache optimizations to reduce write amplification on flash storage, and serializable transactions for atomic multi-k

This project is a pure Go implementation of the Git version control system, providing a library for integrating versioning and history analysis into applications. It functions as a complete repository manager and object store that does not require external binary dependencies. The implementation utilizes interface-based storage, allowing repositories to be managed on disk or entirely in memory. It supports a transactional storage model to ensure atomic operations and implements a content-addressable storage system using delta-compression packfiles. The library covers a broad range of version

fio is a storage performance benchmarking tool and synthetic I/O workload generator. It functions as a storage device profiler and I/O trace replay engine, enabling the measurement of throughput and latency for storage devices and file systems. The project is distinguished by its ability to act as a distributed storage stress tester, managing multiple remote server backends via a single controller to evaluate network storage. It also includes specialized capabilities for storage deduplication analysis by generating redundant data buffers to test the efficiency of deduplication subsystems. Th

Cuberite هو خادم ألعاب متعدد اللاعبين عالي الأداء لعملاء Java Edition، مصمم لتوفير بيئة منخفضة استهلاك الذاكرة وCPU لاستضافة مساحات افتراضية مشتركة. تم بناء الخادم للنشر عبر المنصات المختلفة وأنواع العتاد. يسمح بتوسيع ميكانيكا اللعبة ومنطق الخادم من خلال واجهة برمجة نصية بـ Lua، مما يتيح تغيير الوظائف دون إعادة تجميع المحرك الأساسي. يتضمن المشروع أدوات لإدارة الخادم عبر وحدة تحكم عن بعد وإدارة بيانات العالم لتحليل الإحصائيات وتحسين تخزين ملفات الحفظ. تغطي القدرات الإضافية تصور توليد المناطق الحيوية (biomes) وتحليل تفريغات الذاكرة لمراقبة الموارد.

Nominatim is a self-hosted geospatial search engine and geocoding server that utilizes OpenStreetMap data. It provides a complete infrastructure for forward geocoding, converting addresses or place names into geographic coordinates, and reverse geocoding, translating coordinates into human-readable physical addresses. The project features a dedicated data importer that parses raw map data into a PostgreSQL geospatial database. It distinguishes itself through a configurable import pipeline that uses style files to filter map features and an importance-based ranking system to prioritize search