Awesome GitHub RepositoriesDisk-Based Offloading Systems

Presto is a distributed SQL query engine designed for high-performance analytical processing across heterogeneous data sources. It functions as a data federation platform and massively parallel processing engine, allowing users to execute interactive queries against diverse storage systems without requiring data migration. By mapping remote metadata and structures to a unified relational namespace, it enables seamless cross-platform analysis through a standard SQL interface. The engine distinguishes itself through a pluggable connector architecture and a shared-nothing distributed processing

Mergekit is a toolkit for combining multiple pretrained large language models into a single model. It functions as an architecture assembler and merging system that transfers capabilities between models using weighted algorithms and layer-wise assembly without requiring additional training. The project provides specialized utilities for extracting low-rank approximations from fine-tuned models to create portable parameter updates. It also includes a framework for converting dense language models into a mixture of experts architecture by constructing gating mechanisms to route inputs to specia

pytorch-fid is a PyTorch-based evaluator and image distribution analysis library used to calculate the Fréchet Inception Distance. It functions as a benchmarking tool that maps image pixels to high-dimensional feature vectors using a pre-trained convolutional neural network to measure the mathematical divergence between real and synthetic datasets. The library quantifies the quality and diversity of generative models by representing image feature sets as mean and covariance matrices. It allows for the extraction of latent representations from specific neural network layers, with configurable