Awesome GitHub RepositoriesServing & Runtime

Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference. The library features extensive support for model optimization and

llama.cpp is a high-performance C++ inference engine and runtime for executing large language models locally across various hardware architectures. It provides the core components for local model execution, including a dedicated model quantizer for compressing weights into the GGUF format and a system for generating text embeddings for semantic search. The project distinguishes itself through specialized memory and execution optimizations, such as block-wise weight quantization to reduce memory footprints and memory-mapped model loading. It supports structured text generation by using formal

Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU architectures. The project distinguishes itself by offering a lightweight HTTP server that adheres to standard API specifications, enabling chat completion, embeddings, and reranking services. It includes a suite of tools for model quantization and conversion, which reduces memory us

This repository serves as a comprehensive collection of resources, templates, and starter code for building artificial intelligence applications. It provides a centralized hub for developers to access practical implementations of common workflows, including retrieval-augmented generation pipelines and autonomous agent loops, alongside educational materials designed to support rapid prototyping and experimentation. The project distinguishes itself by offering a dual focus on technical implementation and critical analysis. It provides a library of lightweight, single-file agents and tutorials f

Autoresearch is an autonomous machine learning research agent and architecture search framework. It employs a closed-loop system to programmatically rewrite training and architecture source code to discover optimal language model configurations. The system iteratively modifies code and evaluates performance metrics to improve model quality based on a target objective. It optimizes model performance and training efficiency by tracking validation bits per byte, which allows for a fair comparison of architectural changes independently of vocabulary size. The framework manages the full training

This project is a community-driven knowledge base and curated repository focused on natural language processing and large language model development. It serves as a centralized index for high-quality tools, libraries, and research materials, organizing technical resources into structured, version-controlled documentation to assist developers in navigating the evolving artificial intelligence ecosystem. The repository distinguishes itself by acting as an aggregator for AI model evaluation and benchmarking. It provides access to tools that enable the simultaneous comparison of multiple conversa

Odysseus is a self-hosted AI workspace and autonomous agent framework designed for deploying and managing large language models. It serves as a centralized platform for orchestrating agentic tasks, utilizing a model context protocol server to connect AI models to external system utilities, browser automation, and local hardware. The system distinguishes itself through a combination of retrieval-augmented generation and a RAG knowledge base, using vector stores and local embeddings to provide persistent semantic memory. It further integrates AI-driven communication management to triage email i

Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade hardware. The platform distinguishes itself through hand-optimized kernels and automated computational graph techniques that maximize hardware throughput. It supports advanced training methodologies, including reinforcement learning for reasoning and efficient adapter-based fin

Keras is a high-level deep learning framework designed for constructing and training neural networks through the composition of modular, functional layers. It serves as a comprehensive modeling toolkit that provides standardized procedures for defining, evaluating, and deploying complex architectures. By utilizing a directed acyclic graph approach, the framework allows users to build intricate models with multiple inputs, outputs, and shared layers, ensuring consistent numerical execution through functional state management. The project distinguishes itself as a multi-backend machine learning

YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks. What distinguishes this project is its focus on production-ready deployment and model ef

Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process

DeepSpeed is a distributed deep learning optimization library and framework designed for the training and inference of massive AI models. It serves as a model parallelism orchestrator and a toolkit for scaling large language models across multiple GPUs and compute nodes. The project distinguishes itself through 3D parallelism orchestration, which combines data, pipeline, and tensor parallelism. It utilizes ZeRO-based memory partitioning to eliminate redundant storage and employs CPU-offload memory management to move weights and optimizer states to system RAM. Additionally, it provides special

PyTorch Lightning is a high-level deep learning framework for PyTorch that automates training loops and removes repetitive engineering boilerplate. It functions as a structured pipeline for managing machine learning experiments, providing a distributed training orchestrator and tools for mixed-precision training. The framework decouples scientific model architecture from the engineering required for infrastructure and scaling. This separation allows the same model code to execute across CPUs, GPUs, or TPUs through a hardware-agnostic execution engine and a centralized trainer that manages the

Llama 3 is a collection of pretrained, autoregressive transformer-based models designed for natural language generation, reasoning, and complex instruction following. It functions as a generative AI framework that provides the infrastructure for managing model weights, executing neural network inference, and handling computational workloads across diverse knowledge domains. The project distinguishes itself through an integrated AI safety toolkit that employs secondary classification filtering to inspect inputs and outputs, ensuring adherence to usage compliance and safety standards. It suppor

Sglang is a high-performance inference engine and serving system designed for large language and multimodal models. It provides a programmable interface for orchestrating complex generation workflows, enabling developers to coordinate multi-turn dialogues, tool invocations, and reasoning chains through a domain-specific language. The platform is built to support production-scale deployments, offering an OpenAI-compatible API that allows for integration with existing application ecosystems. The system distinguishes itself through a disaggregated architecture that separates compute-intensive pr

Facefusion is a modular framework designed for automated image and video manipulation, specializing in tasks such as face swapping, enhancement, and restoration. It functions as a computer vision processing pipeline that chains independent machine learning modules to perform complex transformations, including facial animation, age modification, and lip synchronization. The system is built to handle both real-time interactive feeds and large-scale batch processing tasks. The platform distinguishes itself through a highly extensible architecture that supports custom processing modules and inter

This project is a singing voice conversion tool based on VITS generative modeling. It transforms the identity of a singing voice to a target speaker while preserving the original melody, lyrics, and intonation. The system distinguishes itself through hybrid voice synthesis, allowing for the blending of multiple speaker identities via linear model interpolation. It utilizes cluster-based feature retrieval to increase target voice similarity and employs a diffusion probabilistic model as a post-processor to remove electronic artifacts and improve vocal clarity. The software covers a broad rang

Label Studio एक मल्टी-टाइप डेटा लेबलिंग टूल और डेटा एनोटेशन वर्कस्पेस है जिसे मशीन लर्निंग प्रशिक्षण के लिए डेटासेट तैयार करने के लिए डिज़ाइन किया गया है। यह एक क्लाउड-एकीकृत डेटा पाइपलाइन के रूप में कार्य करता है जो स्टोरेज से रॉ डेटा आयात करता है, एनोटेशन प्रक्रिया का प्रबंधन करता है, और लेबल्स को मानकीकृत प्रारूपों में निर्यात करता है। प्लेटफ़ॉर्म में एक मशीन लर्निंग मॉडल एकीकरण फ्रेमवर्क है जो बाहरी मॉडल सर्वर से जुड़ता है। यह मॉडल-सहायता प्राप्त एनोटेशन और सक्रिय शिक्षण को सक्षम बनाता है, जिससे सिस्टम को प्री-लेबलिंग करने और मानवीय प्रतिक्रिया के आधार पर भविष्यवाणियों को परिष्कृत करने की अनुमति मिलती है। सॉफ्टवेयर डेटासेट को व्यवस्थित करने और भूमिका-आधारित एक्सेस के माध्यम से उपयोगकर्ताओं को कार्य सौंपने के लिए प्रोजेक्ट प्रबंधन उपकरण प्रदान करता है। यह विभिन्न डेटा प्रकारों का समर्थन करता है और स्थानीय फ़ाइल सिस्टम या क्लाउड स्टोरेज प्रदाताओं के साथ जुड़ने के लिए बैकएंड-अज्ञेयवादी स्टोरेज एडेप्टर का उपयोग करता है। एप्लिकेशन को क्लाउड इंफ्रास्ट्रक्चर पर मैनुअल सेटअप या वन-क्लिक परिनियोजन के माध्यम से स्थापित किया जा सकता है।

This project is an educational resource focused on the internal mechanics and design principles of transformer-based neural networks. It provides a structured guide to the fundamental components of generative artificial intelligence, including sequence modeling, semantic embeddings, and the mathematical foundations of large language models. The repository distinguishes itself through a heavy emphasis on visual documentation, utilizing diagrams and step-by-step explanations to clarify how data flows through complex neural architectures. It serves as a technical reference for developers seeking

labelImg एक डेस्कटॉप इमेज एनोटेशन टूल और डेटासेट तैयारी यूटिलिटी है जिसका उपयोग कंप्यूटर विज़न प्रशिक्षण के लिए लेबल किए गए डेटासेट बनाने के लिए किया जाता है। यह छवियों में वस्तुओं के चारों ओर बाउंडिंग बॉक्स खींचने और मशीन लर्निंग मॉडल के लिए ग्राउंड ट्रुथ डेटा बनाने के लिए उन्हें क्लास लेबल असाइन करने के लिए एक ग्राफिकल इंटरफ़ेस प्रदान करता है। सॉफ्टवेयर विशेष रूप से Pascal VOC XML एनोटेशन प्रारूप का समर्थन करता है, जो इमेज निर्देशांक और क्लास नामों को मानक XML या टेक्स्ट संरचनाओं में निर्यात करता है। यह उपयोगकर्ताओं को पूरे प्रोजेक्ट में नामकरण को मानकीकृत करने के लिए टेक्स्ट फ़ाइलों से पूर्व-निर्धारित क्लास सूचियों को लोड करने की अनुमति देता है। प्रारंभिक लेबलिंग से परे, टूल इमेज एनोटेशन वर्कफ़्लो को कवर करता है जिसमें सहेजे गए एनोटेशन का विज़ुअलाइज़ेशन और मैनुअल डेटासेट सत्यापन शामिल है। इसमें डेटासेट की गुणवत्ता बनाए रखने के लिए छवियों को सत्यापित या कठिन के रूप में चिह्नित करने की क्षमता शामिल है।