How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
CodeGen is a trained large language model and program synthesis model designed to generate functional source code. It utilizes a neural network architecture to synthesize executable code from natural language descriptions or partial code snippets. The model enables automated program synthesis and AI-assisted coding by predicting and filling in missing sections of code within a program. It transforms natural language descriptions into functional programming logic to automate the creation of boilerplate and logic.
StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues. The models use Grouped Query Attention, a context window of 16,384 tokens, with sliding window…
This project is a quantized fine-tuning framework for large language models. It implements a low-rank adaptation library and a four-bit quantizer to reduce the GPU memory requirements needed to train large models. The framework utilizes four-bit quantization and low-rank adapters to enable model training on consumer-grade hardware. It further reduces the memory footprint through double quantization and a paged optimizer that offloads states to system RAM. The system supports distributed training across multiple GPUs to handle larger parameter scales and includes utilities for custom dataset
LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc
Home of CodeT5: Open Code LLMs for Code Understanding and Generation
The main features of salesforce/codet5 are: AI Coding Assistants, Code Generation Models, Large Language Models, Pre-training Research, Large Language Models (LLMs).
Projects with overlapping indexed features include: salesforce/codegen — CodeGen is a trained large language model and program synthesis model designed to generate functional source code. It… bigcode-project/starcoder2 — StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The… chroma-core/chroma — Chroma is a specialized vector database designed to index and retrieve high-dimensional data representations for… berriai/litellm — LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model… bigscience-workshop/petals — Petals is a decentralized framework and inference engine for running large language models across a peer-to-peer… artidoro/qlora — This project is a quantized fine-tuning framework for large language models. It implements a low-rank adaptation…