Awesome GitHub RepositoriesAutoregressive Models

Bark is a generative audio engine and machine learning inference library designed to convert written text into high-fidelity speech and sound effects. It functions as a text-to-audio transformer, utilizing multi-stage neural network architectures to map semantic input tokens into detailed audio codebooks for synthesis. The system distinguishes itself through a hierarchical transformer stacking approach that separates semantic understanding from acoustic realization. By employing autoregressive token prediction and vector quantized codebook mapping, the engine bridges linguistic and sonic doma

This project is a comprehensive Chinese translation of a technical deep learning textbook, providing an educational resource on the theory and implementation of neural networks. It functions as a collaborative technical translation project designed to make complex academic AI literature accessible to non-English speakers. The project utilizes a community-driven translation model that integrates external suggestions and pull requests to refine linguistic accuracy and reduce bias. It employs standardized terminology mapping to ensure a uniform vocabulary throughout the translated content. To i

minGPT is a minimal implementation of the Transformer architecture designed for training and experimenting with language models. It functions as a neural network training framework and a text generation engine, providing the necessary tools to manage data loading, backpropagation, and parameter updates for custom deep learning models. The project is structured as an educational resource for understanding how transformer architectures function by building and training models from scratch. It utilizes a modular block architecture and transformer-based self-attention to process sequences, allowi

CosyVoice is a speech synthesis framework that utilizes large language models to generate expressive, multilingual audio. The system functions as an audio generation engine capable of producing natural-sounding speech across multiple languages while preserving regional dialects and specific emotional tones. The platform distinguishes itself through its zero-shot voice cloning capabilities, which allow for the creation of synthetic voice profiles from short audio samples without requiring additional model training. It provides fine-grained control over vocal attributes, enabling users to adjus

Qwen3-VL is a multimodal vision-language model designed to process and reason across images, videos, and text. It functions as a computer vision framework capable of identifying objects, extracting structured data from documents, and interpreting spatial elements within visual media. The system operates as an automated user interface interaction agent, interpreting screen data to navigate software and mobile applications. By utilizing a unified transformer architecture, it performs complex visual reasoning to execute user-defined tasks without manual input. Beyond interface navigation, the m

Janus is a multimodal large language model and unified framework that integrates visual understanding and image generation within a single neural network. It functions as both a visual understanding model for analyzing images and a text-to-image generator. The system uses a unified transformer backbone and a multimodal latent space to bridge the gap between text and visual data. This architecture employs decoupled visual encoding and cross-modal tokenization to separate the paths for discriminative understanding and generative tasks, representing images as grids of discrete codes. The projec

FramePack is a neural video synthesis engine and generation framework designed to produce long, temporally consistent video sequences. It functions as a diffusion model optimizer, providing a suite of techniques to manage the computational demands of high-parameter video models while maintaining visual stability during extended generation tasks. The system distinguishes itself through a hierarchical approach to frame prediction, which plans distant anchor frames before filling in intermediate content to prevent cumulative temporal drift. By utilizing constant-length context compression and to

ChatGLM2-6B is a bilingual chat large language model designed for natural conversation and text generation in both English and Chinese. It functions as a fine-tunable language model that supports updating weights via specialized scripts to adapt to specific datasets and tasks. The project serves as a quantized inference engine and multi-GPU model orchestrator, enabling the execution of large models on consumer-grade hardware. It is capable of processing long context sequences up to 32K tokens to maintain understanding across extended documents. The system covers capabilities for multilingual

Spark-TTS is a deep learning text-to-speech synthesis engine designed to convert written text into high-fidelity audio. It utilizes a transformer-based architecture and autoregressive sequence modeling to generate coherent speech, transforming linguistic input into natural-sounding waveforms through neural speech codec synthesis. The platform distinguishes itself through zero-shot voice cloning, which allows users to mimic a target speaker’s unique vocal identity using only a short reference audio sample without requiring additional model training. It also features cross-lingual phonetic mapp

CodeGeeX is an open-source code model and multilingual large language model designed to generate, translate, and complete source code across multiple programming languages. It functions as an AI coding assistant and a cross-lingual code translator that produces executable code and technical documentation. The project enables natural language programming by turning plain English descriptions into functional programs. It also provides the ability to convert source code from one programming language to another while preserving the original logic and functionality. The system covers a range of c

VAR is a visual autoregressive model and image generation framework that applies large language model scaling laws to visual data. It functions as an image generator that uses a coarse-to-fine next-scale prediction approach rather than traditional raster-scan tokenization. The system utilizes scale-based tokenization to represent images as a hierarchy of discrete tokens. It generates high-resolution content by iteratively predicting the next resolution level, refining coarse predictions into fine-grained details. The project covers a broad range of capabilities including autoregressive image

Jukebox is a generative audio model and AI music synthesis tool designed to create high-fidelity music samples and singing voices. It functions as a deep learning system that synthesizes raw audio conditioned on genre and artist metadata, utilizing a neural audio codec to convert raw audio into discrete codes for generative modeling and reconstruction. The system enables musical style steering and AI music composition by conditioning generation on specific artists, genres, and lyrics. It supports audio priming, allowing existing wave files to guide the creation of new musical sequences, and p

GraphCast is a machine learning model that uses graph neural networks to produce global weather forecasts up to ten days ahead at high spatial resolution. The system represents the Earth's surface as an icosahedral mesh, enabling message passing between mesh nodes to capture atmospheric dynamics, and combines this with a learned multiscale processor that operates across coarse-to-fine mesh resolutions. The model is trained on historical ERA5 reanalysis data through a supervised learning objective, and its autoregressive rollout loop feeds predictions back as input to generate multi-step forec

Taming Transformers is a generative system for high-resolution image synthesis that combines a vector-quantized GAN image encoder with an autoregressive transformer. It utilizes a discrete latent space to represent images as codebook tokens, enabling the production of high-fidelity visuals through a hybrid architecture. The project provides specialized capabilities for layout-based scene synthesis, allowing for the creation of complex images by placing objects according to defined bounding box coordinates. It also includes tools for image inpainting to fill missing sections of an image by ana

该项目是一个自然语言处理框架，专注于为无监督语言表示设计的通用自回归预训练器。它实现了一个结合了基于排列的训练与 Transformer-XL 主干的语言模型，以充当长上下文文本处理器。 该系统以其通过使用段级循环和相对位置编码处理超过标准长度限制的文本序列的能力而著称。它使用分布式训练实现，在多个 GPU 和 TPU 集群上扩展高性能预训练。 代码库涵盖了完整的机器学习工作流，包括用于数据预处理的文本清洗和子词分词，以及用于问答、阅读理解和文本分类的任务特定微调。它包括用于参数优化、学习率调度以及通过精确率-召回率指标评估答案概率的实用程序。 该项目提供了用于管理模型超参数和跨多个主机进行硬件加速训练的配置。

x-transformers 是一个用于构建 Transformer 架构的 PyTorch 库和研究工具包。它提供了一个模块化框架来实现实验性 Transformer 研究，包括一套先进的注意力机制、长序列建模工具以及视觉 Transformer 框架。 该项目以专注于内存高效和高性能组件而著称，例如带有分块内核的 Flash Attention 和多查询注意力。它还实现了用于扩展上下文窗口的专门方法，包括序列循环和旋转位置嵌入。 该库涵盖了广泛的架构功能，包括用于稳定训练的各种归一化方案、门控前馈网络以及 Macaron 网络等自定义层拓扑。它支持编码器和解码器构造，为自回归序列生成和图像描述等视觉-语言任务提供工具。

PyTorch Forecasting is a deep learning framework designed for building and training neural network architectures specifically for time series forecasting. It serves as a comprehensive toolkit for implementing autoregressive models, multi-horizon forecasting, and probabilistic prediction intervals using PyTorch tensors. The library distinguishes itself through a probabilistic forecasting toolkit that generates prediction intervals and quantile forecasts using both parametric and non-parametric distributions. It further provides a neural network model optimizer for automated hyperparameter tuni

OmniGen2 是一个统一的图像生成模型和多模态大语言模型，旨在在单个框架内处理文本到图像生成、图像到图像任务和图像编辑。它作为一个因果语言模型视觉引擎，能够根据文本和视觉的组合输入生成并编辑图像。 该系统具有上下文视觉合成和主题驱动生成功能，允许它从参考图像中提取主题并将其放入新场景中。它还支持基于指令的图像编辑，其中特定对象或样式可以通过自然语言命令进行修改，同时保留图像的其余部分。 该模型的能力扩展到视觉内容分析和推理，能够识别跨文本和视觉组合输入的对象。为了提高输出质量，它采用了一种带有自我修正机制的迭代视觉细化流程。 性能通过动态权重卸载的 VRAM 使用优化以及使用缓存技术的推理速度加速来管理。

FastVideo is a comprehensive system for accelerated video generation, serving as a video generation inference engine, a video diffusion training framework, and a modular pipeline orchestrator. It provides a distributed transformer optimizer and a distillation toolkit designed to reduce denoising steps and model complexity to increase frame rates. The project distinguishes itself through specialized acceleration techniques, including joint distillation and sparse attention training. It implements low-step video generation and weight quantization to FP8 or FP4 precision to increase throughput a