Awesome GitHub RepositoriesFlow-Matching Frameworks

Flux is a diffusion model inference engine designed for text-to-image generation and image-to-image manipulation. It provides a system for executing open-weight models to transform natural language descriptions into visual imagery or to modify existing images. The project distinguishes itself through a flow-matching framework for image generation and a structural image controller. This controller allows for guided synthesis by using depth maps and Canny edge detection to constrain the geometry and composition of the output. The toolkit covers a broad range of image editing capabilities, incl

Audiocraft is a deep learning audio library and machine learning framework designed for training, fine-tuning, and evaluating generative models for music and sound effects. It functions as a text-to-music generative model and a neural audio codec, providing the tools necessary to compress audio signals into discrete representations and synthesize high-fidelity waveforms from textual descriptions. The framework is distinguished by its ability to combine multiple conditioning signals, allowing for the generation of audio based on text prompts, melodic excerpts, or style-based audio clips. It al

F5-TTS is a text-to-speech system that utilizes a flow matching engine and diffusion transformers to generate fluent synthetic speech. It functions as a multilingual speech synthesizer and neural training framework, providing tools for voice cloning and high-performance inference serving. The project distinguishes itself through a voice cloning toolkit capable of mimicking specific speaker characteristics and tones from reference audio clips. It supports cross-lingual generation, allowing for the synthesis of audio across various global languages or the mixing of multiple languages within a s

This project is a machine learning research automation system designed to manage the full research lifecycle, from idea discovery to final paper submission. It utilizes markdown-based skill templates to execute autonomous research tasks and manage iterative loops of deep review and experimentation. The system distinguishes itself through integrated capabilities for academic communication and integrity auditing. It can automate the generation of LaTeX papers, conference slide decks, and evidence-grounded peer review rebuttals. To ensure rigor, it employs cross-model review routing and adversar

AI NovelGenerator 是一款使用大语言模型生成长篇小说的工具。它作为叙事架构师和写作助手，自动化创建多章节小说，同时管理整体故事结构和角色追踪。 该项目的特色在于语义上下文检索系统和 AI 故事一致性检查器。这些工具使用语义搜索从之前的章节中回忆特定的故事细节，并扫描生成的文本以查找情节矛盾或行为不一致之处。 该系统涵盖了完整的叙事生命周期，包括故事基础设计、世界观构建和小说结构规划。它利用多阶段管线来起草连贯的章节，并结合了用于管理设置和校对的创意工作流工作台。

这是一个神经文本转语音（TTS）框架和 PyTorch 模型，旨在合成人类语音。它通过预测梅尔频谱图（mel spectrograms）将书面文本转换为合成音频，梅尔频谱图作为语音生成的中间表示。 该系统包括一个用于 WaveNet 的条件模型，以确保自然的音频输出。它提供了一个分布式训练框架，利用多 GPU 处理和自动混合精度来优化训练速度并减少内存使用。 该项目涵盖了神经语音合成的完整流水线，从使用文本和音频数据集的模型训练到人工语音的生成。它采用卷积编码器-解码器和序列到序列注意力机制，将语言特征映射到声学帧。

这是一个基于 PyTorch 的生成模型框架，旨在通过学习向量场和概率路径将噪声转换为复杂的数据分布。它作为一个多模态生成工具包，通过学习到的概率流来生成合成文本和图像。 该库的独特之处在于支持连续、离散和黎曼流形（Riemannian manifold）集成。这使得该框架能够处理多种数据类型，包括通过离散状态流匹配处理分类数据，以及通过黎曼流形集成处理非欧几里得空间。 该工具包涵盖了完整的生成流水线，包括概率路径定义、向量场回归以及用于数据采样的微分方程求解器。这些功能使得训练和推理能够跨多种模态生成合成内容的生成模型成为可能。

ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,

Hunyuan3D-2.1 is a generative 3D framework and image-to-3D pipeline that transforms single 2D images into textured 3D geometries. It functions as an asset generator that produces high-quality 3D meshes and textures using a flow-matching system. The project includes a specialized synthesizer for creating photorealistic textures with physically based rendering properties. These tools allow for the simulation of metallic reflections and light interactions on generated models. The system covers 3D asset pipeline automation through a sequence of shape generation and mesh refinement. It also provi