Awesome GitHub RepositoriesFlow-Matching Frameworks

Flux is a diffusion model inference engine designed for text-to-image generation and image-to-image manipulation. It provides a system for executing open-weight models to transform natural language descriptions into visual imagery or to modify existing images. The project distinguishes itself through a flow-matching framework for image generation and a structural image controller. This controller allows for guided synthesis by using depth maps and Canny edge detection to constrain the geometry and composition of the output. The toolkit covers a broad range of image editing capabilities, incl

Audiocraft is a deep learning audio library and machine learning framework designed for training, fine-tuning, and evaluating generative models for music and sound effects. It functions as a text-to-music generative model and a neural audio codec, providing the tools necessary to compress audio signals into discrete representations and synthesize high-fidelity waveforms from textual descriptions. The framework is distinguished by its ability to combine multiple conditioning signals, allowing for the generation of audio based on text prompts, melodic excerpts, or style-based audio clips. It al

F5-TTS is a text-to-speech system that utilizes a flow matching engine and diffusion transformers to generate fluent synthetic speech. It functions as a multilingual speech synthesizer and neural training framework, providing tools for voice cloning and high-performance inference serving. The project distinguishes itself through a voice cloning toolkit capable of mimicking specific speaker characteristics and tones from reference audio clips. It supports cross-lingual generation, allowing for the synthesis of audio across various global languages or the mixing of multiple languages within a s

This project is a machine learning research automation system designed to manage the full research lifecycle, from idea discovery to final paper submission. It utilizes markdown-based skill templates to execute autonomous research tasks and manage iterative loops of deep review and experimentation. The system distinguishes itself through integrated capabilities for academic communication and integrity auditing. It can automate the generation of LaTeX papers, conference slide decks, and evidence-grounded peer review rebuttals. To ensure rigor, it employs cross-model review routing and adversar

AI NovelGenerator est un outil pour générer de la fiction longue en utilisant de grands modèles de langage. Il fonctionne comme un architecte narratif et un assistant d'écriture, automatisant la création de romans multi-chapitres tout en gérant la structure globale de l'histoire et le suivi des personnages. Le projet se distingue par un système de récupération de contexte sémantique et un vérificateur de cohérence d'histoire par IA. Ces outils utilisent la recherche sémantique pour rappeler des détails spécifiques de l'histoire à partir des chapitres précédents et scanner le texte généré pour détecter des contradictions d'intrigue ou des incohérences comportementales. Le système couvre un cycle de vie narratif complet, incluant la conception des fondations de l'histoire, le worldbuilding et la planification de la structure du roman. Il utilise un pipeline multi-étapes pour rédiger des chapitres cohérents et intègre un atelier de workflow créatif pour gérer les paramètres et la relecture.

Ce projet est un framework de synthèse vocale neuronale et un modèle PyTorch conçu pour synthétiser la parole humaine. Il convertit le texte écrit en audio synthétique en prédisant des spectrogrammes mel, qui servent de représentation intermédiaire pour la génération de voix. Le système inclut un modèle de conditionnement pour WaveNet afin d'assurer une sortie audio au son naturel. Il fournit un framework d'entraînement distribué qui utilise le traitement multi-GPU et la précision mixte automatique pour optimiser la vitesse d'entraînement et réduire l'utilisation de la mémoire. Le projet couvre le pipeline complet de synthèse vocale neuronale, de l'entraînement du modèle utilisant des jeux de données de texte et d'audio à la génération de voix artificielles. Il emploie un encodeur-décodeur convolutif et une attention séquence-à-séquence pour mapper les caractéristiques linguistiques aux trames acoustiques.

This project is a PyTorch-based generative model framework designed to transform noise into complex data distributions by learning vector fields and probability paths. It serves as a multimodal generative toolkit for producing synthetic text and images through learned probability flows. The library distinguishes itself by supporting continuous, discrete, and Riemannian manifold integrations. This allows the framework to handle a variety of data types, including categorical data via discrete-state flow matching and non-Euclidean spaces through Riemannian manifold integration. The toolkit cove

ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,

Hunyuan3D-2.1 is a generative 3D framework and image-to-3D pipeline that transforms single 2D images into textured 3D geometries. It functions as an asset generator that produces high-quality 3D meshes and textures using a flow-matching system. The project includes a specialized synthesizer for creating photorealistic textures with physically based rendering properties. These tools allow for the simulation of metallic reflections and light interactions on generated models. The system covers 3D asset pipeline automation through a sequence of shape generation and mesh refinement. It also provi