# facebookresearch/flow_matching

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/facebookresearch-flow-matching).**

_How this analysis was created: the description and tags below were written by an AI model that read this project's README and public documentation pages; stars, license and language come straight from the GitHub API. The model does not read the source code._

4,562 stars · 359 forks · Python · NOASSERTION

## Links

- GitHub: https://github.com/facebookresearch/flow_matching
- Homepage: http://facebookresearch.github.io/flow_matching
- awesome-repositories: https://awesome-repositories.com/repository/facebookresearch-flow-matching.md

## Description

This project is a PyTorch-based generative model framework designed to transform noise into complex data distributions by learning vector fields and probability paths. It serves as a multimodal generative toolkit for producing synthetic text and images through learned probability flows.

The library distinguishes itself by supporting continuous, discrete, and Riemannian manifold integrations. This allows the framework to handle a variety of data types, including categorical data via discrete-state flow matching and non-Euclidean spaces through Riemannian manifold integration.

The toolkit covers the full generative pipeline, including probability path definition, vector-field regression, and the use of differential equation solvers for data sampling. These capabilities enable the training and inference of generative models capable of synthetic content generation across multiple modalities.

## Tags

### Artificial Intelligence & ML

- [Deep Generative Modeling Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/deep-generative-modeling-frameworks.md) — Provides a comprehensive toolkit for constructing deep generative models based on probability paths and vector fields.
- [Generative Model Training Tools](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-model-training-tools.md) — Provides a framework for training generative models using flow matching to transform noise into data distributions.
- [Discrete-State Flow Matching](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-diffusion-models/flow-matching-frameworks/discrete-state-flow-matching.md) — Provides specialized flow matching implementations for categorical and discrete-state data.
- [General Purpose Flow Matching](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-diffusion-models/flow-matching-frameworks/general-purpose-flow-matching.md) — Provides a PyTorch-based library for implementing continuous and discrete flow matching algorithms to train generative models.
- [Probabilistic Generative Sampling](https://awesome-repositories.com/f/artificial-intelligence-ml/inference-sampling-strategies/reproducible-sampling/probabilistic-generative-sampling.md) — Generates new data samples by integrating probability flows from a noise distribution. ([source](http://facebookresearch.github.io/flow_matching/notebooks.html))
- [ODE-Based Trajectory Sampling](https://awesome-repositories.com/f/artificial-intelligence-ml/inference-sampling-strategies/reproducible-sampling/probabilistic-generative-sampling/distribution-based-sampling/ode-based-trajectory-sampling.md) — Uses ODE integration to sample new data points from learned vector fields.
- [Multimodal AI Toolkits](https://awesome-repositories.com/f/artificial-intelligence-ml/multimodal-ai-toolkits.md) — Implements a framework capable of producing synthetic data across multiple modalities, specifically text and images.
- [Probability Path Definitions](https://awesome-repositories.com/f/artificial-intelligence-ml/probability-path-definitions.md) — Allows users to specify the geometric and probabilistic transformations between noise and data. ([source](http://facebookresearch.github.io/flow_matching/modules.html))
- [Probability Path Modeling](https://awesome-repositories.com/f/artificial-intelligence-ml/probability-path-modeling.md) — Defines the geometric probability paths used to guide flow matching training.
- [Vector-Field Regression](https://awesome-repositories.com/f/artificial-intelligence-ml/vector-field-regression.md) — Trains neural networks to regress the velocity vectors required to transform noise into data.
- [Multimodal Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-application-frameworks/multimodal-frameworks.md) — Supports the development of generative models that can process both text and image modalities.
- [Synthetic Content Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/diffusion-visual-models/synthetic-content-generators.md) — Generates synthetic images and text by applying trained probability flow transformations. ([source](http://facebookresearch.github.io/flow_matching/_sources/index.rst.txt))
- [Noise-to-Image Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-image-models/noise-to-image-generation.md) — Generates synthetic images by integrating learned vector fields to transform noise into visual data.
- [Multimodal Model Trainers](https://awesome-repositories.com/f/artificial-intelligence-ml/language-model-trainers/multimodal-training-interfaces/multimodal-model-trainers.md) — Provides capabilities to train and optimize generative models that handle both text and image data. ([source](http://facebookresearch.github.io/flow_matching/))

### Part of an Awesome List

- [Flow Model Training](https://awesome-repositories.com/f/awesome-lists/ai/flow-matching/flow-model-training.md) — Implements training pipelines for flow matching models across multiple geometric spaces. ([source](http://facebookresearch.github.io/flow_matching/notebooks.html))
- [Probability Path Learning](https://awesome-repositories.com/f/awesome-lists/ai/flow-matching/probability-path-learning.md) — Implements the learning process for probability paths across various data modalities. ([source](https://cdn.jsdelivr.net/gh/facebookresearch/flow_matching@main/README.md))
- [Text Generation](https://awesome-repositories.com/f/awesome-lists/ai/text-generation.md) — Produces synthetic text samples using discrete-state flow matching techniques.

### Scientific & Mathematical Computing

- [Differential Equation Solvers](https://awesome-repositories.com/f/scientific-mathematical-computing/differential-equation-solvers.md) — Employs numerical differential equation solvers to compute sampling trajectories from learned vector fields. ([source](http://facebookresearch.github.io/flow_matching/modules.html))
- [Continuous-Time Density Transformations](https://awesome-repositories.com/f/scientific-mathematical-computing/numerical-mathematical-foundations/statistics-probability/probability-distributions/probability-distribution-transformations/continuous-time-density-transformations.md) — Implements continuous-time density transformations to guide the training of generative flow models.
- [Flow Matching Algorithms](https://awesome-repositories.com/f/scientific-mathematical-computing/numerical-mathematical-foundations/statistics-probability/probability-distributions/probability-distribution-transformations/normalizing-flow-layers/flow-matching-algorithms.md) — Implements flow matching algorithms for both continuous and discrete data transformations. ([source](http://facebookresearch.github.io/flow_matching/))
- [Riemannian Manifold Integration](https://awesome-repositories.com/f/scientific-mathematical-computing/riemannian-manifold-integration.md) — Enables flow matching in non-Euclidean spaces via integration along curved geometric manifolds.