princeton-vl/infinigen
Infinigen
Infinigen is a procedural 3D scene generation framework that creates photorealistic indoor and outdoor environments for computer vision training data. It combines constraint-based object placement, GPU geometry shaders, and ground-truth rendering passes to produce scenes with depth, normals, and segmentation masks alongside final images.
The framework distinguishes itself through modular asset composition, a node-graph material system, and physics simulation integration that embeds rigid-body and fluid dynamics directly into the generation pipeline. Procedural rule-based scene composition and deterministic random seed parameterization ensure reproducible, infinitely varied content without external textures or manual modeling.
Beyond scene generation, the toolset supports creating individual 3D assets, simulating physics and fluids, and exporting scenes to standard formats like OBJ and OpenUSD. This makes it a complete pipeline for producing supervised training data with ground-truth annotations for computer vision model development.
Features
- Procedural Generators - Core capability: generates infinite photorealistic 3D scenes procedurally for computer vision training.
- Procedural Scene Generators - Creates infinite photorealistic indoor and outdoor 3D scenes procedurally for computer vision training data.
- Synthetic Training Data Generators - Produces photorealistic scenes with ground-truth annotations to support supervised model training.
- Multi-Channel Render Passes - Renders depth, normals, and segmentation masks alongside final images for supervised training data.
- Embedded Physics Solvers - Embeds rigid-body and fluid dynamics solvers directly into the generation pipeline for physically accurate interactions.
- Random Number Generator Seeding - Controls all generation variability through a single random seed for deterministic reproducibility.
- Rule-Based Layout Systems - Generates scenes by combining modular geometry, materials, and layouts using hand-authored procedural rules.
- Procedural Geometry Shaders - Generates 3D geometry on the GPU using shader programs from mathematical functions and noise.
- Node-Based Material Generation - Defines materials as interconnected nodes that compute surface properties procedurally without external textures.
- Spatial Constraint Solvers - Solves spatial constraints and collision rules to position objects realistically in procedurally generated scenes.
- Procedural Building Blocks - Builds complex objects and scenes by combining smaller procedural building blocks.
- Scene Annotation Generators - Produces extended ground-truth data like depth, normals, and segmentation masks alongside generated scenes.
- Procedural Asset Generators - Creates individual procedural 3D assets such as materials and objects for use in custom scenes.
- Physics Simulation - Generates fluid simulations and articulated assets for physics-based training environments.
- Fluid and Articulated Simulations - Generates fluid simulations and articulated simulation assets for physics-based training environments.
- 3D Scene Exporters - Exports generated 3D scenes to standard formats like OBJ and OpenUSD for external use.
- Fluid & Articulated Simulation Assets - Generates fluid simulations and articulated assets for physics-based training environments.
- Procedural Asset Creation - Creates individual procedural 3D assets like materials and objects for use in custom scenes.
