nv-tlabs/GET3D

Features

• Mesh and Geometry Generators - Implements a generative model that synthesizes high-quality 3D meshes and geometry from image and text inputs.
• Single-Image 3D Reconstructions - Reconstructs high-fidelity 3D tetrahedral meshes and textures from a single 2D input image.
• Single-View Shape and Texture Estimations - Estimates 3D geometry, textures, and lighting from a single-view image without requiring 3D supervision data.
• Geometry and Texture Disentanglement - Enables independent control of a 3D object's physical geometry and its surface texture through distinct latent representations.
• Directional Loss Optimizers - Refines 3D generative models by optimizing the gradient between text embeddings and the generated output.
• Text-to-3D Generators - Generates specific 3D geometric shapes and textures from descriptive text prompts using directional loss optimization.
• Unsupervised Material Estimation - Learns view-dependent lighting and surface appearance properties without requiring explicit 3D ground truth labels.
• Simulation Meshes - Produces physics-ready tetrahedral meshes designed for direct integration into simulation engines.
• Generative 3D Modeling - Provides a deep learning framework for synthesizing high-quality 3D textured shapes and tetrahedral meshes.
• Differentiable Volume Rendering - Utilizes a differentiable volume renderer to project 3D data into 2D images for gradient-based optimization.
• Isosurface Extractors - Converts volumetric occupancy grids into high-quality 3D meshes using isosurface extraction techniques.
• Latent-Based Textured Mesh Generation - Produces detailed 3D geometry and surface appearances by generating textured meshes from latent codes.
• Unsupervised Material Generation - Generates realistic view-dependent lighting and material surfaces in an unsupervised manner to enhance visual fidelity.
• Differentiable Rendering - Utilizes a differentiable renderer to allow gradients to optimize 3D geometry and textures based on 2D views.
• 3D Shape Interpolations - Provides a latent space interpolator to create smooth transitions between different 3D objects.
• Novel View Synthesis Engines - Synthesizes realistic visual perspectives of 3D objects from new camera angles using fast convergence methods.
• Voxel-to-Shape Upsampling - Transforms low-resolution voxel data into detailed, high-quality geometric 3D reconstructions.
• Point Cloud Reconstruction - Generates precise volumetric 3D meshes from noisy point cloud data by optimizing occupancy and vertex placement.
• Mesh and Voxel Conversions - Transforms low-resolution volumetric grids into high-fidelity geometric surfaces using generative networks.
• Shape Interpolators - Provides algorithms to create smooth geometric transitions between different 3D objects via latent space traversal.
• Latent Space Interpolations - Implements latent space interpolation to produce smooth transitional sequences between different generated 3D shapes.

Star history