30 open-source projects similar to google/mipnerf, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
This project is a framework for neural radiance fields used to synthesize three-dimensional environments from sets of two-dimensional images and camera poses. It functions as a volumetric rendering engine and scene synthesizer that optimizes neural representations of spatial volumes to generate novel views of complex 3D scenes. The system implements a coordinate encoding system that transforms spatial coordinates into high-dimensional space to capture high-frequency geometric details. It also includes a neural mesh extractor that converts trained radiance fields into triangle meshes via march
PyTorch3D is a 3D geometric deep learning library and mesh processing toolkit designed for learning from point clouds and complex 3D surface geometries. It provides a collection of reusable components and data structures for deep learning with 3D data, including a framework for training and evaluating neural radiance fields to enable photorealistic view synthesis. The project features a differentiable 3D renderer that converts meshes and point clouds into 2D images while allowing gradients to flow back into the geometry and textures. This enables 3D shape optimization, where mesh geometry, te
This repository serves as a comprehensive research platform and toolkit for advancing machine learning, quantum computing, and large-scale scientific data analysis. It provides foundational frameworks for developing complex algorithmic systems, offering the necessary infrastructure for distributed training, computational graph execution, and high-performance model development. The project distinguishes itself by integrating specialized research domains with robust, privacy-preserving methodologies. It supports diverse scientific discovery through tools for quantum simulation, physics-informed
This project is a PyTorch implementation of a Neural Radiance Field framework. It serves as a 3D scene synthesizer and differentiable volumetric renderer used to train volumetric representations of scenes by predicting color and density for 3D spatial coordinates. The system enables novel view synthesis, allowing for the generation of new images of complex 3D scenes from previously unseen perspectives. It supports 3D scene reconstruction by processing 2D images and camera poses to build a digital volumetric representation of a physical space. The framework includes capabilities for 3D model
This project is a computer vision pipeline and volumetric rendering system used to transform photos and videos into high-fidelity 3D models. It implements a deformable neural radiance field framework that optimizes deformation fields to represent non-rigid moving subjects in three dimensions. The system utilizes volumetric deformation fields to map 3D coordinates from a static canonical space to a deformed state. This allows for the reconstruction of photorealistic scenes and the synthesis of high-fidelity images from camera perspectives not present in the original input data. The framework
Nerfstudio is a modular development framework for training, visualizing, and exporting three-dimensional scene representations derived from two-dimensional image datasets. It provides a neural scene reconstruction pipeline that converts raw images and camera data into high-fidelity 3D assets and cinematic video using a differentiable volumetric renderer. The system features an interactive web-based visualizer that allows users to monitor training progress and inspect neural scene geometry in real time. It decouples neural network architectures from the training loop through a standardized mod
Neuralangelo is a neural surface reconstruction framework that transforms two-dimensional image sequences and multi-view photography into high-fidelity 3D meshes. It implements a pipeline for training neural radiance fields to represent complex scenes as digital geometry. The project utilizes a signed distance function for surface representation and multi-resolution hash encoding to capture both coarse and fine geometric details. It employs differentiable volume rendering and gradient-based eikonal regularization to ensure the learned distance functions remain physically plausible. The syste
Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)
A performant reimplementation of the UniRep protein featurization model in JAX.
Warning: This project is still in an early stage it could be that the API will change in the future. Further, functionality is still quite limited to the use cases which defined the creation of the project (application to DNA sequences present in Biology).
This is the official repository for our ICCV 2023 paper Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis.
Dynamic Neural Radiance Fields for Monocular 4D Facial Avater Reconstruction
A library for coreset algorithms, written in JAX for fast execution and GPU support.
Python 3.8.13 - PyTorch 1.11.0+cu113 - CUDA 11.3 - Prim3D for efficient RayCasting and MarchingCubes - gmvs for efficient PatchMatch MVS `sh pip install -r requirements.txt `
Implementation of our CVPR2023 paper "Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container"
This is a JAX implementation of NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction.
| Notebook | Open in Colab | View Notebook| Related Paper | |---|---| --- | --- | | 00: GNNs for Solving Combinatorial Optimization Problems | | | | | 01: GNNs versus Simulated Annealing for Max-Cut | | | | | 02: GNNs versus Simulated Annealing for MIS | | | |
This is a minimal implementation of DETR using jax and flax.
Flax Models A collection of pretrained models in Flax .
This is a port of mseitzer/pytorch-fid, which is a port of the original FID implementation (bioinf-jku/TTUR).
This is the official implementation of VaxNeRF (Voxel-Accelearated NeRF). VaxNeRF provides very fast training and slightly higher scores compared to original (Jax)NeRF!!
Eqxvision is a package of popular computer vision model architectures built using Equinox.
The flaxvision package contains a selection of neural network models ported from torchvision to be used with JAX & Flax.
The pytorch implementation for our ECCV2022 paper "Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis".