30 open-source projects similar to hongfz16/avatarclip, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
PhotoMaker is a diffusion-based identity generator designed for person-specific image synthesis. It creates high-fidelity photos and avatars of specific individuals using stacked embeddings, which allows for the generation of consistent human identities without the need for custom model training or fine-tuning. The system utilizes zero-shot identity synthesis and identity adapters to maintain recognizable facial features across various visual contexts. It supports artistic style transfer by combining identity information with specialized model weights and integrates external control framework
Photoshot is a commercial SaaS image platform and web application used for creating personalized AI avatars and portraits. It functions as an AI avatar creator that trains custom machine learning models on user-uploaded photos to produce consistent digital personas. The platform includes an LLM prompt generator that uses large language models to craft detailed text descriptions for image generation engines. It integrates a secure third-party payment gateway to manage user access to these creative tools and services. The system architecture handles asynchronous task queueing for machine learn
InfiniteTalk is an open-source system for generating talking head videos driven by audio input. It synthesizes realistic lip movements, head poses, and facial expressions synchronized to a spoken audio track, using either a single still image or a small set of reference video frames as the visual source. The system can produce videos of arbitrary length while maintaining temporal coherence, and it supports animating multiple subjects in a single scene. A key differentiator is the ability to coordinate multiple talking subjects through a structured JSON description, giving each independent lip
Generating shapes using natural language can enable new ways of imagining and creating the things around us. While significant recent progress has been made in text-to-image generation, text-to-shape generation remains a challenging problem due to the unavailability of paired text and shape data…
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields
Official code release for CVPR 2023 paper Learning Locally Editable Virtual Humans.
Analyzing our Latent-NeRF, we show that while Text-to-3D models can generate impressive results, they are inherently unconstrained and may lack the ability to guide or enforce a specific 3D structure. To assist and direct the 3D generation, we propose to guide our Latent-NeRF using a…
Pippo: High-Resolution Multi-View Humans from a Single Image
PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation
Official Pytorch implementation of the paper "MotionCLIP: Exposing Human Motion Generation to CLIP Space".
EVA3D: Compositional 3D Human Generation from 2D Image Collections
StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation
This work presents CLIPDraw, an algorithm that synthesizes novel drawings based on natural language input. CLIPDraw does not require any training; rather a pre-trained CLIP language-image encoder is used as a metric for maximizing similarity between the given description and a generated drawing.…
News - 09/15/2024 Release the templates of ActorsHQ (Actor01 & Actor04) to facilitate training. - 05/22/2024 :loudspeaker: An extension work of Animatable Gaussians for human avatar relighting is available here. Welcome to check it! - 03/11/2024 The code has been released. Welcome to have a try!…
XAGen: 3D Expressive Human Avatars Generation Zhongcong Xu · Jianfeng Zhang · Jun Hao Liew · Jiashi Feng · Mike Zheng Shou
This is the official implementation of PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion.
This repository contains a pytorch implementation for the ECCV 2022 paper, CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshes. CLIP-Actor is a novel text-driven motion recommendation and neural mesh stylization system for human mesh animation.
By Bowen Zhang\, Yiji Cheng\, Chunyu Wang†, Ting Zhang, Jiaolong Yang, Yansong Tang, Feng Zhao, Dong Chen, and Baining Guo.
ClipFace: Text-guided Editing of Textured 3D Morphable Models Shivangi Aneja, Justus Thies, Angela Dai, Matthias Niessner https://shivangi-aneja.github.io/projects/clipface
Zichen Tang 1 , Yuan Yao 2 , Miaomiao Cui 2 , Liefeng Bo 2 , Hongyu Yang 1 . 1 Beihang University 2 Alibaba Group
GauHuman: Articulated Gaussian Splatting from Monocular Human Videos
PEGASUS: Personalized Generative 3D Avatars with Composable Attributes
AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control
Text2Mesh is a method for text-driven stylization of a 3D mesh, as described in "Text2Mesh: Text-Driven Neural Stylization for Meshes" CVPR 2022.
TADA! Text to Animatable Digital Avatars Tingting Liao · Hongwei Yi · Yuliang Xiu · Jiaxiang Tang · Yangyi Huang · Justus Thies · Michael J. Black Equal Contribution
This is the official PyTorch implementation of Get3DHuman.
Official implementation of HumanNorm, a method for generating high-quality and realistic 3D Humans from prompts.