15 रिपॉजिटरी
Awesome GitHub RepositoriesUnified Models
Multimodal models capable of understanding and generating multiple media types.
Explore 15 awesome GitHub repositories matching part of an awesome list · Unified Models. Refine with filters or upvote what's useful.
Awesome Unified Models GitHub Repositories
AI के साथ बेहतरीन रिपॉजिटरी खोजें।हम AI का उपयोग करके सबसे सटीक रिपॉजिटरी खोजेंगे।
- deepseek-ai/janus
deepseek-ai/Janus
17,746GitHub पर देखेंJanus is a multimodal large language model and unified framework that integrates visual understanding and image generation within a single neural network. It functions as both a visual understanding model for analyzing images and a text-to-image generator. The system uses a unified transformer backbone and a multimodal latent space to bridge the gap between text and visual data. This architecture employs decoupled visual encoding and cross-modal tokenization to separate the paths for discriminative understanding and generative tasks, representing images as grids of discrete codes. The projec
Unified multimodal understanding and generation model.
Pythonany-to-anyfoundation-modelsllm - bytedance/lance
bytedance/Lance
1,250GitHub पर देखेंA 3B-active-parameter native unified multimodal model for image and video understanding, generation, and editing.
Unified multimodal model for efficient processing.
Python - alpha-vllm/lumina-dimoo
Alpha-VLLM/Lumina-DiMOO
1,001GitHub पर देखेंLumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understanding
Unified multimodal generation model.
Python - facebookresearch/tuna-2
facebookresearch/tuna-2
Official implementation of Tuna-2: Pixel Embeddings Beat Vision Encoders for Unified Understanding and Generation
Unified multimodal model for diverse applications.
Python - skyworkai/vitron
SkyworkAI/Vitron
NeurIPS 2024 Paper
Unified vision-language model for generation and editing.
Python - byteflow-ai/tokenflow
ByteFlow-AI/TokenFlow
CVPR 2025 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
Unified framework for multimodal token processing.
Python - opengvlab/internvl-u
OpenGVLab/InternVL-U
InternVL-U is a 4B-parameter unified multimodal model (UMM) that brings multimodal understanding, reasoning, image generation, image editing into a single framework.
Unified vision-language model for diverse tasks.
Python
