How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Janus is a multimodal large language model and unified framework that integrates visual understanding and image generation within a single neural network. It functions as both a visual understanding model for analyzing images and a text-to-image generator. The system uses a unified transformer backbone and a multimodal latent space to bridge the gap between text and visual data. This architecture employs decoupled visual encoding and cross-modal tokenization to separate the paths for discriminative understanding and generative tasks, representing images as grids of discrete codes. The projec
Grounded Reasoning wiht Texts and Images (GRIT) is a novel method for training Multimodal Large Language Models (MLLMs) to perform grounded reasoning by generating reasoning chains that interleave natural language and explicit bounding box coordinates. This approach can use as few as 20 training…
TPAMI 2026 Ego-R1: Agentic Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning
Yi-Hsin Hung 1 , Yueqi Duan 1 , * Equal Contribution. 1 Tsinghua University NeurIPS 2025 (Spotlight)
The main features of diankun-wu/spatial-mllm are: Multimodal Understanding.
Projects with overlapping indexed features include: deepseek-ai/janus — Janus is a multimodal large language model and unified framework that integrates visual understanding and image… eric-ai-lab/grit — Grounded Reasoning wiht Texts and Images (GRIT) is a novel method for training Multimodal Large Language Models… hitsz-tmg/veripo — [📄 Paper Link] [🤗 VerIPO-7B-v1.0]. jun297/v1 — Jiwan Chung   Junhyeok Kim   Siyeol Kim   Jaeyoung Lee   Minsoo Kim   Youngjae Yu. kwai-keye/keye. egolife-ai/ego-r1 — [TPAMI 2026] Ego-R1: Agentic Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning.
