1 repository
Awesome GitHub RepositoriesMulti-Visual Context Processing
Reasoning across multiple discrete visual inputs within a single prompt to follow cross-contextual instructions.
Distinct from Multi-Image Sample Processing: Distinct from Multi-Image Sample Processing: focuses on instruction-following across different visual contexts rather than just aggregating features.
Explore 1 awesome GitHub repository matching graphics & multimedia · Multi-Visual Context Processing. Refine with filters or upvote what's useful.
Awesome Multi-Visual Context Processing GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- evolvinglmms-lab/otter
EvolvingLMMs-Lab/Otter
3,331Vezi pe GitHubOtter is a framework and toolkit for the pretraining, fine-tuning, and evaluation of vision-language models. It provides a pipeline for training large language models to process high-resolution images and video frames, integrating visual encoders with textual token spaces. The system is designed for multi-visual input processing, allowing models to interpret multiple images or video sequences within a single prompt. It supports multi-round conversation management to maintain context across interactions for detailed scene comprehension and visual reasoning. The framework covers a full develop
Interprets multiple images or video frames within a single prompt to follow instructions spanning different visual contexts.
Pythonartificial-inteligencechatgptdeep-learning
