1 repo
Awesome GitHub RepositoriesVision-Language Pipelines
End-to-end workflows for training vision-language models.
Distinguishing note: Focuses on the integration of instruction datasets and projection layers.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Vision-Language Pipelines. Refine with filters or upvote what's useful.
Awesome Vision-Language Pipelines GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- haotian-liu/LLaVA
haotian-liu/LLaVA
24,465View on GitHubLLaVA is a multimodal large language model architecture designed to process and interpret both image and text inputs to generate natural language responses. It functions as a research-oriented platform for visual instruction tuning, providing a framework to align language models with human intent through training on diverse datasets of paired images and text queries. The system distinguishes itself through a specialized vision-language training pipeline that connects visual data to language models using projection layers and instruction-based fine-tuning. It supports distributed inference by
Provides scripts and configurations for fine-tuning language models to understand visual features.
Pythonchatbotchatgptfoundation-models
