1 repo
Awesome GitHub RepositoriesMultimodal Training
Techniques and workflows for training models on multiple data modalities.
Distinguishing note: Specifically targets the integration of visual and textual data for model refinement.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Multimodal Training. Refine with filters or upvote what's useful.
Awesome Multimodal Training GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- haotian-liu/LLaVA
haotian-liu/LLaVA
24,465View on GitHubLLaVA is a multimodal large language model architecture designed to process and interpret both image and text inputs to generate natural language responses. It functions as a research-oriented platform for visual instruction tuning, providing a framework to align language models with human intent through training on diverse datasets of paired images and text queries. The system distinguishes itself through a specialized vision-language training pipeline that connects visual data to language models using projection layers and instruction-based fine-tuning. It supports distributed inference by
Refines large language models to process and interpret visual data through fine-tuning.
Pythonchatbotchatgptfoundation-models
