1 repo
Awesome GitHub RepositoriesProjection Layers
Neural network components that map features between different model modalities.
Distinguishing note: Specifically addresses the alignment of visual embeddings into language model input spaces.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Projection Layers. Refine with filters or upvote what's useful.
Awesome Projection Layers GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- haotian-liu/LLaVA
haotian-liu/LLaVA
24,465View on GitHubLLaVA is a multimodal large language model architecture designed to process and interpret both image and text inputs to generate natural language responses. It functions as a research-oriented platform for visual instruction tuning, providing a framework to align language models with human intent through training on diverse datasets of paired images and text queries. The system distinguishes itself through a specialized vision-language training pipeline that connects visual data to language models using projection layers and instruction-based fine-tuning. It supports distributed inference by
Maps visual encoder embeddings into the input space of a large language model.
Pythonchatbotchatgptfoundation-models
