2 مستودعات
Libraries that generate natural-language descriptions and answer visual questions from images using multimodal encoder-decoder architectures.
Distinct from Image Captioning: Distinct from Image Captioning: combines both caption generation and visual question answering in a single library, not just captioning.
Explore 2 awesome GitHub repositories matching part of an awesome list · Visual Question Answering Libraries. Refine with filters or upvote what's useful.
BLIP is a vision-language model framework that combines contrastive, matching, and language modeling objectives to align images with text. Built on a multimodal encoder-decoder architecture, it supports distributed data-parallel training with cosine learning rate scheduling and sliding-window metric tracking for training stability. The framework provides capabilities for image captioning, visual question answering, and cross-modal retrieval, scoring semantic alignment between images and text through learned embeddings. It includes toolkits for fine-tuning pre-trained models on custom datasets
Generates natural-language descriptions and answers visual questions from images using multimodal encoder-decoder architectures.
ollama-js is a JavaScript client library and API wrapper that provides a programmatic interface for interacting with and managing large language models. It enables the execution of models in both local and cloud-based environments, facilitating the generation of conversational text and the management of model lifecycles. The project distinguishes itself by offering specialized tools for model administration, including the ability to download, create, and remove models, as well as the capacity to define custom model blueprints and prompt templates. It also provides a vector embedding client fo
Integrates multimodal models to generate natural-language descriptions and answer specific questions about image content.