awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
Back to microsoft/llm2clip

Projects sharing features with LLM2CLIP

30 open-source projects similar to microsoft/llm2clip, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.

  • aidc-ai/parrotAIDC-AI avatar

    AIDC-AI/Parrot

    77View on GitHub↗

    📍Quick Start • 👨‍🏫Acknowledgement • 🤗Contact

    Python
    View on GitHub↗77
  • airsplay/lxmertairsplay avatar

    airsplay/lxmert

    967View on GitHub↗

    Our servers break again :(. I have updated the links so that they should work fine now. Sorry for the inconvenience. Please let me for any further issues. Thanks! --Hao, Dec 03

    Python
    View on GitHub↗967
  • alibaba/conv-llavaalibaba avatar

    alibaba/conv-llava

    128View on GitHub↗

    ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models

    Python
    View on GitHub↗128
  • alpha-vllm/llama2-accessoryAlpha-VLLM avatar

    Alpha-VLLM/LLaMA2-Accessory

    2,805View on GitHub↗

    An Open-source Toolkit for LLM Development

    Python
    View on GitHub↗2,805
  • apple/ml-aimapple avatar

    apple/ml-aim

    1,426View on GitHub↗

    This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.

    Python
    View on GitHub↗1,426
  • baaivision/evebaaivision avatar

    baaivision/EVE

    372View on GitHub↗

    2024/05: Unveiling Encoder-Free Vision-Language Models (NeurIPS 2024, spotlight)

    Python
    View on GitHub↗372

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Find more with AI search
  • chenrocks/uniterChenRocks avatar

    ChenRocks/UNITER

    800View on GitHub↗

    This is the official repository of UNITER (ECCV 2020). This repository currently supports finetuning UNITER on NLVR2, VQA, VCR, SNLI-VE, Image-Text Retrieval for COCO and Flickr30k, and Referring Expression Comprehensions (RefCOCO, RefCOCO+, and RefCOCO-g). Both UNITER-base and UNITER-large…

    Python
    View on GitHub↗800
  • damo-nlp-sg/videollama3DAMO-NLP-SG avatar

    DAMO-NLP-SG/VideoLLaMA3

    1,105View on GitHub↗
    Jupyter Notebook
    View on GitHub↗1,105
  • deepseek-ai/deepseek-vldeepseek-ai avatar

    deepseek-ai/DeepSeek-VL

    4,192View on GitHub↗

    DeepSeek-VL is a multimodal large language model and image-to-text reasoning engine. It functions as a vision-language model and visual question answering system that integrates visual perception with linguistic reasoning to understand and describe images. The project enables multimodal image understanding and document image analysis, specifically processing screenshots of web pages and technical diagrams. It provides capabilities for visual conversational AI, allowing users to interact with visual data to extract insights and perform complex reasoning across different types of visual informa

    Python
    View on GitHub↗4,192
  • deepseek-ai/deepseek-vl2deepseek-ai avatar

    deepseek-ai/DeepSeek-VL2

    5,302View on GitHub↗

    DeepSeek-VL2 is a multimodal large language model and vision-language system designed to analyze visual scenes and generate descriptive text. It functions as a visual question answering and visual grounding model, capable of extracting information from documents and locating specific objects or regions within images based on textual descriptions. The project utilizes a mixture-of-experts architecture to process combined image and text inputs. It is optimized for inference through incremental prefilling, which reduces the GPU memory requirements on hardware. The model covers multimodal data a

    Python
    View on GitHub↗5,302
  • deepseek-ai/janusdeepseek-ai avatar

    deepseek-ai/Janus

    17,763View on GitHub↗

    Janus is a multimodal large language model and unified framework that integrates visual understanding and image generation within a single neural network. It functions as both a visual understanding model for analyzing images and a text-to-image generator. The system uses a unified transformer backbone and a multimodal latent space to bridge the gap between text and visual data. This architecture employs decoupled visual encoding and cross-modal tokenization to separate the paths for discriminative understanding and generative tasks, representing images as grids of discrete codes. The projec

    Pythonany-to-anyfoundation-modelsllm
    View on GitHub↗17,763
  • haotian-liu/llavahaotian-liu avatar

    haotian-liu/LLaVA

    24,465View on GitHub↗

    LLaVA is a multimodal large language model architecture designed to process and interpret both image and text inputs to generate natural language responses. It functions as a research-oriented platform for visual instruction tuning, providing a framework to align language models with human intent through training on diverse datasets of paired images and text queries. The system distinguishes itself through a specialized vision-language training pipeline that connects visual data to language models using projection layers and instruction-based fine-tuning. It supports distributed inference by

    Pythonchatbotchatgptfoundation-models
    View on GitHub↗24,465
  • huggingface/smollmhuggingface avatar

    huggingface/smollm

    3,949View on GitHub↗

    SmolLM is a project dedicated to the development of small language models. It focuses on training and fine-tuning compact models that maintain high performance while utilizing fewer parameters. The project emphasizes efficient AI inference and on-device text generation, aiming to enable the deployment of lightweight models on edge devices with limited memory and processing power. It utilizes synthetic data generation to produce artificial datasets that improve the reasoning and training of these AI systems. The system supports a variety of optimization and training capabilities, including we

    Python
    View on GitHub↗3,949
  • huggingface/transformershuggingface avatar

    huggingface/transformers

    168,632View on GitHub↗

    Transformers is a comprehensive library for machine learning that provides a unified interface for training, fine-tuning, and deploying transformer-based models. It supports a wide range of tasks, including text classification, language modeling, question answering, and sequence-to-sequence translation, while offering specialized architectures for both text and vision processing. The framework includes tools for managing the entire model lifecycle, from data preprocessing and tokenization to distributed training and inference. The library features extensive support for model optimization and

    Pythonaudiodeep-learningdeepseek
    View on GitHub↗168,632
  • internlm/internlm-xcomposerInternLM avatar

    InternLM/InternLM-XComposer

    2,924View on GitHub↗

    InternLM-XComposer-2.5

    Python
    View on GitHub↗2,924
  • jackroos/vl-bertjackroos avatar

    jackroos/VL-BERT

    745View on GitHub↗

    Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

    Jupyter Notebook
    View on GitHub↗745
  • luoweizhou/vlpLuoweiZhou avatar

    LuoweiZhou/VLP

    421View on GitHub↗

    This repo hosts the source code for our AAAI2020 work Vision-Language Pre-training (VLP). We have released the pre-trained model on Conceptual Captions dataset and fine-tuned models on COCO Captions and Flickr30k for image captioning and VQA 2.0 for VQA.

    Python
    View on GitHub↗421
  • meta-llama/llama-modelsmeta-llama avatar

    meta-llama/llama-models

    7,717View on GitHub↗

    This project provides a foundational framework and reference implementation for executing causal language modeling and multimodal reasoning on local systems. It includes a set of core components for managing model assets, a fine-tuning framework, and structural definitions required to instantiate transformer-based architectures. The system is distinguished by its ability to process combined text and image inputs through multimodal transformer models for visual reasoning and document analysis. It also supports the deployment of quantized models, reducing memory footprints through low-precision

    Python
    View on GitHub↗7,717
  • microsoft/unilmmicrosoft avatar

    microsoft/unilm

    22,240View on GitHub↗

    This project is a comprehensive framework and toolkit for developing, optimizing, and deploying transformer-based models across multimodal, document intelligence, and natural language processing tasks. It provides a unified neural architecture that processes text, vision, audio, and document layout data through a shared set of weights, enabling researchers and developers to build foundational models that align cross-modal representations. The platform distinguishes itself through advanced training and inference strategies designed for large-scale deep learning. It incorporates specialized mec

    Pythonbeitbeit-3bitnet
    View on GitHub↗22,240
  • minimax-ai/minimax-01MiniMax-AI avatar

    MiniMax-AI/MiniMax-01

    3,435View on GitHub↗

    The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention

    Pythonlarge-language-modelsllmllms
    View on GitHub↗3,435
  • nahidalam/mayanahidalam avatar

    nahidalam/maya

    129View on GitHub↗

    Models and Dataset at HuggingFace - Paper: arXiv - Try Maya Model: Demo

    Python
    View on GitHub↗129
  • nvidia/megatron-lmNVIDIA avatar

    NVIDIA/Megatron-LM

    16,731View on GitHub↗

    Megatron-LM is a distributed transformer training library and large language model training framework designed to scale models across thousands of GPUs. It functions as a GPU-optimized deep learning toolkit and a scaling engine for mixture-of-experts architectures, enabling the training of models with hundreds of billions of parameters. The project implements multi-dimensional model parallelism, combining tensor, pipeline, data, expert, and context-based workload distribution. It specifically optimizes mixture-of-experts architectures through integrated memory and communication improvements t

    Python
    View on GitHub↗16,731
  • opengvlab/internvlOpenGVLab avatar

    OpenGVLab/InternVL

    10,169View on GitHub↗

    InternVL is a vision-language model framework that fuses a visual encoder with a large language model to translate image features into textual tokens for reasoning. It provides a system for multimodal inference and dialogue, enabling the processing of images and text to answer questions or generate descriptions. The project is distinguished by its high-resolution image processing, which uses dynamic tiling to maintain detail for images up to 4K resolution, and its chain-of-thought visual reasoning for solving complex mathematical and spatial problems. It also supports temporal frame sampling

    Pythongptgpt-4ogpt-4v
    View on GitHub↗10,169
  • pku-yuangroup/llava-cotPKU-YuanGroup avatar

    PKU-YuanGroup/LLaVA-CoT

    2,137View on GitHub↗

    LLaVA-CoT: Let Vision Language Models Reason Step-by-Step

    Python
    View on GitHub↗2,137
  • qwenlm/qwen-vlQwenLM avatar

    QwenLM/Qwen-VL

    6,725View on GitHub↗
    Pythonlarge-language-modelsvision-language-model
    View on GitHub↗6,725
  • qwenlm/qwen2.5-vlQwenLM avatar

    QwenLM/Qwen2.5-VL

    19,480View on GitHub↗

    Qwen2.5-VL is an autoregressive multimodal transformer designed to process interleaved sequences of text and visual tokens. It integrates visual feature embeddings into a shared language model space to perform cross-modal reasoning and generate coherent responses or structured layout code. The project distinguishes itself through vision-language-action mapping, allowing it to perceive visual interfaces and translate that perception into actionable commands for operating digital screens and robotic hardware. It employs dynamic-resolution image encoding and temporal-frame video indexing to hand

    Jupyter Notebook
    View on GitHub↗19,480
  • qwenlm/qwen2-vlQwenLM avatar

    QwenLM/Qwen2-VL

    19,404View on GitHub↗

    Qwen2-VL is a multimodal large language model and vision language model designed to process and reason across text, images, and video content. It functions as a visual reasoning engine and a visual agent framework, capable of interpreting visual data to perform object detection, document parsing, and spatial reasoning. The model is distinguished by its ability to act as a video understanding model, processing hour-long videos with second-level indexing and event recall. It further differentiates itself through a visual agent capability that interacts with software interfaces and robotic hardw

    Jupyter Notebook
    View on GitHub↗19,404
  • rhymes-ai/ariarhymes-ai avatar

    rhymes-ai/Aria

    1,088View on GitHub↗

    Codebase for Aria - an Open Multimodal Native MoE

    Jupyter Notebookmixture-of-expertsmultimodalvision-and-language
    View on GitHub↗1,088
  • salesforce/albefsalesforce avatar

    salesforce/ALBEF

    1,758View on GitHub↗

    This is the official PyTorch implementation of the ALBEF paper Blog . This repository supports pre-training on custom datasets, as well as finetuning on VQA, SNLI-VE, NLVR2, Image-Text Retrieval on MSCOCO and Flickr30k, and visual grounding on RefCOCO+. Pre-trained and finetuned checkpoints…

    Python
    View on GitHub↗1,758
  • salesforce/blipsalesforce avatar

    salesforce/BLIP

    5,676View on GitHub↗

    BLIP is a vision-language model framework that combines contrastive, matching, and language modeling objectives to align images with text. Built on a multimodal encoder-decoder architecture, it supports distributed data-parallel training with cosine learning rate scheduling and sliding-window metric tracking for training stability. The framework provides capabilities for image captioning, visual question answering, and cross-modal retrieval, scoring semantic alignment between images and text through learned embeddings. It includes toolkits for fine-tuning pre-trained models on custom datasets

    Jupyter Notebookimage-captioningimage-text-retrievalvision-and-language-pre-training
    View on GitHub↗5,676