13 open-source projects similar to lxtgh/omg-seg, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
This is an educational curriculum for building and training neural networks using PyTorch. It serves as a deep learning training guide and resource, providing a structured series of lessons on tensor computation and architecture development. The course uses an interactive learning model that synchronizes academic theory with practice. It pairs theoretical lecture slides with exercise-driven notebooks, requiring students to implement model logic within predefined templates to validate their conceptual understanding. The curriculum covers a broad range of deep learning capabilities, including
This project is an educational course and learning curriculum for implementing and fine-tuning transformer models using the Hugging Face ecosystem. It serves as a structured guide and technical walkthrough for processing multimodal data, adapting pre-trained neural networks, and deploying models. The material includes a guide for managing, versioning, and distributing model weights and datasets through a centralized asset hub. It also provides a practical tutorial on adapting models to specific datasets using parameter-efficient methods and an implementation guide for solving natural language
Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.
MiniCPM-o is a multimodal large language model designed to function as a real-time conversational assistant on edge devices. By mapping text, image, video, and audio inputs into a unified latent space, the system enables simultaneous cross-modal reasoning and full-duplex interaction. It is built as an edge-side inference engine, utilizing quantized model weights to maintain high-performance processing on consumer hardware. The system distinguishes itself through its integrated speech synthesis and voice cloning capabilities, which allow for the generation of expressive, personalized vocal out
MiniCPM-V is a multimodal large language model and vision-language system designed for complex visual and linguistic understanding. It functions as an on-device AI model, providing the capacity to process text, images, and video as a compact neural network. The project is specifically developed as an edge AI framework, utilizing quantization and weight sharding to run on memory-constrained mobile chipsets. This allows for the deployment of multimodal intelligence directly on mobile operating systems for local inference. Its capabilities cover multimodal content analysis of high-resolution im
ECCV 2024 Best Paper Candidate & TPAMI 2025 PointLLM: Empowering Large Language Models to Understand Point Clouds
The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.
✨✨NeurIPS 2025 VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
A Vision-Language Model for Spatial Affordance Prediction in Robotics
Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models (CVPR 2024 Highlight)
AAAI 2025 DocKylin: A Large Multimodal Model for Visual Document Understanding with Efficient Visual Slimming
Project Page for "LISA: Reasoning Segmentation via Large Language Model"