For image segmentation classification, the strongest matches are ultralytics/ultralytics (Ultralytics provides a comprehensive computer vision framework supporting deep), dmlc/gluon-cv (Gluon-CV is a deep learning computer vision library built) and pytorch/vision (This repository provides a comprehensive computer vision library for). ultralytics/yolov5 and bvlc/caffe round out the shortlist. Each is ranked by relevance to your query, popularity and recent activity.
Discover the best open-source image segmentation models, ranked by GitHub stars and activity, and compare top alternatives to find the right fit.
Ultralytics is a comprehensive computer vision framework designed for training, validating, and deploying deep learning models across a wide range of visual recognition tasks. It provides a unified interface for core operations including object detection, instance segmentation, pose estimation, and image classification. By utilizing a modular architecture, the platform allows users to swap model components to balance inference speed and accuracy requirements for diverse applications. The framework distinguishes itself through its support for real-time processing and flexible deployment. It in
Ultralytics provides a comprehensive computer vision framework supporting deep learning-based image classification, instance segmentation, and real-time inference with pretrained models.
Gluon-CV is an MXNet computer vision library that provides a comprehensive collection of pre-implemented vision architectures and training pipelines. It serves as a deep learning research toolkit and a model zoo containing state-of-the-art pre-trained weights for image and video analysis. The project includes a specialized human pose estimation library and a model compression toolkit. These tools allow for the pruning and quantization of deep learning models to increase inference speed and facilitate deployment on constrained edge hardware. The library covers a broad range of vision capabili
Gluon-CV is a deep learning computer vision library built on MXNet that provides training pipelines, pre-trained models, and architectures for image classification and semantic segmentation tasks.
This project is a comprehensive computer vision library for the PyTorch ecosystem, providing a standardized collection of neural network architectures, datasets, and high-performance transformation utilities. It serves as a foundational framework for building, training, and deploying deep learning models, offering a centralized model registry that allows developers to instantiate architectures with pre-trained weights for tasks such as image classification, object detection, and semantic segmentation. The library distinguishes itself through its modular approach to data and compute management
This repository provides a comprehensive computer vision library for PyTorch containing pretrained models, utilities for image classification, and semantic segmentation capabilities.
YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks. What distinguishes this project is its focus on production-ready deployment and model ef
YOLOv5 is a complete deep learning framework that supports image classification and instance segmentation alongside real-time inference and pretrained models, making it a strong fit for your computer vision tasks.
Caffe is a high-performance deep learning framework designed for training and deploying deep neural networks. It functions as a machine learning engine and a convolutional neural network library, providing a C++ backend to accelerate computations on both GPUs and CPUs. The system includes a specialized toolset for computer vision, enabling tasks such as object detection, semantic segmentation, and large-scale image retrieval. It supports the deployment of pre-trained models for image and scene recognition, as well as the ability to fine-tune neural network weights for specialized tasks. The
Caffe is a classic deep learning framework that supports semantic segmentation, image classification, and pretrained model deployment, though it lacks modern instance segmentation out-of-the-box.
This is a PyTorch semantic segmentation library designed for building image masking frameworks. It provides a collection of over 500 pretrained convolutional and transformer-based encoders and various decoder architectures to perform binary and multiclass pixel-level classification. The library features a modular backbone integration that decouples encoder choice from decoder logic. It supports custom input channel configurations and encoder depth tuning, allowing the modification of input layers to accept non-standard channel counts while preserving pretrained weights. Some configurations al
This library provides modular encoder-decoder architectures and extensive pretrained models for PyTorch, fulfilling the semantic segmentation and classification aspects of your search while focusing specifically on segmentation rather than a broad general-purpose vision framework.
ImageAI is a Python computer vision library providing a suite of tools for image classification, object detection, and video analytics. It functions as an integrated framework for locating and labeling objects in static images and video streams, utilizing deep learning models for identification and categorization. The project includes a model training toolkit that allows for the creation of custom classifiers and detectors through scratch training or transfer learning. It features a GPU-accelerated inference engine to increase processing speed for vision tasks and includes specialized utiliti
ImageAI is a Python deep learning library that provides tools for image classification and object detection with pretrained models and GPU acceleration, though it lacks specialized support for semantic and instance segmentation.
Yolact is a computer vision framework and real-time instance segmentation model. It utilizes a fully convolutional neural network to detect objects and generate pixel-level masks for images and video feeds. The system employs prototypical mask generation to create global mask prototypes that are linearly combined for instance-specific results. It incorporates deformable convolutional layers and deformable region-of-interest pooling to adapt spatial sampling to the irregular shapes of objects. The framework covers the full model development lifecycle, including training on custom datasets, ac
Yolact is a real-time instance segmentation framework and computer vision model, matching the core intent for image segmentation tasks even though it focuses specifically on instance-level detection rather than general classification.
DINOv2 is a self-supervised vision transformer foundation model designed to generate high-quality visual representations from raw image data. By leveraging large-scale unlabelled datasets, the framework learns to extract robust numerical embeddings that serve as inputs for various machine learning and analysis workflows. The model distinguishes itself through a teacher-student training framework that utilizes centered and sharpened soft probability distributions to align feature maps across multiple image crops. It incorporates a masking strategy that forces the model to reconstruct missing i
DINOv2 is a self-supervised vision transformer foundation model that provides powerful feature extraction and semantic segmentation capabilities, though it requires downstream classifiers for full image classification and instance segmentation tasks.
jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti
This repository provides an optimized deep learning framework and libraries for edge hardware, supporting real-time image classification and segmentation with pretrained models.
This project provides a deep learning architecture designed to identify and isolate distinct objects within images by generating precise pixel-level masks. It functions as a browser-based inference engine, enabling the execution of complex machine learning models directly within web environments without requiring server-side processing. The system distinguishes itself by utilizing hardware-accelerated execution and parallel processing to achieve real-time segmentation speeds. It supports prompt-based mask decoding, allowing users to generate spatial masks by providing specific points or boxes
This project provides a computer vision foundation model focused on precise image segmentation, though it specializes in mask generation rather than general image classification.
Caffe is a high-performance deep learning framework and convolutional neural network library designed for training and deploying neural networks. It functions as a GPU-accelerated machine learning engine with a core implemented in C++ to enable high-throughput tensor operations. The project utilizes a declarative configuration system where model architectures and hyperparameters are defined in external text files, separating the network design from the execution code. It includes a model serialization system to export trained weights and topologies into binary files for efficient deployment a
Caffe is a classic deep learning framework capable of image classification and feature extraction, though it is now largely superseded for newer segmentation tasks.
RF-DETR is a Python library for training and deploying object detection, instance segmentation, and keypoint detection models built on a vision transformer architecture. It provides a unified command-line interface and Python API for the full workflow, from fine-tuning pretrained checkpoints on custom datasets to running inference on images, video files, and live camera streams. The project supports training on datasets in COCO or YOLO format, with automatic format detection and configurable augmentation pipelines. Models can be exported to ONNX, TFLite, or TensorRT for deployment across edge
RF-DETR is a Python-based computer vision library built for instance segmentation and object detection using vision transformers, though it focuses on detection and segmentation rather than general image classification.
This repository serves as a centralized collection of state-of-the-art deep learning architectures and reference implementations designed for research and application development. It provides a comprehensive toolkit for computer vision and natural language processing, offering pre-built models and training pipelines for tasks ranging from image classification and object detection to complex sequence modeling. The project distinguishes itself by providing a flexible execution harness that manages the entire training lifecycle, including data ingestion and backpropagation. It supports scalable
This repository provides a comprehensive collection of reference implementations and pre-trained models for computer vision tasks including image classification and segmentation, though it functions primarily as a model zoo and research codebase rather than a standalone library.
Detectron2 is a PyTorch computer vision framework and visual recognition platform designed for training and deploying models for object detection, image segmentation, and visual recognition. It provides a research-oriented environment for training complex vision models with multi-GPU acceleration. The project includes a specialized object detection library for identifying and locating multiple objects via bounding boxes, as well as an image segmentation toolkit for creating pixel-level masks through instance, semantic, and panoptic segmentation. Additionally, it features a human pose estimati
Detectron2 is a PyTorch-based computer vision framework that supports object detection, image classification, and both semantic and instance segmentation with pretrained model checkpoints, though it leans more heavily towards detection and segmentation than general image classification.
Deep Java Library is a Java deep learning framework and JVM model inference engine. It provides a high-level API for building and deploying deep learning models within the Java ecosystem, acting as a cross-platform runtime for executing models across CPUs, GPUs, and mobile devices. The library is engine-agnostic, allowing users to switch between different deep learning engines such as PyTorch, TensorFlow, and MXNet while maintaining a single unified API. This enables the deployment of the same model across different backends without changing the application code. The framework supports the f
Deep Java Library is a deep learning framework and inference engine for Java that supports image classification and object detection tasks, though it functions more broadly as a general-purpose ML runtime rather than a dedicated segmentation library.
This project is a biomedical image segmentation framework and PyTorch computer vision library. It provides a deep learning pipeline for isolating specific anatomical structures within medical imagery using pixel-level binary classification. The system utilizes an encoder-decoder neural architecture combined with attention-based feature refinement to highlight relevant anatomical regions and suppress background noise. The toolkit covers a full training workflow, including stochastic data augmentation for biomedical datasets, hyperparameter optimization, and model persistence for restoring pre
This project is a PyTorch-based computer vision framework focused on biomedical image segmentation using deep learning pipelines, though it lacks general image classification and instance segmentation features.
MedSAM is a deep learning framework designed for automating the segmentation of anatomical structures in 2D and 3D medical imagery. It provides specialized tools for fine-tuning pretrained segmentation weights on custom medical datasets and evaluating the accuracy of those predictions against ground truth labels. The project focuses on adapting the Segment Anything Model architecture for medical use, enabling the isolation of specific anatomical structures through prompt-guided methods such as bounding boxes and point prompts. The system covers a full medical AI workflow, including data engi
MedSAM is a specialized deep learning framework for prompt-based image segmentation in medical imagery, which fits the category well despite being tailored for healthcare rather than general-purpose vision tasks.
Corenet is a deep learning training framework and computer vision model library designed for developing neural networks across vision, text, and audio modalities. It functions as a distributed training orchestrator for scaling workloads across multiple compute nodes and provides a multimodal data pipeline for processing image, text, and video data. The project includes a model conversion toolkit for transforming weights and architectures between different machine learning frameworks. It also provides tools for optimizing model performance on Apple Silicon and reducing response latency in gene
CoreNet is a deep learning training framework and computer vision model library that provides efficient backbones, training recipes, and image classifiers, though it focuses more broadly on multimodal tasks rather than out-of-the-box instance segmentation.
PaddleDetection is an object detection framework designed for the end-to-end development, training, and deployment of computer vision models. It provides a comprehensive library of modular neural network architectures and pipelines that support object detection, instance segmentation, and multi-object tracking tasks. The project distinguishes itself through a configuration-driven approach that decouples model components like backbones and heads, allowing for the flexible assembly of custom vision workflows. It incorporates advanced techniques such as anchor-free detection logic, joint detecti
PaddleDetection is a deep learning computer vision framework that supports instance segmentation and object detection with pretrained models and deployment pipelines, though it lacks semantic segmentation and image classification out of the box.
Pytorch-UNet is a deep learning implementation designed for semantic image segmentation. It provides a framework for training convolutional neural networks to perform pixel-wise classification, transforming input images into detailed prediction masks. The project utilizes a symmetric encoder-decoder architecture that employs skip-connection feature fusion to recover fine-grained boundary details. It includes support for mixed-precision training to reduce memory usage and accelerate processing speeds. The framework covers the end-to-end segmentation pipeline, from model training using custom
This repository provides a specialized deep learning framework for semantic image segmentation using the U-Net architecture, though it focuses exclusively on segmentation rather than broader image classification or instance-level tasks.
MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable framework for building, training, evaluating, and deploying segmentation models. At its core, it offers a config-driven pipeline that assembles training, evaluation, and inference workflows by parsing hierarchical configuration files, with a modular component registry that enables plug-and-play composition of neural network modules, optimizers, datasets, and metrics. The framework supports the full model lifecycle through a unified runner interface that controls training, testi
MMSegmentation is a modular PyTorch toolbox providing pretrained models, pipelines, and tools specifically for semantic segmentation, though it focuses purely on segmentation rather than general image classification.
FastSAM is an image segmentation framework that uses convolutional neural networks to isolate visual elements and generate masks for detectable objects within images. It provides a system for both automatic all-object segmentation and promptable image segmentation. The project utilizes an inference-optimized architecture to reduce computational overhead, enabling faster mask generation and real-time visual analysis. It supports the creation of precise masks through various prompt inputs, including points, bounding boxes, and text descriptions. The framework covers broader computer vision cap
FastSAM is a promptable image segmentation framework supporting efficient mask generation and real-time visual analysis, though it focuses primarily on segmentation rather than general image classification.
AutoGluon is an automated machine learning framework and multimodal library designed to automate the end-to-end pipeline from data preprocessing to high-accuracy model training and validation. It functions as an automated model trainer for tabular, image, text, and time series data, as well as a tool for time series forecasting and foundation model finetuning. The project is distinguished by its ability to jointly process and fuse different data types, allowing for the construction of multimodal neural networks that integrate images, text, and structured tables. It supports zero-shot inferenc
AutoGluon is an automated machine learning framework that includes computer vision capabilities for image classification and object detection, though it focuses broadly on tabular, text, and multimodal data rather than specialized segmentation.
PaddleX is a PaddlePaddle-based framework for building, deploying, and fine-tuning AI model pipelines, with pre-built support for computer vision, OCR, document analysis, and time series tasks. It offers a toolkit of ready-to-use pipelines for image classification, object detection, segmentation, and pose estimation, alongside an end-to-end OCR document analysis pipeline that extracts text, tables, formulas, and layout information. The platform also includes a dedicated time series forecasting pipeline for analyzing historical data to detect anomalies, classify patterns, and predict future val
PaddleX is a comprehensive deep learning framework providing ready-to-use pipelines for image classification and segmentation tasks with pretrained models and inference support, though its scope extends broadly into OCR and other AI domains.
Keras is a high-level deep learning framework designed for constructing and training neural networks through the composition of modular, functional layers. It serves as a comprehensive modeling toolkit that provides standardized procedures for defining, evaluating, and deploying complex architectures. By utilizing a directed acyclic graph approach, the framework allows users to build intricate models with multiple inputs, outputs, and shared layers, ensuring consistent numerical execution through functional state management. The project distinguishes itself as a multi-backend machine learning
Keras is a foundational deep learning framework that supports building image classification and segmentation architectures, though it operates as a general neural network toolkit rather than a pre-packaged vision application.
TensorFlow is a comprehensive machine learning framework designed for the construction, training, and deployment of complex mathematical models. It utilizes a graph-based execution model that represents operations as directed acyclic graphs, enabling automatic differentiation and efficient parallel processing. The system provides high-level interfaces for defining neural network architectures, alongside a robust engine for managing multidimensional array structures and tensor mathematics. The framework distinguishes itself through a scalable distributed runtime that orchestrates workloads acr
TensorFlow provides the comprehensive deep learning foundation and computer vision modeling capabilities needed for image segmentation and classification, though it functions as a general-purpose ML framework rather than an out-of-the-box application.
MobileSAM is a lightweight image segmenter and promptable vision model designed for fast object isolation on resource-constrained hardware. It functions as an automatic image masking tool capable of detecting and isolating distinct objects across an entire image without manual input. The system enables prompt-based object masking using coordinate points or bounding boxes to generate precise masks. It also supports all-object image segmentation through object-aware prompt sampling to identify every distinct object in a scene. To facilitate mobile and edge deployment, the model is compatible w
MobileSAM is a lightweight deep learning image segmentation model designed for fast object isolation and prompt-based masking, making it a strong tool for your computer vision pipeline despite lacking broader image classification tasks.
This is an image segmentation framework and masking toolkit for constructing binary and multi-class neural network architectures. It serves as a deep learning encoder wrapper that integrates pre-trained convolutional neural network architectures into semantic segmentation models. The library enables the use of pre-trained backbones to isolate complex patterns and leverages transfer learning to accelerate training. It provides a collection of overlap-based loss functions and precision metrics specifically designed to evaluate and refine the accuracy of image masks. The toolkit covers the full
This Python library is a deep learning framework for semantic segmentation and pre-trained backbone integration, though it focuses primarily on segmentation rather than general image classification.
This is the implementation for PyTroch 0.4.1. - The HRNet OCR version ia available here. - The PyTroch 1.1 version is available here.
This repository provides a specific deep learning architecture for image segmentation built in Python, making it a fitting tool for semantic segmentation tasks despite lacking a broader pre-trained model zoo or instance segmentation features.
This library provides deep learning architectures for image segmentation built on PyTorch, though you will need to pair it with a separate framework for classification tasks.
This is a PyTorch implementation of semantic segmentation models on MIT ADE20K scene parsing dataset (http://sceneparsing.csail.mit.edu/).
This repository provides PyTorch implementations of semantic segmentation models with pretrained weights, fitting the core image segmentation requirement even though it focuses specifically on semantic parsing rather than a full multi-task framework.
Implementation of various Deep Image Segmentation models in keras.
This repository provides various deep learning image segmentation models built in Keras, matching your need for a specialized segmentation library although it focuses on segmentation rather than general image classification.
This repository provides image segmentation implementations and tools, making it a relevant choice for deep learning-based visual tasks despite lacking a broader classification suite.
Catalyst.Segmentation
Catalyst.Segmentation is a specialized Python-based framework for computer vision tasks that provides segmentation capabilities, though it lacks some of the broader out-of-the-box pretrained models and real-time inference utilities found in comprehensive platforms.
Nvidia Semantic Segmentation monorepo
This repository provides a dedicated computer vision framework for semantic segmentation tasks using deep learning models, making it a relevant choice even though it lacks instance segmentation and general image classification features.
Segment Anything Fast is a high-performance computer vision inference engine and image segmentation framework built for PyTorch. It provides a specialized environment for automated object isolation and mask generation, designed to process large-scale visual datasets with increased throughput. The project distinguishes itself through a suite of system-level optimization strategies that accelerate deep learning model performance. By utilizing graph-based model compilation, just-in-time kernel fusion, and hardware-aware quantization, it reduces computational latency and memory footprint. These t
Segment Anything Fast provides image segmentation and deep learning model optimization in PyTorch, making it a relevant tool for computer vision tasks despite leaning heavily into inference performance rather than a full classification suite.
| المستودع | النجوم | اللغة | الترخيص | آخر تحديث |
|---|---|---|---|---|
| ultralytics/ultralytics | 58.5K | Python | AGPL-3.0 | |
| dmlc/gluon-cv | 5.9K | Python | Apache-2.0 | |
| pytorch/vision | 17.7K | Python | BSD-3-Clause | |
| ultralytics/yolov5 | 57.5K | Python | AGPL-3.0 | |
| bvlc/caffe | 34.6K | C++ | NOASSERTION | |
| qubvel-org/segmentation_models.pytorch | 11.6K | Python | MIT | |
| olafenwamoses/imageai | 8.9K | Python | MIT | |
| dbolya/yolact | 5.2K | Python | MIT | |
| facebookresearch/dinov2 | 13K | Jupyter Notebook | Apache-2.0 | |
| dusty-nv/jetson-inference | 8.7K | C++ | mit |