# chaoningzhang/mobilesam

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/chaoningzhang-mobilesam).**

5,795 stars · 585 forks · Jupyter Notebook · Apache-2.0

## Links

- GitHub: https://github.com/ChaoningZhang/MobileSAM
- awesome-repositories: https://awesome-repositories.com/repository/chaoningzhang-mobilesam.md

## Description

MobileSAM is a lightweight image segmenter and promptable vision model designed for fast object isolation on resource-constrained hardware. It functions as an automatic image masking tool capable of detecting and isolating distinct objects across an entire image without manual input.

The system enables prompt-based object masking using coordinate points or bounding boxes to generate precise masks. It also supports all-object image segmentation through object-aware prompt sampling to identify every distinct object in a scene.

To facilitate mobile and edge deployment, the model is compatible with ONNX export, allowing the vision model to run across various cross-platform hardware runtimes.

## Tags

### Artificial Intelligence & ML

- [Mobile-Optimized Segmentations](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-networks/image-segmentations/mobile-optimized-segmentations.md) — Provides a lightweight image segmenter designed specifically for fast object isolation on mobile hardware.
- [Image Segmentation](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-segmentation.md) — Performs all-object image segmentation to isolate every distinct object across a scene. ([source](https://github.com/chaoningzhang/mobilesam#readme))
- [Object Mask Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-segmentation/object-mask-generators.md) — Creates precise object outlines using point or box prompts as input.
- [Point-Based Mask Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-segmentation/object-mask-generators/point-based-mask-generators.md) — Generates precise segmentation masks using coordinate points and bounding box prompts.
- [Automatic Prompt Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-segmentation/object-mask-generators/text-prompted-masking/automatic-prompt-generators.md) — Generates a grid of candidate prompts to automatically identify and mask all objects in an image.
- [SAM-Based Implementations](https://awesome-repositories.com/f/artificial-intelligence-ml/neural-networks/image-segmentations/sam-based-implementations.md) — Implements a mobile-optimized version of the Segment Anything Model architecture.
- [Image Encoders](https://awesome-repositories.com/f/artificial-intelligence-ml/image-classification/cnn-architectures/image-encoders.md) — Implements a decoupled image encoder to extract spatial features for fast mask decoding.
- [Knowledge Distillation](https://awesome-repositories.com/f/artificial-intelligence-ml/knowledge-distillation.md) — Uses knowledge distillation to compress a large teacher model into a lightweight student model.
- [ONNX Model Exporters](https://awesome-repositories.com/f/artificial-intelligence-ml/machine-learning/infrastructure/model-deployment-and-serving/serialization-and-export-formats/onnx-model-exporters.md) — Provides tools to export the vision model into the standardized ONNX format for edge deployment.
- [Vision Transformers](https://awesome-repositories.com/f/artificial-intelligence-ml/vision-transformers.md) — Employs a lightweight vision transformer with reduced attention heads and layers for efficiency.

### Part of an Awesome List

- [Prompt-Based Segmentations](https://awesome-repositories.com/f/awesome-lists/ai/image-segmentation/prompt-based-segmentations.md) — Implements prompt-based segmentation using bounding boxes or points to identify specific image areas. ([source](https://github.com/chaoningzhang/mobilesam#readme))
- [Promptable Segmentation Tools](https://awesome-repositories.com/f/awesome-lists/ai/promptable-segmentation-tools.md) — Provides a model that generates masks based on multi-modal prompts such as points and boxes.
- [Image segmentation](https://awesome-repositories.com/f/awesome-lists/more/image-segmentation.md) — Listed in the “Image segmentation” section of the Ailia Models awesome list.

### Graphics & Multimedia

- [AI Image Masking](https://awesome-repositories.com/f/graphics-multimedia/ai-image-masking.md) — Functions as an automatic masking tool to isolate distinct objects using neural networks.