# gaomingqi/track-anything

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/gaomingqi-track-anything).**

6,936 stars · 513 forks · Python · mit

## Links

- GitHub: https://github.com/gaomingqi/Track-Anything
- awesome-repositories: https://awesome-repositories.com/repository/gaomingqi-track-anything.md

## Topics

`inpaint-anything` `interactive-tracking` `segment-anything` `track-anything` `video-object-segmentation` `video-object-tracking`

## Description

Track-Anything is an AI-driven video object segmentation and tracking system. It utilizes the Segment Anything Model to isolate and mask multiple objects across video frames, providing tools for automated mask propagation and background-filling inpainting.

The system distinguishes itself through a multi-object segmentation pipeline that can follow several distinct targets simultaneously. It includes a video inpainting utility to remove tracked objects and replace them with synthesized background content, as well as temporal mask refinement to correct tracking drift.

The project covers broad capabilities in computer vision, including point-based mask generation, shot transition management, and cross-frame object tracking. These functions are accessible via a tracking API for managing video uploads, template selection, and automated workflows.

## Tags

### Artificial Intelligence & ML

- [Video Object Tracking](https://awesome-repositories.com/f/artificial-intelligence-ml/video-object-tracking.md) — Provides a comprehensive system for maintaining object identity and masks across sequential video frames. ([source](https://github.com/gaomingqi/Track-Anything/blob/master/text_server.py))
- [Image Segmentation](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-segmentation.md) — Identifies and isolates specific objects within a single image to establish templates for tracking. ([source](https://github.com/gaomingqi/Track-Anything/blob/master/text_server.py))
- [Object Mask Generators](https://awesome-repositories.com/f/artificial-intelligence-ml/computer-vision-systems/image-segmentation/object-mask-generators.md) — Provides tools to define precise selection areas on a frame using positive and negative points. ([source](https://github.com/gaomingqi/Track-Anything/blob/master/doc/tutorials.md))
- [Point-Guided Segmentation](https://awesome-repositories.com/f/artificial-intelligence-ml/segmentation-building-blocks/segmentation-mask-definitions/point-guided-segmentation.md) — Uses positive and negative coordinate prompts to isolate specific objects for initial segmentation.
- [Mask Refinement Loops](https://awesome-repositories.com/f/artificial-intelligence-ml/agentic-systems-frameworks/agentic-workflows/iterative-refinement-workflows/mask-refinement-loops.md) — Corrects tracking drift by resetting masks at failure points and re-propagating the sequence.
- [Shot Transition Management](https://awesome-repositories.com/f/artificial-intelligence-ml/video-object-tracking/shot-transition-management.md) — Provides mechanisms to maintain segmentation continuity when video sequences contain sudden cuts or scene changes. ([source](https://github.com/gaomingqi/Track-Anything/blob/master/README.md))

### Graphics & Multimedia

- [Video Object Segmentations](https://awesome-repositories.com/f/graphics-multimedia/media-processing-analysis/media-manipulation/media-processing-workflows/video-transformation-enhancement/chunked-video-processing/video-processing-apis/video-input-processing/real-time-video-analysis/video-object-segmentations.md) — Isolates objects from their backgrounds in video files using point selection and mask propagation.

### User Interface & Experience

- [Temporal Mask Propagation](https://awesome-repositories.com/f/user-interface-experience/element-masks/stencil-masks/temporal-mask-propagation.md) — Spreads an initial object mask across sequential frames by analyzing visual continuity and temporal movement.
- [Video](https://awesome-repositories.com/f/user-interface-experience/content-rendering-components/image-overlays/media-watermarking-tools/watermark-removal/object-removal/video.md) — Deletes specific elements from a video sequence and fills gaps with synthesized background content.

### Part of an Awesome List

- [Video Inpainting](https://awesome-repositories.com/f/awesome-lists/ai/video-inpainting.md) — Implements video inpainting to remove tracked objects and fill the gaps with synthesized background content.

### System Administration & Monitoring

- [Tracking Drift Correction](https://awesome-repositories.com/f/system-administration-monitoring/error-tracking/tracking-drift-correction.md) — Allows users to reset masks at failure points and re-propagate the sequence to restore tracking accuracy. ([source](https://github.com/gaomingqi/Track-Anything/blob/master/doc/tutorials.md))