# Video analysis models

> AI-ranked search results for `video analysis models` on awesome-repositories.com — ordered by an LLM for relevance, best match first. 115 total matches; showing the top 30.

Explore on the web: https://awesome-repositories.com/q/video-analysis-models

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [this search on awesome-repositories.com](https://awesome-repositories.com/q/video-analysis-models).**

## Results

- [ultralytics/yolov3](https://awesome-repositories.com/repository/ultralytics-yolov3.md) (10,571 ⭐) — This is a real-time object detection framework built on the YOLOv3 architecture, implemented in PyTorch. It provides a complete pipeline for identifying and localizing objects in images and video using a single neural network pass, combining a Darknet-53 backbone with multi-scale feature pyramids and anchor-based bounding box prediction.

The framework extends beyond basic detection to include instance segmentation, human pose estimation, and multi-object tracking across video frames. It offers a model export toolkit that converts trained models through ONNX to CoreML, TensorFlow Lite, and Ten
- [wongkinyiu/yolov9](https://awesome-repositories.com/repository/wongkinyiu-yolov9.md) (9,534 ⭐) — YOLOv9 is a real-time computer vision framework and deep learning model designed for image classification, object detection, and instance segmentation. It functions as both a vision model and a trainer, allowing for the optimization of neural network weights on custom datasets using single or multiple GPUs.

The framework utilizes programmable gradient information to perform high-speed identification and location of multiple objects within images and video streams. It extends beyond bounding box detection to provide instance segmentation and panoptic segmentation, which labels every pixel in a
- [wongkinyiu/yolov7](https://awesome-repositories.com/repository/wongkinyiu-yolov7.md) (14,110 ⭐) — YOLOv7 is a PyTorch vision library and real-time inference engine designed for object detection, human pose estimation, and instance segmentation. It provides a framework for detecting and locating multiple objects within images or video streams using neural networks.

The system includes tools for custom model training and fine-tuning, allowing pre-trained weights to be adapted to specialized datasets via transfer learning. It also supports model weight export and format conversion to facilitate deployment on production servers and embedded edge devices.
- [dmlc/gluon-cv](https://awesome-repositories.com/repository/dmlc-gluon-cv.md) (5,922 ⭐) — Gluon-CV is an MXNet computer vision library that provides a comprehensive collection of pre-implemented vision architectures and training pipelines. It serves as a deep learning research toolkit and a model zoo containing state-of-the-art pre-trained weights for image and video analysis.

The project includes a specialized human pose estimation library and a model compression toolkit. These tools allow for the pruning and quantization of deep learning models to increase inference speed and facilitate deployment on constrained edge hardware.

The library covers a broad range of vision capabili
- [ultralytics/yolov5](https://awesome-repositories.com/repository/ultralytics-yolov5.md) (57,528 ⭐) — YOLOv5 is a comprehensive computer vision framework designed for end-to-end deep learning, specializing in real-time object detection, image classification, and instance segmentation. It provides a unified toolkit that manages the entire lifecycle of a model, from initial dataset configuration and hyperparameter tuning to high-speed inference and deployment. The framework utilizes a modular neural architecture, allowing users to swap backbone and head components to tailor models for specific visual tasks.

What distinguishes this project is its focus on production-ready deployment and model ef
- [ultralytics/ultralytics](https://awesome-repositories.com/repository/ultralytics-ultralytics.md) (58,468 ⭐) — Ultralytics is a comprehensive computer vision framework designed for training, validating, and deploying deep learning models across a wide range of visual recognition tasks. It provides a unified interface for core operations including object detection, instance segmentation, pose estimation, and image classification. By utilizing a modular architecture, the platform allows users to swap model components to balance inference speed and accuracy requirements for diverse applications.

The framework distinguishes itself through its support for real-time processing and flexible deployment. It in
- [open-mmlab/mmtracking](https://awesome-repositories.com/repository/open-mmlab-mmtracking.md) (3,881 ⭐) — mmtracking is a PyTorch video perception framework designed for training and deploying computer vision models that analyze sequential image data. It provides specialized tools for multi-object tracking, video instance segmentation, and a configuration-driven system for managing deep learning models.

The project utilizes a deep learning model registry and a configuration-driven pipeline to swap model backbones and detectors without modifying the core codebase. This modular approach allows for the development of custom perception architectures by combining various components and configurations.
- [muhammadmoinfaisal/yolov8-deepsort-object-tracking](https://awesome-repositories.com/repository/muhammadmoinfaisal-yolov8-deepsort-object-tracking.md) (1,166 ⭐) — This project is a computer vision pipeline that integrates object detection and tracking to monitor moving objects within video streams. It functions as an end-to-end analytics tool that processes video frames to identify, classify, and maintain the unique identity of objects as they move through a scene.

The system utilizes a combination of deep learning inference for detection and motion estimation to ensure temporal continuity. By pairing visual appearance descriptors with predictive motion modeling, it maintains object identities even during temporary occlusions or when spatial overlap is
- [facebookresearch/sam3](https://awesome-repositories.com/repository/facebookresearch-sam3.md) (7,762 ⭐) — This project is a computer vision system for object segmentation and tracking across images and videos. It employs models capable of identifying and masking objects using text prompts, bounding boxes, click points, or image exemplars.

The system differentiates itself through memory-based video tracking and shared-memory architectures that maintain consistent object identities over time. It supports multi-object processing in single computation passes to increase frame throughput and utilizes iterative refinement to correct segmentation boundaries through sequential prompts.

The software also
- [kenshohara/3d-resnets-pytorch](https://awesome-repositories.com/repository/kenshohara-3d-resnets-pytorch.md) (4,039 ⭐) — This project is a PyTorch implementation of 3D residual networks designed for video action recognition. It provides a spatiotemporal architecture that analyzes both spatial frames and temporal motion to classify human activities within video clips.

The system includes a distributed model training framework to accelerate learning across multiple compute nodes. It supports the deployment and fine-tuning of pre-trained model weights, allowing the adaptation of existing networks to specific new datasets.

The codebase covers the full pipeline for spatiotemporal learning, including video dataset p
- [roboflow/trackers](https://awesome-repositories.com/repository/roboflow-trackers.md) (2,565 ⭐) — This project is a multi-object tracking library and computer vision toolkit designed to maintain consistent identity IDs for objects across video frames. It provides a motion-based object tracking system that converts raw detections into stable temporal tracks, enabling the analysis of object movement and behavior over time.

The toolkit distinguishes itself through advanced identity maintenance, utilizing Kalman filters for linear motion tracking and sparse optical flow for camera motion estimation. It features multi-stage object association to recover occluded objects and non-linear motion t
- [nwojke/deep_sort](https://awesome-repositories.com/repository/nwojke-deep-sort.md) (6,148 ⭐) — DeepSORT is a real-time multi-object tracking framework designed to maintain consistent identities of multiple objects across video frames. It integrates deep learning appearance features with motion descriptors to track objects through a sequence of video data.

The system uses a deep convolutional neural network to generate high-dimensional visual descriptors for person re-identification. These appearance features are combined with motion estimation via Kalman filtering and solved using the Hungarian algorithm to optimally associate detections with existing tracks.

The framework includes ca
- [jwyang/faster-rcnn.pytorch](https://awesome-repositories.com/repository/jwyang-faster-rcnn-pytorch.md) (7,859 ⭐) — This project is a PyTorch object detection framework that implements the Faster R-CNN architecture. It serves as a vision model for predicting precise bounding boxes around multiple objects within images and live video feeds.

The system is optimized for multi-GPU training to reduce the time required for model convergence. It utilizes a GPU-accelerated design to handle the training and inference of complex detection networks.

The framework covers the full object detection lifecycle, including custom network training and inference for static images and real-time video streams. It includes capa
- [liuliu/ccv](https://awesome-repositories.com/repository/liuliu-ccv.md) (7,223 ⭐) — ccv is a computer vision library written in C designed for high-performance visual analysis. It serves as a framework for image classification, object detection, and the identification of faces, pedestrians, and vehicles.

The library distinguishes itself through hardware-accelerated vision and deep learning inference optimizations. It utilizes a quantized tensor processor to transform floating-point data into eight-bit integers and implements integer-quantized attention mechanisms to reduce memory bandwidth and increase data throughput.

The project covers a broad range of capabilities, inclu
- [facebookresearch/detectron](https://awesome-repositories.com/repository/facebookresearch-detectron.md) (26,370 ⭐) — Detectron is a PyTorch object detection framework and computer vision research platform. It provides implementations of neural network architectures for locating and identifying objects in images, including Mask R-CNN for generating instance segmentation masks and RetinaNet for one-stage detection.

The platform supports computer vision prototyping and object detection research through the deployment of pre-trained baseline models. This allows for the rapid implementation and evaluation of visual recognition systems.

Its capabilities cover image object localization and instance segmentation w
- [paddlepaddle/paddledetection](https://awesome-repositories.com/repository/paddlepaddle-paddledetection.md) (14,243 ⭐) — PaddleDetection is an object detection framework designed for the end-to-end development, training, and deployment of computer vision models. It provides a comprehensive library of modular neural network architectures and pipelines that support object detection, instance segmentation, and multi-object tracking tasks.

The project distinguishes itself through a configuration-driven approach that decouples model components like backbones and heads, allowing for the flexible assembly of custom vision workflows. It incorporates advanced techniques such as anchor-free detection logic, joint detecti
- [tensorflow/models](https://awesome-repositories.com/repository/tensorflow-models.md) (77,663 ⭐) — This repository serves as a centralized collection of state-of-the-art deep learning architectures and reference implementations designed for research and application development. It provides a comprehensive toolkit for computer vision and natural language processing, offering pre-built models and training pipelines for tasks ranging from image classification and object detection to complex sequence modeling.

The project distinguishes itself by providing a flexible execution harness that manages the entire training lifecycle, including data ingestion and backpropagation. It supports scalable
- [matterport/mask_rcnn](https://awesome-repositories.com/repository/matterport-mask-rcnn.md) (25,564 ⭐) — This project is a TensorFlow and Keras implementation of the Mask R-CNN architecture. It provides a framework for performing simultaneous object detection and instance segmentation, transforming raw images into segmented masks and bounding boxes for individual object identification.

The toolset enables custom computer vision training through fine-tuning pre-trained weights and integrating user-provided datasets. It includes capabilities for distributed GPU training to accelerate the optimization of large vision models.

The framework covers model evaluation using standard precision metrics an
- [gaomingqi/track-anything](https://awesome-repositories.com/repository/gaomingqi-track-anything.md) (6,936 ⭐) — Track-Anything is an AI-driven video object segmentation and tracking system. It utilizes the Segment Anything Model to isolate and mask multiple objects across video frames, providing tools for automated mask propagation and background-filling inpainting.

The system distinguishes itself through a multi-object segmentation pipeline that can follow several distinct targets simultaneously. It includes a video inpainting utility to remove tracked objects and replace them with synthesized background content, as well as temporal mask refinement to correct tracking drift.

The project covers broad
- [microsoft/computervision-recipes](https://awesome-repositories.com/repository/microsoft-computervision-recipes.md) (9,866 ⭐) — This project is a collection of educational resources and implementation frameworks providing deep learning model recipes, code samples, and step-by-step guides for computer vision tasks. It organizes complex workflows into modular recipes and implementation guides to facilitate the building of image and video analysis models.

The framework focuses on specialized vision capabilities, including an image similarity framework for fast retrieval and re-ranking, human pose estimation, and video action recognition. It also provides specific tools for crowd density estimation and document image clea
- [olafenwamoses/imageai](https://awesome-repositories.com/repository/olafenwamoses-imageai.md) (8,867 ⭐) — ImageAI is a Python computer vision library providing a suite of tools for image classification, object detection, and video analytics. It functions as an integrated framework for locating and labeling objects in static images and video streams, utilizing deep learning models for identification and categorization.

The project includes a model training toolkit that allows for the creation of custom classifiers and detectors through scratch training or transfer learning. It features a GPU-accelerated inference engine to increase processing speed for vision tasks and includes specialized utiliti
- [facebookresearch/sam2](https://awesome-repositories.com/repository/facebookresearch-sam2.md) (19,389 ⭐) — This project is a foundation model and research toolkit designed for promptable object segmentation and temporal tracking. It provides a unified framework for isolating specific regions or objects within both static images and dynamic video sequences.

The system distinguishes itself through a streaming memory architecture that maintains temporal consistency by storing and retrieving object features across frames. This mechanism allows the model to resolve occlusions and preserve object identity even when targets move out of view or change appearance. By utilizing a shared backbone for both im
- [facebookresearch/detectron2](https://awesome-repositories.com/repository/facebookresearch-detectron2.md) (34,548 ⭐) — Detectron2 is a PyTorch computer vision framework and visual recognition platform designed for training and deploying models for object detection, image segmentation, and visual recognition. It provides a research-oriented environment for training complex vision models with multi-GPU acceleration.

The project includes a specialized object detection library for identifying and locating multiple objects via bounding boxes, as well as an image segmentation toolkit for creating pixel-level masks through instance, semantic, and panoptic segmentation. Additionally, it features a human pose estimati
- [facebookresearch/maskrcnn-benchmark](https://awesome-repositories.com/repository/facebookresearch-maskrcnn-benchmark.md) (9,370 ⭐) — This project is a modular PyTorch framework for training and evaluating object detection and instance segmentation models. It serves as a computer vision research tool and a deep learning inference engine designed to identify object locations, classes, and pixel-level masks within images.

The framework implements a two-stage inference pipeline that utilizes region proposal networks and a symmetric mask-head architecture. It provides specialized capabilities for instance segmentation, object bounding box detection, and human pose estimation via anatomical keypoint detection.

The system includ
- [foundationvision/bytetrack](https://awesome-repositories.com/repository/foundationvision-bytetrack.md) (6,492 ⭐) — ByteTrack is a multi-object tracking framework that implements the ByteTrack algorithm, an ECCV 2022 method designed to recover occluded objects and reduce trajectory fragmentation. The core innovation of the project is its association algorithm, which processes every detection box—including low-confidence ones—by using separate high and low score thresholds, Kalman filter motion prediction, and Hungarian algorithm matching to produce consistent object identities across video frames.

The project distinguishes itself by its comprehensive approach to handling occlusions and fragmented trajector
- [facebookresearch/slowfast](https://awesome-repositories.com/repository/facebookresearch-slowfast.md) (7,377 ⭐) — SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset for video action recognition, enabling the training and evaluation of models designed to classify complex activities and objects within video sequences.

The framework is distinguished by its use of dual-pathway spatiotemporal sampling to capture both slow and fast motions. It supports self-supervised video learning for pre-training models on unlabeled data and employs multigrid spatiotemporal training to optimize learning across multiple spatial and temporal resolutions.

The
- [open-mmlab/mmdetection](https://awesome-repositories.com/repository/open-mmlab-mmdetection.md) (32,756 ⭐) — This project is a modular research toolkit designed for developing, training, and evaluating deep learning models for object detection, segmentation, and video instance tracking. It provides a flexible training engine that manages complex neural network execution, including distributed training, custom lifecycle hooks, and weight optimization. The framework is built around a hierarchical configuration system that allows users to define architectures, data pipelines, and training hyperparameters through composable, inheritable files.

The project distinguishes itself through its highly modular
- [roboflow/rf-detr](https://awesome-repositories.com/repository/roboflow-rf-detr.md) (5,643 ⭐) — RF-DETR is a Python library for training and deploying object detection, instance segmentation, and keypoint detection models built on a vision transformer architecture. It provides a unified command-line interface and Python API for the full workflow, from fine-tuning pretrained checkpoints on custom datasets to running inference on images, video files, and live camera streams.

The project supports training on datasets in COCO or YOLO format, with automatic format detection and configurable augmentation pipelines. Models can be exported to ONNX, TFLite, or TensorRT for deployment across edge
- [open-mmlab/mmaction2](https://awesome-repositories.com/repository/open-mmlab-mmaction2.md) (5,066 ⭐) — mmaction2 is a PyTorch video understanding toolbox designed for training and evaluating deep learning models. It serves as a framework for action recognition, temporal localization, and spatio-temporal action detection, providing specialized tools for both pixel-based video analysis and skeleton-based action recognition.

The project distinguishes itself through a modular architecture featuring registry-based component discovery and hierarchical, config-driven model assembly. It supports multi-modal feature fusion, integrating RGB frames, optical flow, and audio, and includes capabilities for
- [ux-decoder/segment-everything-everywhere-all-at-once](https://awesome-repositories.com/repository/ux-decoder-segment-everything-everywhere-all-at-once.md) (4,790 ⭐) — This project is a multi-modal image segmentation framework and a text-to-mask vision model. It serves as a SAM-based visual segmenter designed to isolate distinct objects within images and video by converting natural language prompts and other inputs into pixel-level semantic masks.

The system functions as a multi-modal image segmentation framework that integrates text, image, and audio signals to generate masks. It includes an interactive video object tracker that isolates and tracks visual entities across video frames using referring images or textual queries.

The framework provides capabi