How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
The implementation of paper CLIP2Video: Mastering Video-Text Retrieval via Image CLIP.
Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling
SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset for video action recognition, enabling the training and evaluation of models designed to classify complex activities and objects within video sequences. The framework is distinguished by its use of dual-pathway spatiotemporal sampling to capture both slow and fast motions. It supports self-supervised video learning for pre-training models on unlabeled data and employs multigrid spatiotemporal training to optimize learning across multiple spatial and temporal resolutions. The
LLaVA-NeXT is a multimodal large language model framework and training toolkit designed to process interleaved images and video sequences to generate text. It functions as a visual language model that combines vision encoders with language models to perform complex reasoning, question answering, and video understanding. The system is capable of analyzing high-resolution images and temporal video frames to describe events, summarize actions, and reason across multiple visual inputs. It supports the interpretation of documents and charts, spatial environment analysis, and the generation of desc
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
The main features of arrowluo/clip4clip are: Video Retrieval Models, Video Understanding.
Projects with overlapping indexed features include: jayleicn/clipbert — Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling. cryhanfang/clip2video — The implementation of paper CLIP2Video: Mastering Video-Text Retrieval via Image CLIP. llava-vl/llava-next — LLaVA-NeXT is a multimodal large language model framework and training toolkit designed to process interleaved images… facebookresearch/slowfast — SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset… facebookresearch/vjepa2 — vjepa2 is a joint-embedding predictive architecture and video self-supervised learning framework. It functions as a… open-mmlab/mmaction2 — mmaction2 is a PyTorch video understanding toolbox designed for training and evaluating deep learning models. It…