The implementation of paper CLIP2Video: Mastering Video-Text Retrieval via Image CLIP.
Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling
SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset for video action recognition, enabling the training and evaluation of models designed to classify complex activities and objects within video sequences. The framework is distinguished by its use of dual-pathway spatiotemporal sampling to capture both slow and fast motions. It supports self-supervised video learning for pre-training models on unlabeled data and employs multigrid spatiotemporal training to optimize learning across multiple spatial and temporal resolutions. The
LLaVA-NeXT is a multimodal large language model framework and training toolkit designed to process interleaved images and video sequences to generate text. It functions as a visual language model that combines vision encoders with language models to perform complex reasoning, question answering, and video understanding. The system is capable of analyzing high-resolution images and temporal video frames to describe events, summarize actions, and reason across multiple visual inputs. It supports the interpretation of documents and charts, spatial environment analysis, and the generation of desc
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
الميزات الرئيسية لـ arrowluo/clip4clip هي: Video Retrieval Models, Video Understanding.
تشمل البدائل مفتوحة المصدر لـ arrowluo/clip4clip: jayleicn/clipbert — Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling. cryhanfang/clip2video — The implementation of paper CLIP2Video: Mastering Video-Text Retrieval via Image CLIP. llava-vl/llava-next — LLaVA-NeXT is a multimodal large language model framework and training toolkit designed to process interleaved images… facebookresearch/slowfast — SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset… facebookresearch/vjepa2 — vjepa2 is a joint-embedding predictive architecture and video self-supervised learning framework. It functions as a… open-mmlab/mmaction2 — mmaction2 is a PyTorch video understanding toolbox designed for training and evaluating deep learning models. It…