How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
CVPR 2022 Official Pytorch Implementation for "Spatio-temporal Relation Modeling for Few-shot Action Recognition". SOTA Results for Few-shot Action Recognition
ECCV 2022 Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework
TaskMatrix is a multimodal AI chat interface and visual task orchestrator. It combines language models with visual recognition to enable the exchange, analysis, and modification of images within a conversational environment. The system coordinates multiple foundation models through orchestration pipelines that chain language, detection, and segmentation models. This allows for complex visual operations, such as using text instructions to guide image masking and executing modular inpainting workflows to edit specific image regions. The project includes a computer vision toolset for object det
AudioGPT is an LLM-driven audio framework and processing suite that uses large language models to orchestrate neural audio pipelines. It functions as a multimodal audio generator and processing system, integrating a collection of pretrained models to handle speech synthesis, sound generation, and audio manipulation. The system is distinguished by its ability to generate audio from diverse inputs, including text and images, and its capacity to produce synchronized talking head videos. It also operates as a neural speech translator, converting spoken language between different tongues while pre
[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
The main features of mcg-nju/videomae are: Perception Models, Video Understanding and Tracking.
Projects with overlapping indexed features include: anirudh257/strm — [CVPR 2022] Official Pytorch Implementation for "Spatio-temporal Relation Modeling for Few-shot Action Recognition".… botaoye/ostrack — [ECCV 2022] Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework. chenfei-wu/taskmatrix — TaskMatrix is a multimodal AI chat interface and visual task orchestrator. It combines language models with visual… chenxin-dlut/transt — Transformer Tracking (CVPR2021). cvlab-columbia/viper — Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning". aigc-audio/audiogpt — AudioGPT is an LLM-driven audio framework and processing suite that uses large language models to orchestrate neural…