awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
THUDM avatar

THUDM/CogVideo

0
View on GitHub↗

CogVideo

CogVideo is a generative video framework that uses diffusion models and transformer-based architectures to synthesize high-resolution video clips. It functions as both a text-to-video and image-to-video generator, converting textual descriptions or static images into temporal visual sequences.

The system integrates large language model capabilities to expand short user prompts into detailed descriptions for better visual alignment. It supports the animation of static images through latent seeding and provides the ability to extend the length of existing video sequences.

The project includes tools for video analysis, such as automatic caption generation, and supports model fine-tuning to adjust weights for specific visual styles. Computational efficiency is addressed through model weight quantization and parallel inference across multiple graphics processors.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Text-to-Video Generators - Synthesizes high-resolution video clips from detailed textual descriptions using diffusion and transformer-based architectures.
  • Image-to-Video Generation - Provides the capability to animate static images into video sequences using reference images and text prompts.
  • Diffusion Models - Utilizes a diffusion process to generate realistic video content starting from noise.
  • Latent Space Generative Models - Employs a transformer-based latent space with self-attention to ensure temporal consistency across video frames.
  • Video Synthesis - Implements a diffusion-based architecture to synthesize high-resolution video clips from latent representations.
  • Video Generation - Operates as a deep learning model for synthesizing high-resolution video from prompts and images.
  • Prompt Expansion - Integrates a large language model to expand short user prompts into detailed descriptions to improve video generation quality.
  • Prompt Expanders - Integrates a language model to expand short user prompts into detailed descriptions for improved visual alignment.
  • Latent Conditioning Mechanisms - Uses static images as latent seeds to provide spatial guidance for subsequent frame generation.
  • Inference Optimization - Optimizes video generation through a combination of weight quantization and parallel GPU inference.
  • Model Fine-Tuning - Supports fine-tuning of pre-trained model weights to achieve specific visual styles or quality improvements.
  • Multi-GPU Distribution - Distributes model weights across multiple GPUs to enable the generation of high-resolution video.
  • Parallel Inference Orchestrators - Distributes the video generation workload across multiple graphics processors to reduce computation time.
  • Weight Quantization - Reduces model parameter precision via quantization to lower memory overhead on consumer hardware.
  • Temporal Sequence Extension - Provides the ability to extend the length of existing video sequences to produce longer, continuous clips.
  • Generation Platforms - Large-scale text-to-video generation model and platform.
  • Generative AI Models - Direct text-to-video generation model.
  • Video and Animation - Text-to-video generation model.
  • Video Generation - Large-scale text-to-video generation model.
  • Video Generation - Large-scale text-to-video generation framework.
  • Video Generation Models - Large-scale text-to-video generation framework.
12,792 stars·1,307 forks·Python·Apache-2.0·61 views

Star history

Star history chart for thudm/cogvideoStar history chart for thudm/cogvideo

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Projects sharing features with CogVideo

These projects share indexed features with CogVideo. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • zai-org/cogvideozai-org avatar

    zai-org/CogVideo

    12,790View on GitHub↗

    CogVideo is a video generation framework and large language model architecture designed for synthesizing high-resolution video clips from natural language descriptions and images. It functions as a text-to-video and image-to-video generator, while also providing a model for video captioning to analyze visual content into descriptive text summaries. The system supports animating static images into motion sequences and transforming series of images into video based on prompts. It includes capabilities for extending the length of generated video clips to create longer sequences of motion. The f

    Pythoncogvideoximage-to-videollm
    View on GitHub↗12,790
  • pku-yuangroup/open-sora-planPKU-YuanGroup avatar

    PKU-YuanGroup/Open-Sora-Plan

    12,202View on GitHub↗

    Open-Sora-Plan is a text-to-video framework and distributed video training system. It utilizes a diffusion transformer architecture and large language model components to transform written descriptions or image prompts into high-quality video sequences. The system features a distributed infrastructure designed for large-scale video training and inference. It employs sequence parallelism to split high-resolution or long-duration video samples across multiple GPUs and uses a sparse attention mechanism to increase processing speed. The project includes capabilities for both text-to-video and im

    Python
    View on GitHub↗12,202
  • hpcaitech/open-sorahpcaitech avatar

    hpcaitech/Open-Sora

    29,919View on GitHub↗

    Open-Sora is a video generation framework designed to produce cinematic sequences from text prompts and images. It functions as a generative system that transforms written descriptions or reference images into video content featuring realistic textures and lighting. The project includes a dedicated prompt engineering tool that uses large language models to expand simple user inputs into detailed descriptions. It also features a motion controller for adjusting movement intensity in generated sequences and evaluating motion levels in existing video files. The framework incorporates text-to-vid

    Python
    View on GitHub↗29,919
  • nvlabs/sanaNVlabs avatar

    NVlabs/Sana

    8,310View on GitHub↗

    Sana is a framework for high-resolution image and video synthesis based on a linear diffusion transformer. It provides a toolkit for the training, fine-tuning, and execution of text-to-image and text-to-video models, as well as a video generative world model capable of simulating physical environments with precise spatial control. The project is distinguished by its use of linear complexity layers to handle high resolutions and its support for long-form, minute-length video generation in real time. It implements a two-stage inference paradigm that separates structural generation from visual t

    Python
    View on GitHub↗8,310
Compare all 30 related projects→

Frequently asked questions

What does thudm/cogvideo do?

CogVideo is a generative video framework that uses diffusion models and transformer-based architectures to synthesize high-resolution video clips. It functions as both a text-to-video and image-to-video generator, converting textual descriptions or static images into temporal visual sequences.

What are the main features of thudm/cogvideo?

The main features of thudm/cogvideo are: Text-to-Video Generators, Image-to-Video Generation, Diffusion Models, Latent Space Generative Models, Video Synthesis, Video Generation, Prompt Expansion, Prompt Expanders.

Which projects share features with thudm/cogvideo?

Projects with overlapping indexed features include: zai-org/cogvideo — CogVideo is a video generation framework and large language model architecture designed for synthesizing… pku-yuangroup/open-sora-plan — Open-Sora-Plan is a text-to-video framework and distributed video training system. It utilizes a diffusion transformer… hpcaitech/open-sora — Open-Sora is a video generation framework designed to produce cinematic sequences from text prompts and images. It… nvlabs/sana — Sana is a framework for high-resolution image and video synthesis based on a linear diffusion transformer. It provides… ailab-cvc/videocrafter — Videocrafter is a latent diffusion model designed for AI video synthesis. It functions as both a text-to-video and… tencent-hunyuan/hunyuanvideo-1.5 — HunyuanVideo-1.5 is a video generation foundation model and text-to-video diffusion framework. It utilizes a latent…