1 个仓库
Awesome GitHub RepositoriesInference Optimizations
Techniques specifically designed to reduce the runtime latency and memory footprint of diffusion models.
Distinct from Diffusion Models: Covers the holistic application of quantization and distillation for inference, distinct from general diffusion model interfaces.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Inference Optimizations. Refine with filters or upvote what's useful.
Awesome Inference Optimizations GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- thu-ml/turbodiffusion
thu-ml/TurboDiffusion
3,339在 GitHub 上查看TurboDiffusion is a video diffusion inference engine and generator designed to create high-resolution videos from text prompts and images. It provides a runtime environment for executing optimized diffusion model checkpoints with a focus on reducing latency and GPU memory usage. The project features a specialized training framework for aligning sparse-linear attention models with pretrained full-attention models. This system includes capabilities for sparse attention parameter merging and sparse-linear model alignment to reduce computational costs during inference while maintaining output qua
Reduces inference time and GPU memory usage through quantization, timestep distillation, and attention acceleration.
Pythonai-infraconsistency-modeldiffusion-models
