2 个仓库
Awesome GitHub RepositoriesTraining Data Compression
Compression techniques specifically designed to reduce the footprint of training datasets.
Distinct from Video Processing: Distinct from general video codecs by focusing on reducing training costs while preserving quality.
Explore 2 awesome GitHub repositories matching part of an awesome list · Training Data Compression. Refine with filters or upvote what's useful.
Awesome Training Data Compression GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- pku-yuangroup/open-sora-plan
PKU-YuanGroup/Open-Sora-Plan
12,163在 GitHub 上查看Open-Sora-Plan is a text-to-video framework and distributed video training system. It utilizes a diffusion transformer architecture and large language model components to transform written descriptions or image prompts into high-quality video sequences. The system features a distributed infrastructure designed for large-scale video training and inference. It employs sequence parallelism to split high-resolution or long-duration video samples across multiple GPUs and uses a sparse attention mechanism to increase processing speed. The project includes capabilities for both text-to-video and im
Reduces the size of video frames to lower training costs while preserving high image quality.
Python - facebookresearch/starspace
facebookresearch/Starspace
3,954在 GitHub 上查看Starspace 是一个向量嵌入框架，旨在训练文本和图像的高维表示。它作为一种机器学习系统，用于神经排序、文本分类和知识图谱嵌入，将不同的对象类型映射到共享的数值空间中，以促进检索和预测任务。 该系统包含用于知识图谱补全和链接预测的专用工具，通过在多关系向量空间中表示实体及其关系来实现。它还通过将输入映射到目标标签或候选项目，提供了语义内容推荐和大规模文本分类功能。 该框架涵盖了广泛的功能领域，包括基于相似度的实体排序、从文档或 n-gram 中提取向量嵌入，以及使用基于随机游走的训练。为了管理大数据集，它集成了基于磁盘的压缩数据加载和负采样优化。
Supports reading training data from compressed formats to minimize the disk footprint of large datasets.
C++
