1 Repo
Awesome GitHub RepositoriesRing Attention Distributors
Splits a long sequence into blocks and distributes them across devices in a ring topology, computing attention incrementally to handle sequences longer than a single device's memory.
Distinct from Long-Context Sequence Processors: Distinct from Long-Context Sequence Processors: focuses on the ring topology distribution across devices rather than general memory-efficient sequence management.
Explore 1 awesome GitHub repository matching data & databases · Ring Attention Distributors. Refine with filters or upvote what's useful.
Awesome Ring Attention Distributors GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- infrasys-ai/aiinfra
Infrasys-AI/AIInfra
7,414Auf GitHub ansehenSplits long sequences into blocks distributed across devices in a ring topology for memory-efficient attention.
Jupyter Notebookaiinfraaisystem
