1 dépôt
Awesome GitHub RepositoriesMulti-Modal Encoder Parallelism
Techniques for distributing vision encoder workloads across multiple hardware devices.
Distinct from Tensor Parallelism: Focuses on multi-modal encoder distribution, distinct from general tensor parallelism for language layers.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Multi-Modal Encoder Parallelism. Refine with filters or upvote what's useful.
Awesome Multi-Modal Encoder Parallelism GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- sgl-project/sglang
sgl-project/sglang
29,079Voir sur GitHubSglang is a high-performance inference engine and serving system designed for large language and multimodal models. It provides a programmable interface for orchestrating complex generation workflows, enabling developers to coordinate multi-turn dialogues, tool invocations, and reasoning chains through a domain-specific language. The platform is built to support production-scale deployments, offering an OpenAI-compatible API that allows for integration with existing application ecosystems. The system distinguishes itself through a disaggregated architecture that separates compute-intensive pr
Distributes vision encoders across GPU sets to reduce communication overhead and improve throughput.
Pythonattentionblackwellcuda
