1 Repo
Awesome GitHub RepositoriesMoE Batch Cost Calculators
Tools that compute total inference FLOPs for batches processed through activated experts and gating networks.
Distinct from Inference Batching: Distinct from Inference Batching: focuses on FLOPs estimation for MoE architectures, not general request grouping.
Explore 1 awesome GitHub repository matching development tools & productivity · MoE Batch Cost Calculators. Refine with filters or upvote what's useful.
Awesome MoE Batch Cost Calculators GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- infrasys-ai/aiinfra
Infrasys-AI/AIInfra
7,414Auf GitHub ansehenCalculates inference FLOPs for batches processed through MoE expert and gating networks.
Jupyter Notebookaiinfraaisystem
