1 repository
Systems for executing workloads on low-cost spot instances with fault-tolerance and elasticity.
Distinct from Fluid Compute Tasks: None of the candidates address the specific logic of handling preemptible/spot instance compute lifecycles for AI inference.
Explore 1 awesome GitHub repository matching devops & infrastructure · Preemptible Compute Management. Refine with filters or upvote what's useful.
AISystem is a comprehensive AI full-stack infrastructure project covering the entire pipeline from AI chip architecture to high-level training frameworks. It encompasses the development of AI compiler frameworks, inference engines, and distributed training orchestrators designed to coordinate workloads across a heterogeneous compute stack of CPUs, GPUs, and NPUs. The project focuses on the deep integration of software and hardware, employing software-hardware co-design to align tensor layouts with physical memory structures. It provides specialized capabilities for accelerating Transformer mo
Executes inference tasks on low-cost spot instances using elastic computing and fault-tolerant systems.