Lizonghang/prima.cpp

Features

• Inference and Serving - Distributed implementation for running large models on consumer hardware.
• Inference Frameworks - Optimized inference for large models on low-resource home clusters.