1 repo
Documentation or tooling tracking operational support across diverse hardware backends.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Hardware Compatibility Matrices. Refine with filters or upvote what's useful.
Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU archi