1 repo
High-performance tensor computation engines written in C++.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · C++ Inference Backends. Refine with filters or upvote what's useful.
GPT4All is a cross-platform runtime environment designed to execute large language models directly on local consumer hardware. By leveraging an optimized C++ inference backend, it enables private, offline AI interactions without requiring an internet connection or external cloud services. The project provides a compreh