ggerganovllama.cpp

Llama.cpp

AI & Machine Learning - Efficient inference of large language models on consumer hardware.
Inference and Serving - C/C++ implementation for running LLM inference.
Inference Engines - Efficient C/C++ implementation for running local language models.
Inference Frameworks - Efficient C/C++ implementation for running models on consumer hardware.
Language Models - Ports for running LLaMA-based models efficiently on CPUs.
Large Language Models - High-performance C/C++ implementation for running Llama models locally.

AI search

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

AI & Machine Learning - Efficient inference of large language models on consumer hardware.
Inference and Serving - C/C++ implementation for running LLM inference.
Inference Engines - Efficient C/C++ implementation for running local language models.
Inference Frameworks - Efficient C/C++ implementation for running models on consumer hardware.
Language Models - Ports for running LLaMA-based models efficiently on CPUs.
Large Language Models - High-performance C/C++ implementation for running Llama models locally.

Local LLM Execution - C/C++ port for running LLaMA models on consumer hardware.

Model Quantization - High-performance inference engine for running quantized models on consumer hardware.

Model Serving Engines - C/C++ port for running LLaMA models on local hardware.

Transformer Implementations - C/C++ port of the LLaMA model for efficient local execution.

LLM inference in C/C++