1 dépôt
Build configuration enabling external CMake projects to fetch and link the inference engine as a shared library dependency.
Distinct from Shared Library Development: Distinct from Shared Library Development: focuses on CMake FetchContent integration for consuming the library, not general shared library creation.
Explore 1 awesome GitHub repository matching operating systems & systems programming · CMake FetchContent Integration. Refine with filters or upvote what's useful.
gemma.cpp is a C++ inference engine for Gemma, PaliGemma, and Griffin language models, designed to run directly on-device without Python dependencies. It provides a self-contained runtime that loads quantized model weights and performs text generation on CPU or GPU, along with a model checkpoint converter that transforms PyTorch or Keras checkpoints into a compact binary format for fast loading. The engine supports multiple model architectures, including the Griffin recurrent architecture with gated linear recurrent layers and sliding-window attention for efficient long-sequence handling, as
Compiles the inference engine into a standalone shared library for linking into external CMake projects via FetchContent.