1 repo
Computational frameworks designed to process input sequences through pre-trained model weights for text or data generation.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Generative AI Inference Engines. Refine with filters or upvote what's useful.
Llama is a computational framework and runtime environment designed for executing transformer-based neural networks locally. It functions as a generative AI inference engine, enabling the processing of input sequences through pre-trained model weights to produce text completions and structured data outputs directly on