# wangzhaode/mnn-llm

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/wangzhaode-mnn-llm).**

1,617 stars · 178 forks · C++ · Apache-2.0

## Links

- GitHub: https://github.com/wangzhaode/mnn-llm
- awesome-repositories: https://awesome-repositories.com/repository/wangzhaode-mnn-llm.md

## Topics

`baichuan2-7b` `chatglm-6b` `chatglm2-6b` `codegeex2-6b` `cpp` `cuda` `mnn` `opencl` `qwen-7b`

## Description

llm deploy project based mnn. This project has merged into MNN.

## Tags

### Part of an Awesome List

- [Model Deployment](https://awesome-repositories.com/f/awesome-lists/ai/model-deployment.md) — Lightweight inference engine for running models on mobile and edge hardware.
- [Model Deployment](https://awesome-repositories.com/f/awesome-lists/devops/model-deployment.md) — Listed in the “Model Deployment” section of the Llm Course awesome list.