# mosecorg/mosec

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/mosecorg-mosec).**

901 stars · 73 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/mosecorg/mosec
- Homepage: https://mosecorg.github.io/mosec/
- awesome-repositories: https://awesome-repositories.com/repository/mosecorg-mosec.md

## Description

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

## Tags

### Part of an Awesome List

- [Model Serving & Deployment](https://awesome-repositories.com/f/awesome-lists/ai/model-serving-deployment.md) — Provides a pipelined model server with dynamic batching.
- [Serving Frameworks](https://awesome-repositories.com/f/awesome-lists/devtools/serving-frameworks.md) — Serving framework featuring dynamic batching and pipelined stages.