# nvidia/triton-inference-server

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/nvidia-triton-inference-server).**

10,756 stars · 1,794 forks · Python · BSD-3-Clause

## Links

- GitHub: https://github.com/NVIDIA/triton-inference-server
- Homepage: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
- awesome-repositories: https://awesome-repositories.com/repository/nvidia-triton-inference-server.md

## Description

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

## Tags

### Part of an Awesome List

- [Infrastructure and Deployment](https://awesome-repositories.com/f/awesome-lists/devops/infrastructure-and-deployment.md) — Optimized cloud inferencing solution for GPUs.