1 repo
Middleware components for enforcing safety policies and content moderation on request streams.
Distinguishing note: Focuses on real-time stream interception for safety rather than static security scanning.
Explore 1 awesome GitHub repository matching security & cryptography · Content Guardrails. Refine with filters or upvote what's useful.
LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc
Intercepts request and response streams to apply content moderation and safety policy enforcement.