4 个仓库
Servers that expose guard validation logic through HTTP endpoints for remote clients, such as Flask-based REST APIs.
Distinct from LLM Inference Servers: Distinct from LLM Inference Servers: focuses on hosting guard validation logic, not on serving the language model itself.
Explore 4 awesome GitHub repositories matching artificial intelligence & ml · Guardrail Servers. Refine with filters or upvote what's useful.
Guardrails is a Python SDK that wraps calls to large language models with configurable validation pipelines, corrective actions, and structured output generation. It provides a unified API layer that connects to over 100 language models, applying consistent validation, streaming, and error-handling across providers. The framework validates and corrects model responses against safety and quality rules, detecting and mitigating risks in both inputs and outputs using pre-built and custom validators. The project distinguishes itself through a validator-pipeline architecture that sequentially appl
Provides a Flask-based REST server that exposes guard validation logic through HTTP endpoints for remote clients.
NeMo-Guardrails is a toolkit for adding programmable safety constraints and dialogue boundaries to large language model conversational systems. It functions as security middleware that intercepts inputs and outputs to block prompt injections, jailbreaks, and sensitive data leaks, while providing a conversational dialogue manager to define structured interaction flows through configuration files. The framework includes a hallucination filter to screen model outputs for factual accuracy and a specialized modeling language for defining conversational flows and constraints. It provides capabiliti
Exposes guard validation logic through an HTTP API server for remote client integration.
Provides a Python API and server to run LLM inference with enforced safety guardrails.
Plano is an AI agent orchestrator and LLM gateway proxy that unifies access to multiple AI providers through a single interoperable interface. It functions as a model routing engine that decouples applications from specific vendors using semantic aliases, allowing traffic to be shifted between providers without modifying application code. The system distinguishes itself with intent-based agent routing, which directs prompts to specialized agents based on semantic analysis. It features an interceptor-based filter chain system that acts as guardrail middleware to enforce safety policies, rewrit
Executes LLM inference through a guardrails layer that enforces safety policies on inbound and outbound traffic.