NeMo-Guardrails is a toolkit for adding programmable safety constraints and dialogue boundaries to large language model conversational systems. It functions as security middleware that intercepts inputs and outputs to block prompt injections, jailbreaks, and sensitive data leaks, while providing a conversational dialogue manager to define structured interaction flows through configuration files. The framework includes a hallucination filter to screen model outputs for factual accuracy and a specialized modeling language for defining conversational flows and constraints. It provides capabiliti
Garak is a suite of tools for measuring AI reliability, scanning for vulnerabilities, and automating security assessments through adaptive probing. It functions as a generative AI vulnerability scanner and evaluation tool designed to identify security gaps, hallucinations, and failure modes in language models. The framework provides a toolkit for red-teaming and safety assessments, utilizing a structured system of probes and detectors to calculate failure rates. It specifically scans for risks such as data leakage and prompt injection by recording model responses to adversarial inputs. The p
This project is no longer actively maintained. You are welcome to fork and continue its development on your own. Thank you for your interest and support.
PyRIT is an AI vulnerability assessment tool and security scanner designed to detect risks in large language model applications. It functions as a generative AI red teaming framework used to simulate adversarial attacks and identify weaknesses in system guardrails. The tool automates AI risk assessment by scanning generative AI components for security vulnerabilities. It utilizes automated testing and analysis to identify security gaps and prevent potential exploits through a consistent, repeatable process. The system incorporates asynchronous model orchestration to compare security postures
LLM Prompt Injection Detector
protectai/rebuff 的主要功能包括：AI Application Security, AI Security and Red Teaming, Detection and Monitoring, Guardrails and AI Safety, Red Teaming and Security。
protectai/rebuff 的开源替代品包括： mnns/llmfuzzer — This project is no longer actively maintained. You are welcome to fork and continue its development on your own. Thank… leondz/garak — Garak is a suite of tools for measuring AI reliability, scanning for vulnerabilities, and automating security… nvidia/nemo-guardrails — NeMo-Guardrails is a toolkit for adding programmable safety constraints and dialogue boundaries to large language… nvidia/garak — Garak is an AI model evaluation tool and vulnerability scanner designed for red teaming large language models and… azure/pyrit — PyRIT is an AI vulnerability assessment tool and security scanner designed to detect risks in large language model… protectai/llm-guard — LLM Guard is a security firewall and guardrail framework designed to scan and sanitize inputs and outputs for large…