10 repositorios
Security controls for interactions between models and external tools.
Distinguishing note: Focuses on protocol-level security for context sharing.
Explore 10 awesome GitHub repositories matching security & cryptography · Model Context Protocol Security. Refine with filters or upvote what's useful.
The OWASP Cheat Sheet Series is a comprehensive, community-driven repository of concise security best practices and defensive coding patterns. It serves as a centralized knowledge base for developers and security professionals, providing actionable guidance to secure applications across the entire software development lifecycle. The project covers a vast array of security domains, ranging from fundamental web application hardening and authentication protocols to specialized controls for modern infrastructure and artificial intelligence systems. What distinguishes this project is its decentral
Ensures safe and authorized interaction between artificial intelligence models and external tools via context protocols.
Model Context Protocol is a standardized framework for connecting large language models to external data sources and executable tools. It enables the creation of a universal interface where servers expose tools, resources, and prompts that can be discovered and utilized by various AI clients. The protocol utilizes a JSON-RPC message system that is transport-agnostic, supporting both standard input/output for local processes and HTTP with server-sent events for remote connections. It emphasizes security and control by delegating model sampling to the client to keep API keys secure from servers
Generates content via a client to ensure API keys remain secure and are not exposed to servers.
Superagent is an AI safety platform that protects applications from prompt injections, data leaks, and harmful outputs through built-in guardrails. It functions as a prompt injection detection system, data redaction tool, and red team testing tool, automatically removing personally identifiable information and protected health data from AI inputs and outputs while scanning image uploads with vision AI to detect visual prompt injection attacks before processing. The platform routes every prompt through a sequential pipeline of safety checks including injection detection, data redaction, and co
Scans image uploads with vision AI to detect and block visual prompt injection attacks before processing.
Trail of Bits wraps Model Context Protocol apps to defend against prompt injection via tool descriptions and ANSI terminal escape codes.
El agent-governance-toolkit es un framework para aplicar políticas de seguridad, gestionar identidades de confianza cero (zero-trust) y aislar (sandbox) la ejecución de agentes de IA autónomos. Proporciona una capa de gobernanza diseñada para controlar el comportamiento de los agentes mediante el uso de un motor de políticas de seguridad, gestión de identidad criptográfica y un sandbox de ejecución en tiempo de ejecución. El proyecto se distingue por un sistema de anillos de privilegios de múltiples niveles y una malla de identidad criptográfica que asegura la comunicación entre entidades autónomas. Implementa un mecanismo de puntuación de confianza basado en decaimiento para rastrear la confiabilidad de la entidad y utiliza registros de auditoría encadenados por hash y a prueba de manipulaciones para mantener un historial verificable de ejecución. El toolkit cubre una amplia gama de áreas de capacidad, incluyendo seguridad de prompts para defenderse contra ataques de inyección, mapeo automatizado de cumplimiento frente a estándares regulatorios y orquestación de flujos de trabajo autónomos utilizando patrones de saga. También cuenta con monitoreo de flota para rastrear la salud y los límites de gasto, así como aislamiento de ejecución de herramientas para restringir el acceso no autorizado a recursos. Se proporciona una interfaz de línea de comandos para ejecutar señales de control, validar políticas de gobernanza y gestionar la instalación de extensiones.
Provides a deterministic pattern scanner to verify that defensive language is present in system prompts before deployment.
OpenSquilla es un framework de orquestación de agentes LLM diseñado para coordinar flujos de trabajo de IA de varios pasos y la ejecución de herramientas mediante grafos acíclicos dirigidos. Funciona como un sistema centralizado para gestionar paquetes de habilidades especializadas y ejecutar secuencias de razonamiento complejas. El proyecto se distingue por una pasarela de enrutamiento que dirige las tareas a diferentes proveedores de IA según la complejidad, el coste y el rendimiento. Utiliza un sistema de memoria de IA de varios niveles que organiza el conocimiento de trabajo, episódico y semántico mediante embeddings locales y SQLite, junto con un sandbox de ejecución seguro que aísla el código generado por el agente mediante perfiles de permisos basados en riesgos. La plataforma cubre una amplia gama de capacidades, incluyendo despliegue multicanal en web y plataformas de mensajería, programación automatizada de tareas mediante cron y un puente de Model Context Protocol para conectar con herramientas externas. También proporciona herramientas integrales de monitoreo y observabilidad para rastrear costes de tokens, auditar decisiones en tiempo de ejecución y gestionar un catálogo de habilidades reutilizables. El sistema incluye utilidades de línea de comandos para la inicialización del espacio de trabajo y la gestión del ciclo de vida de las habilidades.
Deno AI Agent escapes metadata and tool results using XML to close common prompt injection attack vectors.
Atmosphere is a Java-based framework for building and coordinating AI agents. It provides a real-time transport layer for streaming data via WebSockets, SSE, gRPC, and WebTransport, alongside a multi-agent orchestration framework for managing agent fleets through sequential, parallel, and graph-based execution workflows. The project features a durable workflow engine that persists agent state as snapshots, allowing long-running tasks to survive system restarts and incorporate human-in-the-loop approvals. It also implements Model Context Protocol servers to expose tools, resources, and prompt
Uses confinement blocks prepended to system prompts to ensure agents adhere to defined security boundaries.
This repository is a collection of specialized toolsets and libraries for large language model prompt engineering and security testing. It provides a library of advanced templates and frameworks designed to optimize the quality and specificity of model responses. The project includes resources for red teaming and security research, featuring a repository of prompts designed to bypass safety filters and operational constraints. It also provides techniques for system prompt extraction to reveal the internal instructions and configurations of AI personas. The collection covers a broader surface
Provides security controls and prompt-based rules to defend against malicious prompt injection attacks.
This project is a comprehensive ecosystem of frameworks, toolkits, and datasets designed to evaluate model vulnerabilities and analyze jailbreak patterns. It serves as an adversarial testing framework and research toolkit for measuring the effectiveness of safety guardrails in large language models. The system includes a library of real-world prompt injection datasets harvested from social media to study bypass strategies. It provides specialized tools for semantic attack analysis and prompt visualization, allowing for the mapping of relationships between adversarial prompts to discover commo
Ships a library of real-world prompt injection datasets harvested from social media to study bypass strategies.
This project is an educational and research platform designed to simulate security vulnerabilities within AI-integrated systems and Model Context Protocol implementations. It provides a controlled environment where users can practice identifying and mitigating common attack vectors, such as prompt injection and unauthorized code execution, by interacting with intentionally insecure tools and protocol configurations. The platform distinguishes itself by offering a dedicated laboratory for auditing Model Context Protocol integrations. It exposes server-side functions as discoverable tools and p
Provides a dedicated laboratory for auditing the security posture of Model Context Protocol implementations and tool interactions.