How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
gpt-instruct is a packaged set of custom system prompts designed to bypass safety refusals in OpenAI Codex and GPT models, together with a test harness that measures how well those prompts work. The prompts are deployed by installing a downloadable archive into the Codex configuration directory and setting a single top-level config entry that points at the prompt file.
The main features of mdx-tom/gpt-instruct are: Jailbreak Prompts, Custom Prompt File Deployers, Bypass Resistance Benchmarks, LLM Evaluation, Hybrid Human-Reviewed Judging, Identity-Matched Prompt Score Comparisons, Model Red-Teaming, Manual Refusal Verdict Logs.
Projects with overlapping indexed features include: arize-ai/phoenix — Arize Phoenix is an LLM observability platform and evaluation framework designed to capture execution traces and… verazuo/jailbreak_llms — This project is a comprehensive ecosystem of frameworks, toolkits, and datasets designed to evaluate model… cyberalbsecop/awesome_gpt_super_prompting — This repository is a collection of specialized toolsets and libraries for large language model prompt engineering and… giskard-ai/giskard — Giskard is an evaluation framework, testing library, and quality monitoring system for large language models and AI… leondz/garak — Garak is a suite of tools for measuring AI reliability, scanning for vulnerabilities, and automating security… agenta-ai/agenta — Agenta is a Prompt Ops lifecycle manager and prompt management platform that decouples prompt engineering from…
Arize Phoenix is an LLM observability platform and evaluation framework designed to capture execution traces and monitor large language model applications. It serves as a prompt management system for versioning and testing templates, and as a self-hosted AI operations infrastructure for managing telemetry and experiments. The platform differentiates itself through a specialized embedding visualization tool used to detect data drift and optimize vector search. It provides a comprehensive evaluation suite that utilizes judge-based evaluators and ground-truth datasets to score model outputs, and
This project is a comprehensive ecosystem of frameworks, toolkits, and datasets designed to evaluate model vulnerabilities and analyze jailbreak patterns. It serves as an adversarial testing framework and research toolkit for measuring the effectiveness of safety guardrails in large language models. The system includes a library of real-world prompt injection datasets harvested from social media to study bypass strategies. It provides specialized tools for semantic attack analysis and prompt visualization, allowing for the mapping of relationships between adversarial prompts to discover commo
This repository is a collection of specialized toolsets and libraries for large language model prompt engineering and security testing. It provides a library of advanced templates and frameworks designed to optimize the quality and specificity of model responses. The project includes resources for red teaming and security research, featuring a repository of prompts designed to bypass safety filters and operational constraints. It also provides techniques for system prompt extraction to reveal the internal instructions and configurations of AI personas. The collection covers a broader surface
Giskard is an evaluation framework, testing library, and quality monitoring system for large language models and AI agents. It serves as a toolkit for quantifying model performance and reliability, providing specialized capabilities for validating retrieval-augmented generation pipelines. The project distinguishes itself through an automated red teaming tool and security scanner designed to identify vulnerabilities, prompt injections, and safety risks. It utilizes adversarial probing and synthetic edge case generation to quantify model robustness and detect information disclosure. The platfo