How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
In this paper, we conduct the first work to propose the concept of indirect jailbreak and achieve Retrieval-Augmented Generation (RAG) via LangChain. Building on this, we further design a novel method of indirect jailbreak attack, termed Poisoned-LangChain (PLC), which leverages a poisoned…
This is the official repo of the paper "Attack Prompt Generation for Red Teaming and Defending Large Language Models" accepted to Findings of EMNLP 2023.
This repository contains code and data for "FUZZLLM: A Novel and Universal Fuzzing Framework for Discovering Jailbreak Vulnerabilities in LLMs" (accepted to ICASSP 2024). Our work was also invited to be presented at one of the top hacker conventions – ShmooCon 2024. arXiv
The main features of rainjamesy/fuzzllm are: Jailbreak Attack Methods.
Open-source alternatives to rainjamesy/fuzzllm include: agencyenterprise/promptinject — PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the… cam-fss/jailbreak-langchain — In this paper, we conduct the first work to propose the concept of indirect jailbreak and achieve Retrieval-Augmented… chawins/pal — Chawin Sitawarin 1 Norman Mu 1 David Wagner 1 Alexandre Araujo 2. czycurefun/ijbr — The respositiy is public package of the paper titled "Play Guessing Game with LLM: Indirect Jailbreak Attack with… damo-nlp-sg/multilingual-safety-for-llms — 📄 Paper • 🤗 Dataset. aatrox103/sap — This is the official repo of the paper "Attack Prompt Generation for Red Teaming and Defending Large Language Models"…
