How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
The respositiy is public package of the paper titled "Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues" submitted to ACL 2024.
This is the official repo of the paper "Attack Prompt Generation for Red Teaming and Defending Large Language Models" accepted to Findings of EMNLP 2023.
In this paper, we conduct the first work to propose the concept of indirect jailbreak and achieve Retrieval-Augmented Generation (RAG) via LangChain. Building on this, we further design a novel method of indirect jailbreak attack, termed Poisoned-LangChain (PLC), which leverages a poisoned…
The main features of cam-fss/jailbreak-langchain are: Jailbreak Attack Methods.
Projects with overlapping indexed features include: agencyenterprise/promptinject — PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the… chawins/pal — Chawin Sitawarin 1 Norman Mu 1 David Wagner 1 Alexandre Araujo 2. czycurefun/ijbr — The respositiy is public package of the paper titled "Play Guessing Game with LLM: Indirect Jailbreak Attack with… damo-nlp-sg/multilingual-safety-for-llms — 📄 Paper • 🤗 Dataset. dtc7w3pq/response-attack — Response Attack: Exploiting Contextual Priming to Jailbreak Large Language Models. aatrox103/sap — This is the official repo of the paper "Attack Prompt Generation for Red Teaming and Defending Large Language Models"…