awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
Back to greshake/llm-security

Open-source alternatives to Llm Security

30 open-source projects similar to greshake/llm-security, ranked by how many features they have in common. Compare stars, activity and what each one does to find the best Llm Security alternative.

  • trusted-ai/adversarial-robustness-toolboxTrusted-AI avatar

    Trusted-AI/adversarial-robustness-toolbox

    6,056View on GitHub↗

    The Adversarial Robustness Toolbox (ART) is an open-source library that provides a unified framework for evaluating, defending, and certifying machine learning models against adversarial threats. It wraps models from any framework behind a common estimator interface, enabling composable pipelines for attack generation, defense application, robustness certification, and privacy auditing across evasion, poisoning, and extraction threats. The library distinguishes itself by covering the full adversarial ML security lifecycle within a single toolkit. It supports gradient-based adversarial example

    Pythonadversarial-attacksadversarial-examplesadversarial-machine-learning
    View on GitHub↗6,056
  • agencyenterprise/promptinjectagencyenterprise avatar

    agencyenterprise/PromptInject

    500View on GitHub↗

    PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022

    Python
    View on GitHub↗500
  • azure/pyritAzure avatar

    Azure/PyRIT

    3,444View on GitHub↗

    PyRIT is an AI vulnerability assessment tool and security scanner designed to detect risks in large language model applications. It functions as a generative AI red teaming framework used to simulate adversarial attacks and identify weaknesses in system guardrails. The tool automates AI risk assessment by scanning generative AI components for security vulnerabilities. It utilizes automated testing and analysis to identify security gaps and prevent potential exploits through a consistent, repeatable process. The system incorporates asynchronous model orchestration to compare security postures

    Pythonai-red-teamgenerative-aired-team-tools
    View on GitHub↗3,444

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Find more with AI search
  • cam-fss/jailbreak-langchainCAM-FSS avatar

    CAM-FSS/jailbreak-langchain

    1View on GitHub↗

    In this paper, we conduct the first work to propose the concept of indirect jailbreak and achieve Retrieval-Augmented Generation (RAG) via LangChain. Building on this, we further design a novel method of indirect jailbreak attack, termed Poisoned-LangChain (PLC), which leverages a poisoned…

    View on GitHub↗1
  • chawins/palchawins avatar

    chawins/pal

    56View on GitHub↗

    Chawin Sitawarin 1 Norman Mu 1 David Wagner 1 Alexandre Araujo 2

    Python
    View on GitHub↗56
  • cleverhans-lab/cleverhanscleverhans-lab avatar

    cleverhans-lab/cleverhans

    6,443View on GitHub↗

    Cleverhans is an adversarial machine learning library and toolkit designed to generate adversarial examples, incorporate them into training loops, and benchmark the resilience of machine learning models. It provides a gradient-based attack framework for constructing both white-box and black-box attacks to identify model misclassifications. The project includes capabilities for model robustness benchmarking, allowing users to evaluate and verify how models resist evasion attacks and malicious input perturbations. It also facilitates adversarial training to increase a model's resistance to pert

    Jupyter Notebookbenchmarkingmachine-learningsecurity
    View on GitHub↗6,443
  • confident-ai/deepteamconfident-ai avatar

    confident-ai/deepteam

    1,320View on GitHub↗
    Pythonhacktoberfestllm-guardrailsllm-red-teaming
    View on GitHub↗1,320
  • corca-ai/awesome-llm-securitycorca-ai avatar

    corca-ai/awesome-llm-security

    1,611View on GitHub↗

    A curation of awesome tools, documents and projects about LLM Security.

    View on GitHub↗1,611
  • czycurefun/ijbrczycurefun avatar

    czycurefun/IJBR

    2View on GitHub↗

    The respositiy is public package of the paper titled "Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues" submitted to ACL 2024.

    Python
    View on GitHub↗2
  • damo-nlp-sg/multilingual-safety-for-llmsDAMO-NLP-SG avatar

    DAMO-NLP-SG/multilingual-safety-for-LLMs

    105View on GitHub↗

    📄 Paper • 🤗 Dataset

    View on GitHub↗105
  • dtc7w3pq/response-attackDtc7w3PQ avatar

    Dtc7w3PQ/Response-Attack

    37View on GitHub↗

    Response Attack: Exploiting Contextual Priming to Jailbreak Large Language Models

    Python
    View on GitHub↗37
  • fzakk/badreasonerFZaKK avatar

    FZaKK/BadReasoner

    9View on GitHub↗

    This repository is for our new work: "BadReasoner: Planting Tunable Overthinking Backdoors into Large Reasoning Models for Fun or Profit", feel free to propose your issues!! 😎

    Python
    View on GitHub↗9
  • godxuxilie/promptattackGodXuxilie avatar

    GodXuxilie/PromptAttack

    114View on GitHub↗

    This is the source code for the ICLR 2024 paper "An LLM can Fool Itself: A Prompt-Based Adversarial Attack", Xilie Xu (NUS), Keyi Kong (SDU), Ning Liu (SDU), Lizhen Cui (SDU), Di Wang (KAUST), Jingfeng Zhang (University of Auckland/RIKEN-AIP), Mohan Kankanhalli (NUS).…

    Python
    View on GitHub↗114
  • hkust-knowcomp/llm-multistep-jailbreakHKUST-KnowComp avatar

    HKUST-KnowComp/LLM-Multistep-Jailbreak

    37View on GitHub↗

    Paper Link: https://arxiv.org/pdf/2304.05197.pdf

    Python
    View on GitHub↗37
  • huizhang-l/codechameleonhuizhang-L avatar

    huizhang-L/CodeChameleon

    30View on GitHub↗

    This repository contains the code implementation for the paper CodeChameleon: Personalized Encryption Framework for Jailbreaking Large Language Models.

    Python
    View on GitHub↗30
  • jiep/offensive-ai-compilationjiep avatar

    jiep/offensive-ai-compilation

    1,393View on GitHub↗

    A curated list of useful resources that cover Offensive AI.

    HTML
    View on GitHub↗1,393
  • leondz/garakleondz avatar

    leondz/garak

    8,227View on GitHub↗

    Garak is a suite of tools for measuring AI reliability, scanning for vulnerabilities, and automating security assessments through adaptive probing. It functions as a generative AI vulnerability scanner and evaluation tool designed to identify security gaps, hallucinations, and failure modes in language models. The framework provides a toolkit for red-teaming and safety assessments, utilizing a structured system of probes and detectors to calculate failure rates. It specifically scans for risks such as data leakage and prompt injection by recording model responses to adversarial inputs. The p

    Python
    View on GitHub↗8,227
  • llm-dra/draLLM-DRA avatar

    LLM-DRA/DRA

    115View on GitHub↗

    Logo generated by GPT-4

    Python
    View on GitHub↗115
  • llm-gasp/gaspL

    llm-gasp/gasp

    0View on GitHub↗
    View on GitHub↗0
  • llmsecurity/masterkeyLLMSecurity avatar

    LLMSecurity/MasterKey

    38View on GitHub↗

    This is the replication package for the paper MASTERKEY: Automated Jailbreaking of Large Language Model Chatbots.

    Python
    View on GitHub↗38
  • luka-group/cognitiveoverloadluka-group avatar

    luka-group/CognitiveOverload

    8View on GitHub↗

    Code for our NAACL 2024 Paper "Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking"

    Python
    View on GitHub↗8
  • mnns/llmfuzzermnns avatar

    mnns/LLMFuzzer

    353View on GitHub↗

    This project is no longer actively maintained. You are welcome to fork and continue its development on your own. Thank you for your interest and support.

    Python
    View on GitHub↗353
  • naver-ai/joodnaver-ai avatar

    naver-ai/JOOD

    21View on GitHub↗

    Official implementation for "Playing the Fool: Jailbreaking LLMs and Multimodal LLMs with Out-of-Distribution Strategy"

    Python
    View on GitHub↗21
  • njunlp/renellmNJUNLP avatar

    NJUNLP/ReNeLLM

    162View on GitHub↗

    The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily".

    Python
    View on GitHub↗162
  • promptfoo/promptfoopromptfoo avatar

    promptfoo/promptfoo

    10,529View on GitHub↗

    Promptfoo is an evaluation framework designed for testing, benchmarking, and red-teaming language models and agentic workflows. It provides a unified environment to run prompts against multiple providers, allowing developers to systematically validate model outputs against objective assertions, semantic similarity metrics, and custom grading rubrics. The platform distinguishes itself through a provider-agnostic execution layer and a stateful orchestrator capable of simulating multi-turn conversations and complex tool-use trajectories. It includes a dedicated adversarial mutation pipeline that

    TypeScriptcici-cdcicd
    View on GitHub↗10,529
  • promptlabs/prompt-hacking-resourcesPromptLabs avatar

    PromptLabs/Prompt-Hacking-Resources

    635View on GitHub↗

    A list of curated resources for people interested in AI Red Teaming, Jailbreaking, and Prompt Injection

    View on GitHub↗635
  • protectai/ai-exploitsprotectai avatar

    protectai/ai-exploits

    1,733View on GitHub↗

    A collection of real world AI/ML exploits for responsibly disclosed vulnerabilities

    Python
    View on GitHub↗1,733
  • qizhangli/adversarial-prompt-translatorqizhangli avatar

    qizhangli/Adversarial-Prompt-Translator

    7View on GitHub↗

    This repository contains a PyTorch implementation for our paper Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translation.

    Python
    View on GitHub↗7
  • qroa/qroaQ

    qroa/qroa

    0View on GitHub↗

    QROA, or Query-Response Optimization Attack, is an innovative and robust strategy designed to explore and exploit vulnerabilities in Large Language Models (LLMs) through black-box interactions. This method leverages optimized triggers embedded within benign-looking instructions to manipulate…

    View on GitHub↗0
  • rainjamesy/fuzzllmR

    RainJamesY/FuzzLLM

    0View on GitHub↗

    This repository contains code and data for "FUZZLLM: A Novel and Universal Fuzzing Framework for Discovering Jailbreak Vulnerabilities in LLMs" (accepted to ICASSP 2024). Our work was also invited to be presented at one of the top hacker conventions – ShmooCon 2024. arXiv

    View on GitHub↗0