How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
An example of Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations (to be presented at the IJCAI-ECAI 2022). This repository contains code for crafting perceptual-aware perturbation in the Lab color space to attack an…
Cleverhans is an adversarial machine learning library and toolkit designed to generate adversarial examples, incorporate them into training loops, and benchmark the resilience of machine learning models. It provides a gradient-based attack framework for constructing both white-box and black-box attacks to identify model misclassifications. The project includes capabilities for model robustness benchmarking, allowing users to evaluate and verify how models resist evasion attacks and malicious input perturbations. It also facilitates adversarial training to increase a model's resistance to pert
Superagent is a framework for AI assistant orchestration and agent security. It provides the tools to build intelligent assistants that integrate external APIs and maintain conversation memory to automate complex tasks. The project focuses on AI agent security through adversarial testing, red teaming, and the detection of prompt injections and malicious tool calls. It includes automated vulnerability patching, which scans codebases and configurations for security flaws and generates pull requests with fixes. The platform supports retrieval augmented generation by connecting language models t
This repository provides tools and methodologies for studying adversarial attacks on large language models. It focuses on understanding how carefully crafted inputs can manipulate or bypass the safety mechanisms of LLMs, enabling researchers to probe model vulnerabilities and improve their robustness. The project covers techniques for generating adversarial prompts, evaluating model responses under attack conditions, and analyzing the effectiveness of different attack strategies.
This repository contains the official PyTorch implementation of the following paper at ICLR 2024 (Spotlight):
The main features of jwliang007/pff are: Adversarial Attacks, Adversarial Attacks and Defense.
Open-source alternatives to jwliang007/pff include: abstractteen/antiforgery — An example of Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware… homanp/superagent — Superagent is a framework for AI assistant orchestration and agent security. It provides the tools to build… cleverhans-lab/cleverhans — Cleverhans is an adversarial machine learning library and toolkit designed to generate adversarial examples,… trusted-ai/adversarial-robustness-toolbox — The Adversarial Robustness Toolbox (ART) is an open-source library that provides a unified framework for evaluating,… llm-attacks/llm-attacks — This repository provides tools and methodologies for studying adversarial attacks on large language models. It focuses… cs231n/cs231n.github.io — This project is a static educational website and comprehensive curriculum focused on computer vision and deep…