How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Machine Learning (ML) models are shared publicly over the internet, within teams and across teams. The rise of Foundation Models have resulted in public ML models being increasingly consumed for further training/fine tuning. ML Models are increasingly used to make critical decisions and power…
The main features of protectai/modelscan are: AI Security Frameworks.
Projects with overlapping indexed features include: microsoft/ai-system — AI-System is an educational resource and toolkit designed for learning the hardware and software foundations of deep… keygraphhq/shannon — Shannon is an integrated security platform designed for autonomous penetration testing, static and dynamic analysis,… mattersec-labs/seclens — Role-Specific Evaluation of LLMs for Security Vulnerability Detection Paper · Docs · Quick Start… nvidia/garak — Garak is an AI model evaluation tool and vulnerability scanner designed for red teaming large language models and… onestardao/wfgy. promptfoo/promptfoo — Promptfoo is an evaluation framework designed for testing, benchmarking, and red-teaming language models and agentic…
AI-System is an educational resource and toolkit designed for learning the hardware and software foundations of deep learning systems. It provides a curriculum and practical exercises for building AI infrastructure, ranging from low-level CUDA kernel development to high-level system management. The project includes a toolkit for developing tensor operations and optimizing GPU performance through direct hardware programming. It also features a framework for distributed training, focusing on resource scheduling and communication protocols to manage large-scale models across multiple computing n
Shannon is an integrated security platform designed for autonomous penetration testing, static and dynamic analysis, and automated vulnerability remediation within self-hosted, private infrastructure. It functions as a unified security suite that orchestrates the entire lifecycle of vulnerability management, from initial discovery and reachability prioritization to the generation and verification of code-level patches. The platform distinguishes itself through its agentic approach to security, deploying autonomous agents to execute both black-box and white-box exploits against running applica
Role-Specific Evaluation of LLMs for Security Vulnerability Detection Paper · Docs · Quick Start · Results
Garak is an AI model evaluation tool and vulnerability scanner designed for red teaming large language models and auditing the security of retrieval-augmented generation pipelines. It identifies behavioral weaknesses, such as jailbreaks, hallucinations, and data leakage, by simulating adversarial attacks and executing automated testing vectors. The framework utilizes an adaptive probing loop where prompts can react to previous model behavior and be modified in flight via middleware. To ensure consistent analysis, it employs a provider-agnostic interface to interact with various model APIs and