20 个仓库
Defensive practices for protecting language models against adversarial manipulation and prompt injection.
Distinguishing note: Specific to AI and LLM security rather than general software cryptography.
Explore 20 awesome GitHub repositories matching security & cryptography · AI Security. Refine with filters or upvote what's useful.
gstack is an AI agent framework and development workflow system designed to automate the software development lifecycle. It coordinates specialized AI personas to manage tasks across product design, engineering management, and quality assurance, transforming product intent into technical specifications and final releases. The project is distinguished by its deep integration of headless browser automation and semantic code memory. It utilizes a persistent Chromium daemon for web scraping and visual auditing, and implements a searchable knowledge base that logs architectural decisions and repos
Implements prompt injection detection, secret scanning, and directory restrictions to secure AI mutations.
This project is a comprehensive educational resource and technical guide focused on the development, optimization, and application of large language models. It provides a structured curriculum for mastering prompt engineering, ranging from foundational principles of instruction design to advanced techniques for improving model reasoning, accuracy, and reliability. The guide distinguishes itself by offering deep technical insights into agentic workflows and autonomous system design. It covers the implementation of multi-step reasoning chains, tool integration through function calling, and stat
Implements defensive strategies to protect language model interactions from malicious manipulation.
LocalAI is a local generative AI platform and inference engine designed to host large language, vision, and audio models on private hardware. It functions as an API compatible gateway that mimics proprietary service endpoints, allowing existing third-party software to integrate with a self-hosted backend. The platform distinguishes itself as a distributed AI model orchestrator, capable of scaling inference across machine clusters using VRAM-aware routing and hardware coordination. It provides a unified interface for diverse open-source backends and supports self-hosted RAG infrastructure thro
Protects AI services from unauthorized access through identity verification and resource quotas.
This project is a comprehensive cybersecurity knowledge repository that provides a structured collection of technical documentation, training materials, and professional development roadmaps. It serves as a centralized resource for practitioners to navigate complex security disciplines, ranging from offensive and defensive fundamentals to specialized infrastructure and application security. The repository distinguishes itself through a modular resource framework that enables users to construct isolated cyber range environments for hands-on practice. It also features a specialized reference gu
Serves as a specialized reference guide for AI security, vulnerability management, and incident response.
This is a full-featured chatbot framework and Next.js web application designed for integrating various large language model providers into a web interface. It serves as a template for building AI chatbots that can generate text and structured data through a unified interface. The project functions as an authenticated AI application, incorporating built-in user identity verification and session management. It includes a suite for AI tool integration, allowing language models to execute tool calls and generate structured objects by connecting to external data and functions. The framework provi
Combines user authentication and credential verification to secure access to AI chat services.
Ironclaw is an LLM orchestration framework and AI agent gateway designed to connect large language models with external tools, messaging interfaces, and persistent memory systems. It functions as a communication layer that routes interactions between users and AI models via HTTP webhooks and various messaging channels. The system focuses on secure tool execution through a WebAssembly sandbox and isolated containers, which allows the framework to run untrusted code and dynamically generate new tools from natural language descriptions. Security middleware provides prompt injection defense and s
Implements a protection layer to filter prompt injections and prevent credential leakage during model inference.
kohya_ss is a graphical user interface and workbench for fine-tuning diffusion models, specifically designed for Stable Diffusion. It provides a suite of tools for training generative AI models, including specialized interfaces for creating Low-Rank Adaptation weights and training ControlNet spatial control networks. The project distinguishes itself through integrated VRAM usage optimization and hardware acceleration, featuring specific support for Intel GPUs via XPU-accelerated libraries. It implements parameter-efficient training methods and memory-saving techniques like gradient checkpoint
Includes a security layer requiring username and password authentication for accessing the training interface.
This repository provides curated learning paths, structured courseware, and technical materials for mastering Go programming, container orchestration, and software architecture. It serves as a comprehensive educational resource for systems programming, focusing on language mechanics, memory safety, and high-performance backend design. The project distinguishes itself through a multi-modal instructional design that combines instructor-led workshops, project-based curricula, and competency-based certifications. It offers specialized guidance on building production-grade AI infrastructure, inclu
Offers guidance on implementing security layers and risk mitigation strategies specifically for AI models.
Easy Diffusion is a desktop application that generates images from text descriptions using AI. It provides a straightforward interface for creating visuals by simply typing what you want to see, with the ability to preview images as they are being generated. The application supports loading custom AI models, allowing users to switch between different artistic capabilities and styles. It includes tools for editing existing images through text prompts or masks, applying predefined artistic styles like "Realistic" or "Pencil Sketch", and upscaling or correcting facial details after generation. F
Checks downloaded model files for known security threats before loading them into the application.
Higress is an AI API gateway and cloud-native traffic manager that functions as a Kubernetes ingress controller. It provides a centralized system for routing, securing, and optimizing traffic directed toward large language models, AI agents, and microservice architectures. The project distinguishes itself through deep AI orchestration, including the ability to host and manage Model Context Protocol servers that transform REST APIs into tools for AI agents. It features specialized AI infrastructure for model request proxying, protocol translation across multiple providers, and semantic-based c
Filters sensitive information and performs security checks specifically on requests directed at AI resources.
Cleverhans is an adversarial machine learning library and toolkit designed to generate adversarial examples, incorporate them into training loops, and benchmark the resilience of machine learning models. It provides a gradient-based attack framework for constructing both white-box and black-box attacks to identify model misclassifications. The project includes capabilities for model robustness benchmarking, allowing users to evaluate and verify how models resist evasion attacks and malicious input perturbations. It also facilitates adversarial training to increase a model's resistance to pert
Benchmarks model robustness by using standardized scripts to reproduce defensive techniques across different backends.
Cleverhans 是一个 TensorFlow 对抗性机器学习库,既是攻击框架,也是鲁棒性基准测试和防御库。它提供了一系列工具来生成对抗样本、测试神经网络的安全性,并实施保护机制以提高模型对恶意输入的抵御能力。 该项目专注于创建旨在欺骗机器学习模型并使其做出错误预测的扰动输入。它能够评估深度学习模型在受到对抗性噪声干扰时的稳定性和准确性,并提供已知攻击方法的参考实现以识别安全弱点。 该工具包涵盖了对抗样本生成、机器学习模型防御以及神经网络鲁棒性基准测试。它利用模型无关的接口和可微分的攻击实现来执行基于梯度的扰动和迭代优化循环。
Implements protective mechanisms to harden neural networks against evasion and poisoning attacks.
Security-101 is a vendor-agnostic, foundational cybersecurity learning curriculum organized into modular, framework-aligned modules. It is designed to build core knowledge across multiple security domains without tying content to specific products or platforms, making it suitable for both beginners and professionals seeking a structured introduction to the field. The curriculum is built around established security frameworks, including the MITRE ATT&CK framework for standardized threat analysis and the NIST Cybersecurity Framework for incident response workflows. It covers a broad range of do
Provides a dedicated curriculum module on AI system security including adversarial attacks and model hardening.
The Adversarial Robustness Toolbox (ART) is an open-source library that provides a unified framework for evaluating, defending, and certifying machine learning models against adversarial threats. It wraps models from any framework behind a common estimator interface, enabling composable pipelines for attack generation, defense application, robustness certification, and privacy auditing across evasion, poisoning, and extraction threats. The library distinguishes itself by covering the full adversarial ML security lifecycle within a single toolkit. It supports gradient-based adversarial example
Applies preprocessing, postprocessing, and detection techniques to harden models against multiple attack types.
这是一个基于 AI 的静态分析工具和自动化漏洞扫描器,旨在检测注入和身份验证绕过等安全缺陷。它利用大语言模型对多种编程语言进行语义推理,从而识别代码变更中的漏洞。 该工具作为 GitHub Action 运行,集成在持续集成流水线中以分析 Pull Request 的差异。它专注于修改后的代码行,针对性地发现新风险,并通过在 Pull Request 中直接发布自动化评论来报告结果。 分析过程由可自定义的安全策略和外部规则注入引导,支持针对特定项目的指令。这些自定义规则和过滤器用于减少干扰并剔除低影响的发现,从而优先处理高置信度的安全风险。
Implements a customizable AI-driven security linter that applies project-specific instructions and filters to reduce noise during analysis.
该项目是一个全面的教育资源和技术手册,专注于可解释机器学习和可解释 AI(XAI)。它作为一本教科书和参考资料,用于实现使复杂的机器学习模型对人类透明且易于理解的技术。 该资源提供了关于构建本质上透明的模型(如决策树和稀疏线性模型)以及将事后解释方法应用于黑盒系统的指导。它详细介绍了量化特征重要性、为单个预测生成理由以及使用代理模型近似复杂决策过程的具体方法。 内容涵盖了广泛的分析功能,包括全局和局部特征影响分析、计算机视觉可解释性以及使用 Shapley 值等博弈论贡献。它还通过可解释性评估、识别模型捷径的调试工作流以及透明算法结构的设计来解决模型评估问题。 该项目以 Jupyter Notebooks 集合的形式实现。
Details techniques to harden models against adversarial inputs through robust optimization and training.
OpenChat is a conversational AI agent builder and customer service automation platform that uses large language models to power customer support chatbots across multiple channels. It provides tools for defining AI agent behavior, training on custom knowledge, managing actions, and controlling autopilot responses per channel. The platform enables deploying AI agents on web, phone, email, SMS, and WhatsApp, with a unified inbox for managing conversations across all channels. It includes CRM synchronization, automated workflows, contact segmentation, and analytics for tracking customer satisfact
Authenticates AI action calls using secrets, tokens, or context headers.
AI-System is an educational resource and toolkit designed for learning the hardware and software foundations of deep learning systems. It provides a curriculum and practical exercises for building AI infrastructure, ranging from low-level CUDA kernel development to high-level system management. The project includes a toolkit for developing tensor operations and optimizing GPU performance through direct hardware programming. It also features a framework for distributed training, focusing on resource scheduling and communication protocols to manage large-scale models across multiple computing n
Teaches how to analyze and mitigate privacy vulnerabilities and adversarial attacks in artificial intelligence models.
该项目是一个 Go 进程监督器,旨在启动和监控多个后台程序,并具有自动重启和生命周期管理功能。它作为一个用于协调守护进程执行的系统,通过集中配置确保连续运行。 该监督器的特色在于多个远程管理接口,包括进程管理 REST API、XML-RPC 控制器以及用于监控和控制进程的内置 Web 仪表板。它具有一个 Prometheus 监控导出器,通过专用 HTTP 端点提供实时性能指标,并使用基本身份验证保护这些远程接口。 该系统涵盖了广泛的功能领域,包括具有基于大小轮转的日志管理、通过 TCP 和 HTTP 轮询的自动健康检查,以及通过基于组的优先级调度进行的服务生命周期编排。它还提供事件驱动的操作触发器、用于清理僵尸进程的子进程收割器,以及用于手动进程控制的命令行界面。 该软件包括用于配置模板生成的实用程序,并可以作为系统服务使用自定义环境文件进行集成。
Restricts access to the remote control interface using authenticated identity verification.
This project is a server implementation of the Model Context Protocol designed to function as an AI knowledge retrieval tool. It acts as a semantic search engine and web scraping framework that indexes technical documentation from web sources, local files, and archives, making this information directly accessible to AI coding assistants for context-aware research and querying. The system distinguishes itself through a hybrid search architecture that combines vector-based embeddings with full-text retrieval to improve the accuracy of documentation lookups. It features a modular pipeline for co
Deploys documentation servers with authentication, network access controls, and telemetry to safely manage knowledge access for AI-driven development tools.