21 مستودعات
Tools and utilities for stripping sensitive information from data streams before storage or processing.
Distinguishing note: Focuses on privacy-preserving data filtering rather than general encryption or authentication.
Explore 21 awesome GitHub repositories matching security & cryptography · Data Sanitization. Refine with filters or upvote what's useful.
Claude-mem is an agentic memory persistence system designed to provide AI assistants with long-term context across multiple development sessions. It functions as a background orchestrator that captures, summarizes, and indexes interaction history, allowing models to maintain continuity and recall technical decisions from past tasks. By utilizing a vector-augmented context engine, the system injects relevant historical observations into active sessions, ensuring that AI agents remain informed without exceeding finite token budgets. The project distinguishes itself through an endless memory arc
Strips sensitive or system-level tags from user prompts and tool data to ensure privacy.
This project provides a collection of practical machine learning code examples, including implementations for supervised, unsupervised, and reinforcement learning algorithms. It features deep learning model implementations for convolutional, recurrent, and generative architectures, alongside specific examples of reinforcement learning agents that maximize rewards in simulated environments. The repository includes dedicated data preprocessing pipelines for sanitization, feature scaling, and dimensionality reduction. It also provides implementations for a wide range of specific models, such as
Provides workflows for collecting raw data and sanitizing it for use in machine learning models.
The Google Workspace CLI is a command-line interface and Google API client designed to automate tasks across Google Workspace services. It functions as a cloud productivity automator that uses the Google Discovery Service to dynamically generate command structures and parameter requirements at runtime. The project distinguishes itself by providing a specialized AI agent toolset, exposing a server over standard input and output to provide structured tool definitions and skills for AI clients. It includes security layers for AI content sanitization to protect against prompt injection and utiliz
Provides a utility to filter sensitive information in API responses using configurable templates to protect data privacy.
Repomix is an AI-focused development utility designed to prepare local and remote codebases for analysis, review, and automated interaction. It functions as a codebase context bundler and a Model Context Protocol server, aggregating project files into structured documents that are optimized for ingestion by large language models. By serving as a bridge between local repositories and external intelligence agents, the tool facilitates real-time codebase inspection and automated development workflows. The system distinguishes itself through rigorous repository token management and security-consc
Scans file contents for secrets and credentials to prevent accidental exposure during packaging.
This project is a PDF data extraction tool and document preprocessor designed to convert PDF files into structured formats such as Markdown, JSON, and HTML. It functions as an OCR document parser for scanned files, an accessibility automator for generating PDF/UA compliant metadata, and a loader for AI orchestration frameworks like LangChain. The software distinguishes itself through specialized handling of complex document elements, including the conversion of mathematical formulas into LaTeX and the generation of natural-language descriptions for charts and images. It utilizes recursive seg
Replaces sensitive private information such as emails, phone numbers, and credit cards with placeholders.
This is a machine learning educational repository consisting of a collection of notebooks and code examples. It provides practical implementations of diverse machine learning algorithms and workflows, ranging from traditional scientific computing to deep learning. The project features specific implementations of Scikit-Learn models, such as decision trees, random forests, and support vector machines, as well as TensorFlow examples for building neural networks, convolutional layers, and recurrent architectures. It also includes tutorials on reinforcement learning development and the creation o
Provides processes for collecting raw datasets and sanitizing sensitive information to ensure data privacy.
This project is a security hardening guide and privacy configuration manual for macOS. It provides a comprehensive set of instructions for configuring system settings to improve privacy, reduce the attack surface, and implement a malware defense framework. The guide covers technical methods for validating software notarization, verifying application sandboxing, and auditing system activity. It distinguishes itself by providing detailed workflows for restricting high-risk features and applying advanced security configurations to protect the operating system. The documentation covers several k
Provides methods to clear sensitive historical artifacts and metadata from system preferences and caches.
This project provides a comprehensive, modular framework for auditing and hardening personal digital and physical security. It functions as a structured, platform-agnostic knowledge base that breaks down complex security standards into granular, actionable tasks. By utilizing a static documentation architecture, the project ensures that its guidance remains accessible and transparent, allowing users to track their security posture incrementally through a persistent, manual progress-tracking system. The project distinguishes itself by bridging the gap between digital cybersecurity and physical
Removes hidden EXIF data and applies facial recognition cloaking to images before uploading to prevent tracking.
WeClone is an end-to-end framework designed for the creation, training, and deployment of personalized conversational AI digital twins. By fine-tuning large language models on individual chat history, the platform enables the replication of unique communication styles, speech patterns, and conversational habits. The system manages the entire lifecycle of these digital avatars, from initial data preparation to final integration into messaging platforms for real-time interaction. The platform distinguishes itself through a comprehensive suite of data processing utilities that prepare raw messag
Provides automated pipelines to redact sensitive personal information from chat logs before model training.
Screenpipe is a local-first platform designed to record, index, and analyze desktop activity. By capturing screen, audio, and keyboard input, it creates a comprehensive and searchable history of computer usage. The system functions as an activity recorder and automation framework, providing a persistent, context-aware memory that allows artificial intelligence agents to observe and interact with local desktop environments. The platform distinguishes itself through a privacy-focused architecture that processes all data locally. It utilizes on-device computer vision and speech recognition to tr
Filters and redacts personally identifiable information using local models before data is indexed.
SuperTokens Core is an open-source, self-hosted authentication and identity management platform designed for deployment within private infrastructure. It provides a comprehensive suite for managing user accounts, roles, and secure authentication flows, utilizing a modular, recipe-based architecture that allows developers to enable specific security features without modifying the core codebase. The platform distinguishes itself through its robust multi-tenancy capabilities, which allow for the logical or physical isolation of user records and configuration settings across different organizatio
Filters sensitive information like passwords and tokens from telemetry logs to ensure data protection.
This project is a state management inspector and debugging tool for Redux. It provides a browser-based interface for inspecting and modifying application state and actions in real time, serving as an action logger and time travel debugger to troubleshoot application logic. The tool allows users to navigate a chronological history of state changes to replay previous versions of the application or skip specific actions. It also functions as a remote monitoring bridge, streaming Redux state and actions from non-browser environments to a centralized debugging interface. The capability surface in
Implements utilities to strip sensitive information from state objects before they are transmitted to the monitor.
Chainlit is a Python framework designed for building and deploying interactive, stateful conversational AI interfaces. It provides a backend-driven platform that connects language models and agent frameworks to a web-based chat frontend, managing the complexities of session state, message history, and real-time communication. The framework distinguishes itself by offering a component-based UI builder that allows developers to inject interactive widgets, rich media, and data visualizations directly into the chat stream. It supports the visualization of complex agent workflows, enabling users t
Detects and masks sensitive information or credentials in messages before processing.
OpenReplay is a session replay platform and frontend debugging suite designed to record and play back user browser sessions. It functions as a user behavior monitoring system that captures interaction patterns and technical metadata to identify conversion issues and revenue loss. The platform is distinguished by its self-hosted infrastructure model, allowing the recording and analytics pipeline to be deployed on private servers for full control over data residency. It also includes a browser co-browsing tool for real-time screen sharing and direct communication to provide immediate technical
Filters or masks sensitive information in the browser before data is transmitted to the storage backend.
Betterfox is a curated configuration profile for the Firefox web browser designed to optimize speed, security, privacy, and user interface minimalism. It provides a set of preferences and settings to harden the browser environment and improve overall performance. The project distinguishes itself through targeted configuration suites that refine scrolling behavior, font rendering, and interface elements while removing visual distractions from the new tab page and address bar. It includes specific directives to disable telemetry, tracking, and digital rights management. Its broader capabilitie
Automatically clears history, cookies, and cache upon closing the application to maintain user privacy.
This project is an on-device AI SDK providing a framework for running large language models, vision models, and speech models locally. It serves as an orchestration layer for local LLM execution, ensuring data privacy and offline availability by utilizing hardware acceleration on the device. The SDK is distinguished by its comprehensive voice and multimodal capabilities, including a coordinated voice pipeline for activity detection, speech-to-text, and text-to-speech synthesis. It also provides a dedicated implementation kit for local retrieval-augmented generation and tools for processing co
Purges sensitive information from the device by removing conversation history and resetting internal session states.
This project is a browser automation toolset and Model Context Protocol server that connects large language models to live browser sessions. It provides a web debugging interface and a quality auditor to facilitate the analysis of document object model structures and browser logs. The system implements a bridge that streams diagnostics into AI-powered editors, allowing for the automated identification of web bugs. It features a data sanitization pipeline that removes cookies and sensitive headers to prevent private information leakage during the analysis process. The toolset covers a range o
Strips cookies and sensitive headers from browser logs to prevent private information leakage to LLMs.
MNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and code corpora used to train large language models. It provides specialized tools for harvesting source code, commit histories, and repository metadata from version control platforms, alongside a multilingual text corpus collector for gathering parallel text and academic papers. The project distinguishes itself through comprehensive capabilities for processing diverse document types, including a PDF-to-text converter that transforms complex layouts and formulas into structured JS
Scans text to identify and remove personally identifiable information such as ID numbers and email addresses.
This project is a comprehensive command-line reference and toolkit designed for Linux system administration and network security assessment. It provides a collection of technical snippets and operational guides focused on managing remote environments, orchestrating shell sessions, and executing administrative tasks through native terminal utilities. The repository distinguishes itself by offering specialized techniques for stealthy operations and infrastructure manipulation. It covers methods for establishing encrypted tunnels to bypass firewalls, obfuscating process identities and command hi
Strips metadata from documents and images to prevent accidental disclosure of private information.
This project is an enterprise messaging mobile application and cross-platform team chat client. It serves as a self-hosted messaging interface for team communication, direct messaging, and voice calls within corporate environments. The application integrates artificial intelligence agents to automate repetitive tasks and retrieve information. It also functions as a Kanban task management tool, providing project and task coordination through planning boards to track operational work. The platform covers secure mobile messaging with local data sanitization and mobile workflow automation. It in
Protects user privacy by removing all application data from the device upon logout.