awesome-repositories.com
Blog
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektÜber unsRanking-MethodikPresseMCP-Server
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

22 Repos

Awesome GitHub RepositoriesData Sanitization

Tools and utilities for stripping sensitive information from data streams before storage or processing.

Distinguishing note: Focuses on privacy-preserving data filtering rather than general encryption or authentication.

Explore 22 awesome GitHub repositories matching security & cryptography · Data Sanitization. Refine with filters or upvote what's useful.

Awesome Data Sanitization GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • thedotmack/claude-memAvatar von thedotmack

    thedotmack/claude-mem

    82,698Auf GitHub ansehen↗

    Claude-mem is an agentic memory persistence system designed to provide AI assistants with long-term context across multiple development sessions. It functions as a background orchestrator that captures, summarizes, and indexes interaction history, allowing models to maintain continuity and recall technical decisions from past tasks. By utilizing a vector-augmented context engine, the system injects relevant historical observations into active sessions, ensuring that AI agents remain informed without exceeding finite token budgets. The project distinguishes itself through an endless memory arc

    Strips sensitive or system-level tags from user prompts and tool data to ensure privacy.

    JavaScriptaiai-agentsai-memory
    Auf GitHub ansehen↗82,698
  • ageron/handson-ml2Avatar von ageron

    ageron/handson-ml2

    29,938Auf GitHub ansehen↗

    This project provides a collection of practical machine learning code examples, including implementations for supervised, unsupervised, and reinforcement learning algorithms. It features deep learning model implementations for convolutional, recurrent, and generative architectures, alongside specific examples of reinforcement learning agents that maximize rewards in simulated environments. The repository includes dedicated data preprocessing pipelines for sanitization, feature scaling, and dimensionality reduction. It also provides implementations for a wide range of specific models, such as

    Provides workflows for collecting raw data and sanitizing it for use in machine learning models.

    Jupyter Notebook
    Auf GitHub ansehen↗29,938
  • googleworkspace/cliAvatar von googleworkspace

    googleworkspace/cli

    27,096Auf GitHub ansehen↗

    The Google Workspace CLI is a command-line interface and Google API client designed to automate tasks across Google Workspace services. It functions as a cloud productivity automator that uses the Google Discovery Service to dynamically generate command structures and parameter requirements at runtime. The project distinguishes itself by providing a specialized AI agent toolset, exposing a server over standard input and output to provide structured tool definitions and skills for AI clients. It includes security layers for AI content sanitization to protect against prompt injection and utiliz

    Provides a utility to filter sensitive information in API responses using configurable templates to protect data privacy.

    Rustagent-skillsai-agentautomation
    Auf GitHub ansehen↗27,096
  • yamadashy/repomixAvatar von yamadashy

    yamadashy/repomix

    26,498Auf GitHub ansehen↗

    Repomix is an AI-focused development utility designed to prepare local and remote codebases for analysis, review, and automated interaction. It functions as a codebase context bundler and a Model Context Protocol server, aggregating project files into structured documents that are optimized for ingestion by large language models. By serving as a bridge between local repositories and external intelligence agents, the tool facilitates real-time codebase inspection and automated development workflows. The system distinguishes itself through rigorous repository token management and security-consc

    Scans file contents for secrets and credentials to prevent accidental exposure during packaging.

    TypeScriptaianthropicartificial-intelligence
    Auf GitHub ansehen↗26,498
  • opendataloader-project/opendataloader-pdfAvatar von opendataloader-project

    opendataloader-project/opendataloader-pdf

    25,769Auf GitHub ansehen↗

    This project is a PDF data extraction tool and document preprocessor designed to convert PDF files into structured formats such as Markdown, JSON, and HTML. It functions as an OCR document parser for scanned files, an accessibility automator for generating PDF/UA compliant metadata, and a loader for AI orchestration frameworks like LangChain. The software distinguishes itself through specialized handling of complex document elements, including the conversion of mathematical formulas into LaTeX and the generation of natural-language descriptions for charts and images. It utilizes recursive seg

    Replaces sensitive private information such as emails, phone numbers, and credit cards with placeholders.

    Javaa11yaccessibilityai
    Auf GitHub ansehen↗25,769
  • ageron/handson-mlAvatar von ageron

    ageron/handson-ml

    25,608Auf GitHub ansehen↗

    This is a machine learning educational repository consisting of a collection of notebooks and code examples. It provides practical implementations of diverse machine learning algorithms and workflows, ranging from traditional scientific computing to deep learning. The project features specific implementations of Scikit-Learn models, such as decision trees, random forests, and support vector machines, as well as TensorFlow examples for building neural networks, convolutional layers, and recurrent architectures. It also includes tutorials on reinforcement learning development and the creation o

    Provides processes for collecting raw datasets and sanitizing sensitive information to ensure data privacy.

    Jupyter Notebook
    Auf GitHub ansehen↗25,608
  • drduh/macos-security-and-privacy-guideAvatar von drduh

    drduh/macOS-Security-and-Privacy-Guide

    22,449Auf GitHub ansehen↗

    This project is a security hardening guide and privacy configuration manual for macOS. It provides a comprehensive set of instructions for configuring system settings to improve privacy, reduce the attack surface, and implement a malware defense framework. The guide covers technical methods for validating software notarization, verifying application sandboxing, and auditing system activity. It distinguishes itself by providing detailed workflows for restricting high-risk features and applying advanced security configurations to protect the operating system. The documentation covers several k

    Provides methods to clear sensitive historical artifacts and metadata from system preferences and caches.

    appledisk-encryptiondnscrypt-proxy
    Auf GitHub ansehen↗22,449
  • lissy93/personal-security-checklistAvatar von Lissy93

    Lissy93/personal-security-checklist

    21,691Auf GitHub ansehen↗

    This project provides a comprehensive, modular framework for auditing and hardening personal digital and physical security. It functions as a structured, platform-agnostic knowledge base that breaks down complex security standards into granular, actionable tasks. By utilizing a static documentation architecture, the project ensures that its guidance remains accessible and transparent, allowing users to track their security posture incrementally through a persistent, manual progress-tracking system. The project distinguishes itself by bridging the gap between digital cybersecurity and physical

    Removes hidden EXIF data and applies facial recognition cloaking to images before uploading to prevent tracking.

    TypeScriptawesomeawesome-listcensorship
    Auf GitHub ansehen↗21,691
  • xming521/wecloneAvatar von xming521

    xming521/WeClone

    18,028Auf GitHub ansehen↗

    WeClone is an end-to-end framework designed for the creation, training, and deployment of personalized conversational AI digital twins. By fine-tuning large language models on individual chat history, the platform enables the replication of unique communication styles, speech patterns, and conversational habits. The system manages the entire lifecycle of these digital avatars, from initial data preparation to final integration into messaging platforms for real-time interaction. The platform distinguishes itself through a comprehensive suite of data processing utilities that prepare raw messag

    Provides automated pipelines to redact sensitive personal information from chat logs before model training.

    Pythonchat-historydigital-avatarllm
    Auf GitHub ansehen↗18,028
  • screenpipe/screenpipeAvatar von screenpipe

    screenpipe/screenpipe

    16,932Auf GitHub ansehen↗

    Screenpipe is a local-first platform designed to record, index, and analyze desktop activity. By capturing screen, audio, and keyboard input, it creates a comprehensive and searchable history of computer usage. The system functions as an activity recorder and automation framework, providing a persistent, context-aware memory that allows artificial intelligence agents to observe and interact with local desktop environments. The platform distinguishes itself through a privacy-focused architecture that processes all data locally. It utilizes on-device computer vision and speech recognition to tr

    Filters and redacts personally identifiable information using local models before data is indexed.

    Rustagentsagiai
    Auf GitHub ansehen↗16,932
  • supertokens/supertokens-coreAvatar von supertokens

    supertokens/supertokens-core

    14,922Auf GitHub ansehen↗

    SuperTokens Core is an open-source, self-hosted authentication and identity management platform designed for deployment within private infrastructure. It provides a comprehensive suite for managing user accounts, roles, and secure authentication flows, utilizing a modular, recipe-based architecture that allows developers to enable specific security features without modifying the core codebase. The platform distinguishes itself through its robust multi-tenancy capabilities, which allow for the logical or physical isolation of user records and configuration settings across different organizatio

    Filters sensitive information like passwords and tokens from telemetry logs to ensure data protection.

    Javaauth0authenticationaws-cognito
    Auf GitHub ansehen↗14,922
  • zalmoxisus/redux-devtools-extensionAvatar von zalmoxisus

    zalmoxisus/redux-devtools-extension

    13,460Auf GitHub ansehen↗

    This project is a state management inspector and debugging tool for Redux. It provides a browser-based interface for inspecting and modifying application state and actions in real time, serving as an action logger and time travel debugger to troubleshoot application logic. The tool allows users to navigate a chronological history of state changes to replay previous versions of the application or skip specific actions. It also functions as a remote monitoring bridge, streaming Redux state and actions from non-browser environments to a centralized debugging interface. The capability surface in

    Implements utilities to strip sensitive information from state objects before they are transmitted to the monitor.

    JavaScriptdebugdevtoolsextension
    Auf GitHub ansehen↗13,460
  • chainlit/chainlitAvatar von Chainlit

    Chainlit/chainlit

    12,213Auf GitHub ansehen↗

    Chainlit is a Python framework designed for building and deploying interactive, stateful conversational AI interfaces. It provides a backend-driven platform that connects language models and agent frameworks to a web-based chat frontend, managing the complexities of session state, message history, and real-time communication. The framework distinguishes itself by offering a component-based UI builder that allows developers to inject interactive widgets, rich media, and data visualizations directly into the chat stream. It supports the visualization of complex agent workflows, enabling users t

    Detects and masks sensitive information or credentials in messages before processing.

    Pythonchatgptlangchainllm
    Auf GitHub ansehen↗12,213
  • openreplay/openreplayAvatar von openreplay

    openreplay/openreplay

    12,104Auf GitHub ansehen↗

    OpenReplay is a session replay platform and frontend debugging suite designed to record and play back user browser sessions. It functions as a user behavior monitoring system that captures interaction patterns and technical metadata to identify conversion issues and revenue loss. The platform is distinguished by its self-hosted infrastructure model, allowing the recording and analytics pipeline to be deployed on private servers for full control over data residency. It also includes a browser co-browsing tool for real-time screen sharing and direct communication to provide immediate technical

    Filters or masks sensitive information in the browser before data is transmitted to the storage backend.

    TypeScriptanalyticsangulardevtools
    Auf GitHub ansehen↗12,104
  • yokoffing/betterfoxAvatar von yokoffing

    yokoffing/Betterfox

    10,059Auf GitHub ansehen↗

    Betterfox is a curated configuration profile for the Firefox web browser designed to optimize speed, security, privacy, and user interface minimalism. It provides a set of preferences and settings to harden the browser environment and improve overall performance. The project distinguishes itself through targeted configuration suites that refine scrolling behavior, font rendering, and interface elements while removing visual distractions from the new tab page and address bar. It includes specific directives to disable telemetry, tracking, and digital rights management. Its broader capabilitie

    Automatically clears history, cookies, and cache upon closing the application to maintain user privacy.

    JavaScriptanti-trackingfirefoxgecko
    Auf GitHub ansehen↗10,059
  • runanywhereai/runanywhere-sdksAvatar von RunanywhereAI

    RunanywhereAI/runanywhere-sdks

    8,781Auf GitHub ansehen↗

    This project is an on-device AI SDK providing a framework for running large language models, vision models, and speech models locally. It serves as an orchestration layer for local LLM execution, ensuring data privacy and offline availability by utilizing hardware acceleration on the device. The SDK is distinguished by its comprehensive voice and multimodal capabilities, including a coordinated voice pipeline for activity detection, speech-to-text, and text-to-speech synthesis. It also provides a dedicated implementation kit for local retrieval-augmented generation and tools for processing co

    Purges sensitive information from the device by removing conversation history and resetting internal session states.

    C++androidapple-intelligencecpp
    Auf GitHub ansehen↗8,781
  • agentdeskai/browser-tools-mcpAvatar von AgentDeskAI

    AgentDeskAI/browser-tools-mcp

    7,254Auf GitHub ansehen↗

    This project is a browser automation toolset and Model Context Protocol server that connects large language models to live browser sessions. It provides a web debugging interface and a quality auditor to facilitate the analysis of document object model structures and browser logs. The system implements a bridge that streams diagnostics into AI-powered editors, allowing for the automated identification of web bugs. It features a data sanitization pipeline that removes cookies and sensitive headers to prevent private information leakage during the analysis process. The toolset covers a range o

    Strips cookies and sensitive headers from browser logs to prevent private information leakage to LLMs.

    JavaScriptaianthropiccursor
    Auf GitHub ansehen↗7,254
  • esbatmop/mnbvcAvatar von esbatmop

    esbatmop/MNBVC

    4,123Auf GitHub ansehen↗

    MNBVC is a dataset pipeline and toolkit designed for the collection, cleaning, and normalization of massive text and code corpora used to train large language models. It provides specialized tools for harvesting source code, commit histories, and repository metadata from version control platforms, alongside a multilingual text corpus collector for gathering parallel text and academic papers. The project distinguishes itself through comprehensive capabilities for processing diverse document types, including a PDF-to-text converter that transforms complex layouts and formulas into structured JS

    Scans text to identify and remove personally identifiable information such as ID numbers and email addresses.

    chinesechinese-languagechinese-nlp
    Auf GitHub ansehen↗4,123
  • hackerschoice/thc-tips-tricks-hacks-cheat-sheetAvatar von hackerschoice

    hackerschoice/thc-tips-tricks-hacks-cheat-sheet

    3,853Auf GitHub ansehen↗

    This project is a comprehensive command-line reference and toolkit designed for Linux system administration and network security assessment. It provides a collection of technical snippets and operational guides focused on managing remote environments, orchestrating shell sessions, and executing administrative tasks through native terminal utilities. The repository distinguishes itself by offering specialized techniques for stealthy operations and infrastructure manipulation. It covers methods for establishing encrypted tunnels to bypass firewalls, obfuscating process identities and command hi

    Strips metadata from documents and images to prevent accidental disclosure of private information.

    Shell
    Auf GitHub ansehen↗3,853
  • mattermost/mattermost-mobileAvatar von mattermost

    mattermost/mattermost-mobile

    2,593Auf GitHub ansehen↗

    This project is an enterprise messaging mobile application and cross-platform team chat client. It serves as a self-hosted messaging interface for team communication, direct messaging, and voice calls within corporate environments. The application integrates artificial intelligence agents to automate repetitive tasks and retrieve information. It also functions as a Kanban task management tool, providing project and task coordination through planning boards to track operational work. The platform covers secure mobile messaging with local data sanitization and mobile workflow automation. It in

    Protects user privacy by removing all application data from the device upon logout.

    TypeScripthacktoberfestmattermost-mobile
    Auf GitHub ansehen↗2,593
Vorherige12Nächste
  1. Home
  2. Security & Cryptography
  3. Data Sanitization

Unter-Tags erkunden

  • Automated Privacy Clearing1 Sub-TagMechanisms that automatically wipe temporary browser data upon session termination. **Distinct from Data Sanitization:** Distinct from general Data Sanitization which focuses on filtering data streams; this focuses on clearing session history/cache.
  • Data Acquisition & Sanitization1 Sub-TagProcesses for collecting raw data and removing sensitive information for machine learning use. **Distinct from Data Sanitization:** Extends data sanitization to include the acquisition and formatting of raw datasets specifically for modeling pipelines.
  • Ephemeral Sanitization UtilitiesTools that automatically remove temporary unencrypted artifacts after data processing tasks to prevent sensitive information leakage. **Distinct from Data Sanitization:** Distinct from Data Sanitization: focuses on the lifecycle-bound cleanup of temporary files post-process, rather than general data stream filtering.