awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
bee-san avatar

bee-san/pyWhat

0
View on GitHub↗

PyWhat

pyWhat is a Python-based data extraction tool designed to scan files and text for sensitive identifiers, credentials, and network artifacts using regular expressions. It functions as a pattern matching engine and PII scanner capable of identifying personal identifiers and sensitive data patterns across directories and binary files.

The project specializes in the identification of unknown data formats through file signatures and the extraction of high-value identifiers, such as URLs, IP addresses, and phone numbers, from network capture files. It utilizes a rarity-based filtering system and specific tags to reduce false positives during the discovery process.

The tool provides broad capabilities for recursive directory scanning, data type identification, and digital forensic processing. Findings can be organized through custom sorting and exported into structured JSON or plain text formats for integration into external security pipelines.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Features

  • Sensitive Data Identification - Scans data for personal identifiers, credentials, and API keys using a comprehensive set of identifiable markers.
  • Sensitive Data Scanners - Scans files, directories, and text to locate personal identifiers, API keys, and credentials for security auditing.
  • Text Pattern Matching - Uses predefined regular expressions to scan text and binary data for specific identifiers and sensitive information.
  • Signature-Based Identification - Matches file headers and content against known signatures to determine the format of unknown data.
  • Pattern Matching Engines - Uses a pattern matching engine with regular expressions and rarity scores to identify specific data formats.
  • PII Detection and Screening - Identifies personal identifiers and sensitive data patterns across directories and binary files.
  • Sensitive Data Extraction Tools - Provides a command line tool that scans files and text for sensitive identifiers, credentials, and network artifacts.
  • Digital Forensics - Filters and sorts identified data patterns to isolate relevant evidence and reduce false positives during investigations.
  • Pattern-Based Data Identification - Uses regular expressions and priority logic to identify emails, IP addresses, and system credentials.
  • Recursive Directory Traversers - Recursively walks through nested folder structures to process all files within a path for content analysis.
  • Rarity-Based Filtering - Restrict searches to specific data categories using rarity scores and tags to significantly reduce false positives.
  • Identifier Extractions - Extracts high-value identifiers such as URLs and phone numbers from network capture files to accelerate traffic analysis.
  • Automated Data Extraction - Converts unstructured data analysis findings into structured JSON formats for use in security pipelines.
  • Search Result Filtering - Processes raw matches through rarity scores and category tags to refine results and reduce noise.
  • Network Capture Parsers - Extracts URLs, IP addresses, and phone numbers from network traffic files to accelerate forensic analysis.
  • Partial String Matching - Identifies patterns embedded in larger data blobs by relaxing word boundary constraints for more flexible discovery.
  • Network Forensic Extractions - Extracts high-value identifiers like URLs and phone numbers from network capture files to accelerate forensic investigations.
7,150 stars·386 forks·Python·mit·32 views

Star history

Star history chart for bee-san/pywhatStar history chart for bee-san/pywhat

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Frequently asked questions

What does bee-san/pywhat do?

pyWhat is a Python-based data extraction tool designed to scan files and text for sensitive identifiers, credentials, and network artifacts using regular expressions. It functions as a pattern matching engine and PII scanner capable of identifying personal identifiers and sensitive data patterns across directories and binary files.

What are the main features of bee-san/pywhat?

The main features of bee-san/pywhat are: Sensitive Data Identification, Sensitive Data Scanners, Text Pattern Matching, Signature-Based Identification, Pattern Matching Engines, PII Detection and Screening, Sensitive Data Extraction Tools, Digital Forensics.

Which projects share features with bee-san/pywhat?

Projects with overlapping indexed features include: jaykali/maskphish — Maskphish is a comprehensive security toolkit that integrates capabilities for digital forensics, network… bootandy/dust — Dust is a command line disk usage analyzer written in Rust. It functions as a disk space visualization tool and… lancedb/lancedb — LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector… shekhargulati/52-technologies-in-2016 — This project serves as a comprehensive educational repository and technical reference collection, documenting a wide… microsoft/presidio — Presidio is a PII detection and anonymization framework designed to identify and mask personally identifiable… blacksmithgu/obsidian-dataview — This project is a metadata query engine and indexer for markdown files, designed to transform YAML frontmatter and…

Projects sharing features with PyWhat

These projects share indexed features with PyWhat. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • jaykali/maskphishjaykali avatar

    jaykali/maskphish

    3,020View on GitHub↗

    Maskphish is a comprehensive security toolkit that integrates capabilities for digital forensics, network vulnerability scanning, open-source intelligence, penetration testing, and social engineering. It functions as a multi-purpose framework for automating reconnaissance and executing security audits across diverse network environments. The project features a specialized phishing and social engineering toolkit used for cloning websites, masking URLs, and deploying deceptive pages to capture user credentials. It also includes a remote access Trojan builder for generating platform-specific exe

    Shellhackhackinghacking-tool
    View on GitHub↗3,020
  • bootandy/dustbootandy avatar

    bootandy/dust

    12,591View on GitHub↗

    Dust is a command line disk usage analyzer written in Rust. It functions as a disk space visualization tool and recursive directory size scanner used to identify large files and directories through a formatted list of disk consumption across a filesystem. The tool differentiates itself by providing a recursive tree view to visualize space distribution and the ability to output directory and file size data in machine-readable formats for external processing and analysis. Its broader capabilities include filesystem auditing and storage capacity management. This is achieved through file and dir

    Rust
    View on GitHub↗12,591
  • lancedb/lancedblancedb avatar

    lancedb/lancedb

    9,031View on GitHub↗

    LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters

    HTMLapproximate-nearest-neighbor-searchimage-searchnearest-neighbor-search
    View on GitHub↗9,031
  • shekhargulati/52-technologies-in-2016shekhargulati avatar

    shekhargulati/52-technologies-in-2016

    7,311View on GitHub↗

    This project serves as a comprehensive educational repository and technical reference collection, documenting a wide range of software engineering practices and modern development technologies. It provides a structured learning path for developers, curating tutorials and practical examples that cover the full lifecycle of application development, from initial project scaffolding to deployment and maintenance. The repository distinguishes itself by offering deep technical insights into complex architectural patterns, including actor-based concurrency models for managing parallel tasks and cont

    JavaScriptawesomeawesome-listblog
    View on GitHub↗7,311
Compare all 30 related projects→