awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
p0dalirius avatar

p0dalirius/robotstester

0
View on GitHub↗
48 stars·4 forks·Python·GPL-3.0·7 viewspodalirius.net↗

Robotstester

This Python script can enumerate all URLs present in robots.txt files, and test whether they can be accessed or not.

Features

  • Reconnaissance and Dorking - Enumerate and test accessibility of URLs found in robots files.

Star history

Star history chart for p0dalirius/robotstesterStar history chart for p0dalirius/robotstester

How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Open-source alternatives to Robotstester

Similar open-source projects, ranked by how many features they share with Robotstester.
  • techgaun/github-dorkstechgaun avatar

    techgaun/github-dorks

    3,140View on GitHub↗

    This project is a GitHub secret scanner and dorking tool designed to identify leaked credentials and private keys within repositories. It functions as an API reconnaissance utility that uses curated search queries and automated dorks to locate sensitive data across public and enterprise GitHub instances. The tool enables security vulnerability research and enterprise auditing by targeting both public cloud instances and private enterprise installations via configurable base URLs. It utilizes token-based authentication to access private repository content and bypass API rate limits. The syste

    Pythondorkdorkergithub-dork
    View on GitHub↗3,140
  • daffainfo/allaboutbugbountydaffainfo avatar

    daffainfo/AllAboutBugBounty

    6,644View on GitHub↗

    AllAboutBugBounty is a curated collection of bug bounty techniques and payloads for web application security testing. It serves as a reference resource covering common web vulnerabilities and exploitation methods for security researchers, providing a structured approach to identifying and exploiting web application security flaws in bug bounty programs. The repository covers a wide range of attack categories including authentication bypass, cross-site scripting injection, server-side request forgery, web cache poisoning, and business logic abuse. It includes techniques for bypassing access co

    bugbugbountybugbountytips
    View on GitHub↗6,644
  • c3n7ral051nt4g3ncy/webosintC3n7ral051nt4g3ncy avatar

    C3n7ral051nt4g3ncy/webosint

    344View on GitHub↗

    W3b0s1nt (WebOSINT) is a Python tool/script for passive Domain Intelligence gathering.

    Python
    View on GitHub↗344
  • channyein1337/jsleakchannyein1337 avatar

    channyein1337/jsleak

    589View on GitHub↗

    jsleak is a tool to find secret , paths or links in the source code during the recon.

    Go
    View on GitHub↗589
See all 30 alternatives to Robotstester→

Frequently asked questions

What does p0dalirius/robotstester do?

This Python script can enumerate all URLs present in robots.txt files, and test whether they can be accessed or not.

What are the main features of p0dalirius/robotstester?

The main features of p0dalirius/robotstester are: Reconnaissance and Dorking.

What are some open-source alternatives to p0dalirius/robotstester?

Open-source alternatives to p0dalirius/robotstester include: daffainfo/allaboutbugbounty — AllAboutBugBounty is a curated collection of bug bounty techniques and payloads for web application security testing.… techgaun/github-dorks — This project is a GitHub secret scanner and dorking tool designed to identify leaked credentials and private keys… c3n7ral051nt4g3ncy/webosint — W3b0s1nt (WebOSINT) is a Python tool/script for passive Domain Intelligence gathering. d3ext/aort. channyein1337/jsleak — jsleak is a tool to find secret , paths or links in the source code during the recon. blacknon/pydork — Scraping and listing text and image searches on Google, Bing, DuckDuckGo, Baidu, Yahoo japan.