awesome-repositories.com
Blog
MCP
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektMCP-ServerÜber unsRanking-MethodikPresse
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

2 Repos

Awesome GitHub RepositoriesAutonomous Data Gathering

AI-driven systems that navigate the web independently to discover and collect specific datasets without predefined URLs.

Distinct from Resource Gathering Automation: The candidates focus on game resources, cybersecurity intelligence, or networking patterns, whereas this is about general-purpose AI web navigation for data extraction.

Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Autonomous Data Gathering. Refine with filters or upvote what's useful.

  1. Home
  2. Artificial Intelligence & ML
  3. Autonomous Data Gathering

Awesome Autonomous Data Gathering GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • mendableai/firecrawlAvatar von mendableai

    mendableai/firecrawl

    139,399Auf GitHub ansehen↗

    Firecrawl is a headless browser automation tool and web crawling engine designed to extract structured data from the web. It functions as an API that transforms raw website content and documents into clean markdown and JSON formats to serve as context for large language models. The project distinguishes itself by using natural language prompts to translate human instructions into targeted data extraction tasks and browser actions. It can execute interactive page navigation, such as clicking and scrolling, and perform automated web research to retrieve structured data without manual interventi

    Enables AI-driven autonomous navigation and collection of specific datasets from the web without predefined URLs.

    TypeScript
    Auf GitHub ansehen↗139,399
  • mendableai/firecrawl-mcp-serverAvatar von mendableai

    mendableai/firecrawl-mcp-server

    6,602Auf GitHub ansehen↗

    This project is a Model Context Protocol server that connects large language models to web scraping and crawling tools. It functions as a bridge, allowing LLM clients to utilize a web crawling engine and scraping utilities to extract and process web data. The server integrates a markdown web converter that transforms dynamic web pages and PDF documents into clean markdown to optimize consumption by AI models. It also provides a browser automation interface for controlling headless sessions and bypassing access restrictions. The system covers broad capabilities including large-scale website d

    Firecrawl uses AI to autonomously navigate the web and gather specific datasets without predefined URLs.

    JavaScript
    Auf GitHub ansehen↗6,602