awesome-repositories.com
博客
MCP
awesome-repositories.com

通过 AI 驱动的搜索，发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
jmcarp avatar

jmcarp/robobrowser

0
View on GitHub↗
3,696 星标·333 分支·Python·BSD-3-Clause·3 次浏览

Robobrowser

Robobrowser is a Python web scraping library that provides a headless browser emulator and an HTML DOM parser. It is designed to programmatically navigate websites, interact with HTML forms, and extract data from web pages.

The tool includes a web request caching mechanism to store previously fetched web content, reducing network traffic and increasing loading speeds for repeated requests.

It covers capabilities for automated web navigation, programmatic web scraping, and web form automation, including the ability to populate input fields and trigger submission events. The system also manages stateful sessions to track navigation across multiple requests.

Features

  • Headless Browser Simulation - Simulates browser navigation and user sessions via HTTP requests without requiring a graphical user interface.
  • DOM Tree Construction - Provides a mechanism to convert HTML responses into a hierarchical Document Object Model for structured data retrieval.
  • Programmatic Form Control - Allows for the programmatic population of input fields and the triggering of form submission events.
  • Automated UI Form Filling - Simulates user interaction by automatically entering text and submitting data through web forms.
  • Automated Form Fillers - Automatically fills and submits web forms to access content located behind input-restricted pages.
  • Headless Browser Emulation - Implements a programmatic interface that emulates browser behavior and standards for server-side scraping.
  • Headless Web Navigation - Facilitates programmatic movement through website hierarchies by following links in a headless session.
  • HTML Parsers - Converts raw HTML strings into structured trees for programmatic analysis and data extraction.
  • Session State Management - Tracks state and session data across multiple HTTP requests to maintain a continuous browsing context.
  • Browser Navigation - Enables programmatic navigation to specific URLs and the following of links within web pages.
  • Web Scraping and Extraction - Provides tools for parsing HTML and using selectors to extract structured data from websites.
  • Web Scraping Libraries - Offers a comprehensive Python library for automated web navigation, form interaction, and data extraction.
  • Web Page Caches - Stores retrieved HTML content locally to avoid redundant network requests during the scraping process.
  • Response Caching - Caches previously fetched web responses to minimize network traffic and improve loading speeds for repeated requests.
  • Python Crawling Frameworks - Library for browsing the web without a standalone browser.
  • Simulated Browser Environments - Pythonic library for web browsing without a standalone browser.
  • Web Scraping - Library for browsing websites without a browser.

Star 历史

jmcarp/robobrowser 的 Star 历史图表jmcarp/robobrowser 的 Star 历史图表

AI 搜索

探索更多 awesome 仓库

用简单的语言描述您的需求 —— AI 将根据相关性为您从数千个精选开源项目中进行排序。

Start searching with AI

常见问题解答

jmcarp/robobrowser 是做什么的？

Robobrowser is a Python web scraping library that provides a headless browser emulator and an HTML DOM parser. It is designed to programmatically navigate websites, interact with HTML forms, and extract data from web pages.

jmcarp/robobrowser 的主要功能有哪些？

jmcarp/robobrowser 的主要功能包括：Headless Browser Simulation, DOM Tree Construction, Programmatic Form Control, Automated UI Form Filling, Automated Form Fillers, Headless Browser Emulation, Headless Web Navigation, HTML Parsers。

jmcarp/robobrowser 有哪些开源替代品？

jmcarp/robobrowser 的开源替代品包括： hickford/mechanicalsoup — MechanicalSoup is a Python web automation library designed to simulate browser behavior. It functions as a toolkit for… sunra/php-simple-html-dom-parser — php-simple-html-dom-parser is a PHP library for parsing HTML documents into a traversable in-memory tree that handles… sparklemotion/mechanize — Mechanize is a Ruby library for web browser automation and headless browser emulation. It allows for programmatically… mechanicalsoup/mechanicalsoup — MechanicalSoup is a Python web automation library and scraping framework designed to simulate browser sessions and… ionicabizau/scrape-it — scrape-it is a Node.js web scraper and HTML parser designed to extract structured data from websites and HTML files.… anglesharp/anglesharp — AngleSharp is an HTML5 DOM parser and web scraping framework designed to parse HTML5, SVG, and MathML documents into a…

Robobrowser 的开源替代方案

相似的开源项目，按与 Robobrowser 的功能重合度排序。
  • hickford/mechanicalsouphickford 的头像

    hickford/MechanicalSoup

    4,868在 GitHub 上查看↗

    MechanicalSoup is a Python web automation library designed to simulate browser behavior. It functions as a toolkit for web scraping and automation, providing an HTML parsing engine and an HTTP session manager to interact with websites programmatically. The library enables headless web interaction by mimicking a real user session. It manages persistent state through cookie handling and automatic redirect following, allowing for programmatic website navigation and the simulation of complex browser interactions. Its capabilities cover automated form population and submission using CSS selectors

    Python
    在 GitHub 上查看↗4,868
  • sunra/php-simple-html-dom-parsersunra 的头像

    sunra/php-simple-html-dom-parser

    1,286在 GitHub 上查看↗

    php-simple-html-dom-parser is a PHP library for parsing HTML documents into a traversable in-memory tree that handles malformed markup gracefully. It constructs a complete object graph from raw HTML strings while retaining document structure and relational node hierarchies, and supports lazy child node iteration to load descendant nodes on demand for large documents. The library features a CSS selector query engine that translates selector expressions to locate and filter matching nodes within the parsed DOM tree. Programmatic accessors provide direct string-based attribute retrieval to extra

    HTML
    在 GitHub 上查看↗1,286
  • sparklemotion/mechanizesparklemotion 的头像

    sparklemotion/mechanize

    4,443在 GitHub 上查看↗

    Mechanize is a Ruby library for web browser automation and headless browser emulation. It allows for programmatically navigating websites and simulating human behavior without a graphical user interface. The library provides an automated interface for populating and submitting web forms, including text fields, checkboxes, and file uploads. It manages stateful sessions by automatically storing and sending cookies across multiple requests to maintain user authentication and identity. Additional capabilities include web data scraping, the ability to download remote web content, and the maintena

    Ruby
    在 GitHub 上查看↗4,443
  • mechanicalsoup/mechanicalsoupMechanicalSoup 的头像

    MechanicalSoup/MechanicalSoup

    4,868在 GitHub 上查看↗

    MechanicalSoup is a Python web automation library and scraping framework designed to simulate browser sessions and navigate websites without requiring JavaScript execution. It functions as an HTML parsing tool and HTTP session manager, allowing for the programmatic retrieval of page content and the automation of web interactions. The library distinguishes itself by combining session persistence with automated form interaction. It maps user data to HTML input fields and selection boxes for programmatic submission and maintains authenticated states by managing cookies and user-agent headers acr

    Pythonbeautifulsoupmechanicalsouppypi
    在 GitHub 上查看↗4,868
查看 Robobrowser 的所有 30 个替代方案→