awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
omkarcloud avatar

omkarcloud/botasaurus

0
View on GitHub↗
www.omkar.cloud/botasaurus↗

Botasaurus

Botasaurus is a Python web scraping framework and headless browser automation system used to build scalable data extraction tools. It functions as a web data extraction tool and OCR document parser, converting website content, images, and PDF files into structured formats such as JSON, CSV, and Excel.

The framework distinguishes itself by providing a scraper management interface that allows Python functions to be wrapped in a web-based UI or deployed as standalone desktop applications. This enables non-technical users to trigger extraction jobs and manage tasks via a graphical interface or REST API without writing code.

The system covers a broad range of capabilities including bot detection bypass, proxy rotation, and resource-aware parallel execution to manage large-scale data collection. It provides integrated utilities for session persistence, asynchronous task orchestration, and document text extraction via optical character recognition.

Data management is supported through interchangeable database backends, result caching, and interactive filtering and sorting tools for viewing extracted data.

Features

  • Web Automation and Scraping - Provides a comprehensive framework for programmatic browser control, data extraction, and automated web interactions.
  • Optical Character Recognition - Converts images and PDF files into structured text and spreadsheets using optical character recognition.
  • OCR Document Parsers - Uses optical character recognition to extract structured text and data from images and PDF files.
  • Optical Character Recognitions - Converts images and PDFs into structured formats like Excel or LaTeX using optical character recognition.

Búsqueda con IA

Explora más repositorios increíbles

Describe lo que necesitas en lenguaje sencillo: la IA clasifica miles de proyectos open-source curados por relevancia.

Start searching with AI
3,970 estrellas·342 forks·Python·mit·7 vistas
Bot Detection Evasion - Emulates human-like browser behavior and interaction patterns to circumvent automated bot detection systems.
  • Data Extraction Pipelines - Implements automated workflows for parsing and transforming raw web and document content into structured formats.
  • High-Volume Data Collection - Manages parallel browser instances and rotating proxies to collect massive amounts of information.
  • Web Data Extraction Tools - Converts website content and documents into structured formats like JSON, CSV, and Excel.
  • Headless Browser Automation - Provides an automation system for controlling headless browsers to interact with page elements and manage sessions.
  • Resource-Aware Parallelization - Implements a system that calculates available memory to determine the optimal number of concurrent browser instances for data extraction.
  • Task Schedulers - Schedules, caches, sorts, and filters data extraction jobs to organize the overall processing workflow.
  • Proxy Rotation Services - Distributes outgoing HTTP requests across a pool of rotating proxy servers to bypass IP-based rate limits.
  • UI-to-Function Mappings - Wraps Python functions in a web interface and REST API to automatically generate user-facing task controls.
  • Scraper Management Interfaces - Provides a web and desktop UI for triggering extraction jobs and filtering results for non-technical users.
  • Browser Session Persistence - Saves browser fingerprints and cookies in lightweight profiles to maintain session state and bypass detection across runs.
  • Web Scraping Frameworks - Offers a comprehensive Python framework for building scalable web scrapers with parallel execution and bot bypass.
  • Standalone Data Extractors - Creates standalone local applications to extract data from websites and documents without cloud dependencies.
  • Execution Result Caches - Caches the outputs of web scraping executions to avoid redundant network requests and improve performance.
  • Database Backend Integration - Integrates with production-grade databases using connection strings for scalable result management.
  • Resource-Aware Scaling Controllers - Calculates available system memory to dynamically determine the optimal number of concurrent browser instances.
  • Pluggable Database Backends - Supports interchangeable database backends, allowing users to switch between local storage and production-grade databases.
  • Input List Decomposition - Splits lists of inputs into individual sub-tasks to enable parallel processing of multiple items.
  • Distribution and Packaging - Generates installers and handles automatic updates to distribute logic as a standalone desktop application.
  • Asset Blocking - Implements asset-filtering during page loads to reduce memory usage and increase scraping speed.
  • Asynchronous Task Queues - Splits input lists into individual sub-tasks processed through an asynchronous background queue for concurrency.
  • Asynchronous Task Queues - Runs jobs in a background queue to perform concurrent operations such as scrolling and fetching page details.
  • Concurrent Task Limiters - Provides utilities to cap the number of simultaneous browser instances and network requests to prevent resource exhaustion.
  • Task Result Aggregation - Combines outputs from multiple sub-tasks into a single consolidated result set for streamlined analysis.
  • Browser Automation Interfaces - Provides interfaces that enable users to trigger automated browser tasks and data extraction via web UIs.
  • Application Generators - Generates a graphical user interface for non-technical users to input parameters and manage extraction tasks.
  • Scraper Application Development - Enables building standalone local applications with GUIs for running data extraction tasks.
  • Resource Blocking - Blocks images and heavy assets during the scraping process to reduce load times and save system resources.
  • Browser Session Managers - Controls browser profiles, network proxies, and authenticated sessions while keeping drivers alive to reduce overhead.
  • Task Triggering Interfaces - Wraps functions in a web-based interface and REST API to let users trigger extraction jobs.
  • Historial de estrellas

    Gráfico del historial de estrellas de omkarcloud/botasaurusGráfico del historial de estrellas de omkarcloud/botasaurus

    Preguntas frecuentes

    ¿Qué hace omkarcloud/botasaurus?

    Botasaurus is a Python web scraping framework and headless browser automation system used to build scalable data extraction tools. It functions as a web data extraction tool and OCR document parser, converting website content, images, and PDF files into structured formats such as JSON, CSV, and Excel.

    ¿Cuáles son las características principales de omkarcloud/botasaurus?

    Las características principales de omkarcloud/botasaurus son: Web Automation and Scraping, Optical Character Recognition, OCR Document Parsers, Optical Character Recognitions, Bot Detection Evasion, Data Extraction Pipelines, High-Volume Data Collection, Web Data Extraction Tools.

    ¿Qué alternativas de código abierto existen para omkarcloud/botasaurus?

    Las alternativas de código abierto para omkarcloud/botasaurus incluyen: apify/crawlee — Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction… apify/crawlee-python — Crawlee-python is a web crawling framework for building scalable scrapers using Python. It serves as a comprehensive… garrytan/gstack — gstack is an AI agent framework and development workflow system designed to automate the software development… ultrafunkamsterdam/undetected-chromedriver — Undetected-chromedriver is a framework for automated browser navigation designed to bypass anti-bot security measures.… gsh199449/spider — Spider is a web-based platform designed for automated data extraction, providing a centralized framework to collect,… lining0806/pythonspidernotes — PythonSpiderNotes is a comprehensive instructional resource and framework for building web crawlers and extracting…

    Alternativas open-source a Botasaurus

    Proyectos open-source similares, clasificados según cuántas características comparten con Botasaurus.
    • apify/crawleeAvatar de apify

      apify/crawlee

      24,002Ver en GitHub↗

      Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob

      TypeScriptapifyautomationcrawler
      Ver en GitHub↗24,002
    • apify/crawlee-pythonAvatar de apify

      apify/crawlee-python

      8,097Ver en GitHub↗

      Crawlee-python is a web crawling framework for building scalable scrapers using Python. It serves as a comprehensive tool for web scraping automation, providing a system to extract structured data from websites using both lightweight HTTP requests and headless browser automation. The framework is distinguished by its anti-bot evasion capabilities, which include browser fingerprint impersonation and tiered proxy rotation to bypass detection systems and solve challenges such as Cloudflare. It also incorporates artificial intelligence for autonomous website navigation and schema-based data extra

      Pythonapifyautomationbeautifulsoup
      Ver en GitHub↗8,097
    • garrytan/gstackAvatar de garrytan

      garrytan/gstack

      110,596Ver en GitHub↗

      gstack is an AI agent framework and development workflow system designed to automate the software development lifecycle. It coordinates specialized AI personas to manage tasks across product design, engineering management, and quality assurance, transforming product intent into technical specifications and final releases. The project is distinguished by its deep integration of headless browser automation and semantic code memory. It utilizes a persistent Chromium daemon for web scraping and visual auditing, and implements a searchable knowledge base that logs architectural decisions and repos

      TypeScript
      Ver en GitHub↗110,596
    • ultrafunkamsterdam/undetected-chromedriverAvatar de ultrafunkamsterdam

      ultrafunkamsterdam/undetected-chromedriver

      12,353Ver en GitHub↗

      Undetected-chromedriver is a framework for automated browser navigation designed to bypass anti-bot security measures. It functions by patching browser drivers at the binary level to obscure automation signals, allowing scripts to interact with protected websites without being flagged or blocked by security services. The project distinguishes itself through its ability to maintain stealth during automated sessions, including those executed in headless mode. It achieves this by injecting custom configurations to mimic human user behavior and by hooking into low-level browser debugging protocol

      Pythonanti-botanti-detectionautomation
      Ver en GitHub↗12,353
    Ver las 30 alternativas a Botasaurus→