awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

16 repositorios

Awesome GitHub RepositoriesDOM-Based Extractions

Runs JavaScript inside browser contexts to read DOM elements and return formatted data such as text and links.

Distinct from Structured Data Extraction: Distinct from Structured Data Extraction: focuses on extracting data from live DOM elements via JavaScript execution rather than from static documents or model outputs.

Explore 16 awesome GitHub repositories matching data & databases · DOM-Based Extractions. Refine with filters or upvote what's useful.

Awesome DOM-Based Extractions GitHub Repositories

Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
  • jackwener/opencliAvatar de jackwener

    jackwener/OpenCLI

    25,060Ver en GitHub↗

    OpenCLI is an AI browser automation framework designed to automate web navigation, data extraction, and repetitive browser tasks. It functions as a browser-based CLI generator that converts website interfaces into command-line interactions by controlling authenticated web browser sessions. The project features a web-to-CLI adapter platform for mapping web elements to programmatic command-line inputs and outputs. It includes a browser profile manager to organize and switch between isolated session profiles to maintain different user identities. The toolkit provides capabilities for web conten

    Provides a mechanism to map website DOM patterns to structured data outputs using predefined rules.

    JavaScriptai-agentai-agentsai-tools
    Ver en GitHub↗25,060
  • mattboldt/typed.jsAvatar de mattboldt

    mattboldt/typed.js

    16,276Ver en GitHub↗

    Typed.js is a JavaScript typing animation library and DOM text animator used to simulate a user typing and erasing text. It serves as a frontend animation tool for creating dynamic text transitions and visual effects within HTML elements. The library distinguishes itself through the ability to render animated typing sequences directly inside the placeholder attribute of HTML input fields. It also supports reading animation strings from static HTML elements to maintain search engine visibility and accessibility. The tool covers animation control with configurable timing and playback state man

    Reads initial animation strings from static HTML elements to maintain search engine visibility and accessibility.

    JavaScript
    Ver en GitHub↗16,276
  • ntegrals/openbrowserAvatar de ntegrals

    ntegrals/openbrowser

    9,472Ver en GitHub↗

    OpenBrowser is an AI web agent toolkit and automation framework designed to translate natural language instructions into executable browser workflows. It functions as a headless browser controller and orchestrator, enabling the creation of autonomous agents that navigate websites, interact with elements, and extract data using plain English commands. The system features a sandboxed execution environment that utilizes domain whitelists and memory limits to ensure secure web interaction. It distinguishes itself through a command-line interface for triggering autonomous tasks with configurable m

    Retrieves raw page structures from the DOM and converts them into structured text for LLM processing.

    TypeScriptai-agentsautomationclaude
    Ver en GitHub↗9,472
  • n4ze3m/page-assistAvatar de n4ze3m

    n4ze3m/page-assist

    8,023Ver en GitHub↗

    Page Assist es una herramienta de integración de IA basada en navegador que proporciona una interfaz de barra lateral para interactuar con modelos de IA mientras se navega por la web. Se centra en el chat y el análisis de contenido web con enfoque en la privacidad, permitiendo a los usuarios extraer y consultar información de páginas web activas para recibir respuestas conscientes del contexto. El proyecto se distingue por su integración de IA local, permitiendo conexiones a modelos alojados localmente o endpoints de API privados para procesar datos sin depender de servicios en la nube. También admite conversaciones colaborativas con IA mediante enlaces de uso compartido público o infraestructura de alojamiento propio para un mayor control de los datos. El sistema incluye capacidades para la automatización del navegador, como el control de pestañas y la interacción con elementos de la página al exponer la sesión del navegador como un conjunto de herramientas. Además, admite el procesamiento de visión mediante capturas de pantalla de páginas web y la extracción de contenido basada en el DOM para un análisis completo de la página.

    Uses JavaScript to extract text and metadata from the live DOM for AI prompt context.

    TypeScript
    Ver en GitHub↗8,023
  • interstellard/chatgpt-advancedAvatar de interstellard

    interstellard/chatgpt-advanced

    6,445Ver en GitHub↗

    This project is a browser extension and toolset designed to integrate real-time web search results and extracted page content into large language model prompts. It functions as a web search integrator and content parser that feeds current internet data into conversational AI interfaces to ensure responses are grounded in evidence. The system includes a prompt template manager for storing and executing pre-defined structures that trigger automated web crawls. It enables deep research workflows by performing comprehensive searches to generate detailed responses supported by citations and links

    Runs JavaScript inside browser contexts to read DOM elements and return formatted text and links from live pages.

    TypeScriptaibrowser-extensionchatgpt
    Ver en GitHub↗6,445
  • steel-dev/steel-browserAvatar de steel-dev

    steel-dev/steel-browser

    6,450Ver en GitHub↗

    Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome browser sessions. It enables programmatic browsing and web scraping using standard automation tools like Puppeteer, Playwright, and Selenium, connecting to cloud-hosted browser instances via WebSocket and the Chrome DevTools Protocol. The platform supports both headless and headful browser sessions, with language-specific SDKs for TypeScript and Python. The service distinguishes itself through comprehensive anti-detection capabilities, including residential proxy rotation, CAPTCHA

    Runs JavaScript inside browser contexts to read DOM elements and return formatted data such as text and links.

    TypeScriptaiai-agentsai-tools
    Ver en GitHub↗6,450
  • executeautomation/mcp-playwrightAvatar de executeautomation

    executeautomation/mcp-playwright

    5,237Ver en GitHub↗

    This project is a Model Context Protocol server that enables Large Language Models to control Playwright browsers for web automation, scraping, and end-to-end testing. It functions as a programmable interface for executing JavaScript, capturing screenshots, and interacting with web elements across multiple browser engines. The server exposes browser automation capabilities as a set of standardized tools that models can discover and invoke. It supports session-based browser isolation to ensure unique contexts for each client connection and provides a transport layer using either standard input

    Retrieves page content by filtering HTML and removing scripts to provide clean text for LLM processing.

    TypeScript
    Ver en GitHub↗5,237
  • neet-nestor/telegram-media-downloaderAvatar de Neet-Nestor

    Neet-Nestor/Telegram-Media-Downloader

    4,491Ver en GitHub↗

    Telegram-Media-Downloader is a web media scraper and restricted content downloader designed to extract images and videos from the Telegram web interface for local storage. It functions by programmatically automating a web browser to capture media from chats and stories. The utility specifically enables the recovery of restricted content from groups and channels where administrators have disabled the native download function. It bypasses these restrictions by identifying media elements within the browser to locate source URLs. The system includes capabilities for session-based authentication,

    Uses JavaScript to read live DOM elements in the browser to identify and extract hidden media source URLs.

    JavaScriptgreasyforkgreasymonkeygreasymonkey-userscript
    Ver en GitHub↗4,491
  • syhyz1990/baiduyunAvatar de syhyz1990

    syhyz1990/baiduyun

    4,379Ver en GitHub↗

    Este proyecto es una colección de scripts de automatización de navegador y herramientas de personalización de interfaz de usuario diseñadas para la extracción de enlaces de almacenamiento en la nube y la gestión de descargas de archivos por lotes. Su propósito principal es recuperar URLs de descarga directa de proveedores de almacenamiento en la nube para eludir restricciones web y permitir descargas externas. La herramienta se integra con gestores de descargas externos reenviando los enlaces extraídos mediante solicitudes HTTP o JSON-RPC. Automatiza la detección de enlaces de almacenamiento y códigos de extracción en páginas web para facilitar la recopilación simultánea de múltiples URLs de archivos. Más allá de la extracción de enlaces, el proyecto incluye personalizaciones de la interfaz de la página web, como un interruptor de modo nocturno y la capacidad de revelar contraseñas enmascaradas. También proporciona características de utilidad, incluyendo la traducción de texto mediante atajos de teclado.

    Uses JavaScript to scan the live DOM of webpages for cloud storage links and extraction codes.

    JavaScriptbaiduchromeidm
    Ver en GitHub↗4,379
  • kamranahmedse/pennywiseAvatar de kamranahmedse

    kamranahmedse/pennywise

    3,864Ver en GitHub↗

    Pennywise is a cross-platform desktop utility that functions as a floating web browser and media player. It allows users to maintain a persistent, always-on-top window for monitoring web content or viewing media while interacting with other applications. The tool distinguishes itself through window management controls that include adjustable opacity and an interaction passthrough toggle. This mechanism disables window interactivity, allowing mouse and keyboard inputs to reach processes positioned behind the interface. The application also includes capabilities for distraction-free media view

    Parses webpage structures using JavaScript to isolate specific video elements for playback.

    JavaScript
    Ver en GitHub↗3,864
  • ruipgil/scraperjsAvatar de ruipgil

    ruipgil/scraperjs

    3,718Ver en GitHub↗

    Scraperjs is a JavaScript web scraping library and headless browser automation tool designed to extract structured data from both static HTML and JavaScript-rendered websites. It functions as an asynchronous scraping workflow orchestrator and a selector-based engine for transforming unstructured web content into usable data. The library distinguishes itself by managing a shared browser instance across multiple tasks to optimize resource usage and reduce startup latency. It supports custom script injection into sandboxed browser environments to manipulate the DOM or execute browser-side logic

    Transforms unstructured web content into usable data by reading DOM elements via selector-based extraction.

    JavaScript
    Ver en GitHub↗3,718
  • joeyism/linkedin_scraperAvatar de joeyism

    joeyism/linkedin_scraper

    3,746Ver en GitHub↗

    This project is a LinkedIn data scraper and professional profile extractor designed to collect information from professional networking sites. It functions as a headless browser scraper that extracts professional profiles, company details, and job listings using automated browser sessions. The tool includes a session manager that saves and loads authentication cookies to maintain persistent access to protected profiles. It employs configurable browser settings and user-agent mimicry to simulate human activity and bypass bot detection. Data extraction capabilities cover person profiles, compa

    Extracts professional data by querying the HTML structure of rendered web pages using JavaScript.

    Pythonchromecompanydriver
    Ver en GitHub↗3,746
  • deathau/markdownloadAvatar de deathau

    deathau/markdownload

    3,678Ver en GitHub↗

    Markdownload is a browser extension that functions as a markdown web clipper, converting webpages and selected text into clean markdown files for offline storage and archiving. It operates as a content extractor that isolates the main document from the page while removing navigation elements and advertisements. The tool includes a template generator for injecting dynamic front-matter and metadata into documents via user-defined placeholders. It also serves as a local media downloader that saves remote images to the filesystem and updates links to reference those local files. Additionally, it

    Parses the document object model to isolate main content by removing navigation, advertisements, and irrelevant layout elements.

    JavaScriptchrome-extensionedge-extensionfirefox-addon
    Ver en GitHub↗3,678
  • obsidianmd/obsidian-clipperAvatar de obsidianmd

    obsidianmd/obsidian-clipper

    3,032Ver en GitHub↗

    This project is a markdown web clipper and local-first web archiver. It functions as a browser extension that extracts web page content and highlights, saving them as structured markdown files for personal knowledge management and long-term preservation. The utility acts as a template-based content extractor, transforming raw website data into formatted notes. It uses custom variables and processing filters to organize how captured information is structured before it is sent to a local directory.

    Parses the live document object model to isolate primary text and highlights for extraction.

    TypeScriptbravebrowser-extensionchrome
    Ver en GitHub↗3,032
  • huaying/instagram-crawlerAvatar de huaying

    huaying/instagram-crawler

    1,335Ver en GitHub↗

    This project is a web scraping and automation tool designed to collect public data from Instagram and perform automated social media interactions. It functions by gathering profile details, captions, media files, and engagement metrics directly from web pages, bypassing the need for official developer interfaces or platform-specific credentials. The tool distinguishes itself by combining data extraction with automated engagement capabilities. It allows users to programmatically interact with content by liking posts that match specific search criteria or hashtags, aiming to increase account vi

    Extracts structured information by traversing the document object model of rendered web pages to locate specific content nodes.

    Pythonautoautolikerinstagram
    Ver en GitHub↗1,335
  • rezach/my-budgetAvatar de reZach

    reZach/my-budget

    956Ver en GitHub↗

    My-budget is a cross-platform desktop application designed for personal finance management. It functions as a local-first budgeting tool that allows users to track income and expenses while maintaining complete control over their financial data without relying on cloud services. The application distinguishes itself by integrating automated transaction ingestion, which retrieves and parses financial records directly from banking websites. To ensure privacy, all stored transaction history and budget records are protected by local encryption using user-defined passphrases, keeping sensitive info

    Extracts structured financial data from banking websites by programmatically traversing and parsing DOM elements.

    JavaScriptbudgetingfreesoftware
    Ver en GitHub↗956
  1. Home
  2. Data & Databases
  3. Structured Data Extraction
  4. DOM-Based Extractions

Explorar subetiquetas

  • SEO-Friendly Content ExtractionExtracting text from static DOM elements to be used as animation source while preserving search engine visibility. **Distinct from DOM-Based Extractions:** Focuses on reading content for animation purposes specifically to maintain accessibility and SEO.