Awesome GitHub RepositoriesDOM-Based Extractions

OpenCLI is an AI browser automation framework designed to automate web navigation, data extraction, and repetitive browser tasks. It functions as a browser-based CLI generator that converts website interfaces into command-line interactions by controlling authenticated web browser sessions. The project features a web-to-CLI adapter platform for mapping web elements to programmatic command-line inputs and outputs. It includes a browser profile manager to organize and switch between isolated session profiles to maintain different user identities. The toolkit provides capabilities for web conten

Typed.js is a JavaScript typing animation library and DOM text animator used to simulate a user typing and erasing text. It serves as a frontend animation tool for creating dynamic text transitions and visual effects within HTML elements. The library distinguishes itself through the ability to render animated typing sequences directly inside the placeholder attribute of HTML input fields. It also supports reading animation strings from static HTML elements to maintain search engine visibility and accessibility. The tool covers animation control with configurable timing and playback state man

OpenBrowser is an AI web agent toolkit and automation framework designed to translate natural language instructions into executable browser workflows. It functions as a headless browser controller and orchestrator, enabling the creation of autonomous agents that navigate websites, interact with elements, and extract data using plain English commands. The system features a sandboxed execution environment that utilizes domain whitelists and memory limits to ensure secure web interaction. It distinguishes itself through a command-line interface for triggering autonomous tasks with configurable m

Page Assist ist ein browserbasiertes KI-Integrationstool, das eine Seitenleisten-Schnittstelle für die Interaktion mit KI-Modellen während des Surfens bietet. Es konzentriert sich auf datenschutzorientiertes Chatten und die Analyse von Webinhalten, wodurch Benutzer Informationen aus aktiven Webseiten extrahieren und abfragen können, um kontextbezogene Antworten zu erhalten. Das Projekt zeichnet sich durch lokale KI-Integration aus, die Verbindungen zu lokal gehosteten Modellen oder privaten API-Endpunkten ermöglicht, um Daten zu verarbeiten, ohne auf Cloud-Dienste angewiesen zu sein. Es unterstützt zudem kollaborative KI-Konversationen über öffentliche Freigabelinks oder selbst gehostete Freigabeinfrastrukturen für eine bessere Datenkontrolle. Das System umfasst Funktionen für die Browser-Automatisierung, wie das Steuern von Tabs und die Interaktion mit Seitenelementen, indem die Browsersitzung als eine Reihe von Tools bereitgestellt wird. Es unterstützt zudem die Bildverarbeitung durch Webseiten-Screenshots und DOM-basierte Inhaltsextraktion für eine umfassende Seitenanalyse.

This project is a browser extension and toolset designed to integrate real-time web search results and extracted page content into large language model prompts. It functions as a web search integrator and content parser that feeds current internet data into conversational AI interfaces to ensure responses are grounded in evidence. The system includes a prompt template manager for storing and executing pre-defined structures that trigger automated web crawls. It enables deep research workflows by performing comprehensive searches to generate detailed responses supported by citations and links

Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome browser sessions. It enables programmatic browsing and web scraping using standard automation tools like Puppeteer, Playwright, and Selenium, connecting to cloud-hosted browser instances via WebSocket and the Chrome DevTools Protocol. The platform supports both headless and headful browser sessions, with language-specific SDKs for TypeScript and Python. The service distinguishes itself through comprehensive anti-detection capabilities, including residential proxy rotation, CAPTCHA

This project is a Model Context Protocol server that enables Large Language Models to control Playwright browsers for web automation, scraping, and end-to-end testing. It functions as a programmable interface for executing JavaScript, capturing screenshots, and interacting with web elements across multiple browser engines. The server exposes browser automation capabilities as a set of standardized tools that models can discover and invoke. It supports session-based browser isolation to ensure unique contexts for each client connection and provides a transport layer using either standard input

Telegram-Media-Downloader ist ein Web-Media-Scraper und Downloader für eingeschränkte Inhalte, der entwickelt wurde, um Bilder und Videos aus dem Telegram-Web-Interface für die lokale Speicherung zu extrahieren. Er funktioniert durch die programmatische Automatisierung eines Webbrowsers, um Medien aus Chats und Stories zu erfassen. Das Utility ermöglicht gezielt die Wiederherstellung eingeschränkter Inhalte aus Gruppen und Kanälen, in denen Administratoren die native Download-Funktion deaktiviert haben. Es umgeht diese Einschränkungen, indem es Medienelemente innerhalb des Browsers identifiziert, um Quell-URLs zu lokalisieren. Das System umfasst Funktionen für Sitzungsbasierte Authentifizierung, Headless-Browser-Automatisierung und Puffer-basiertes File-Streaming, um die Speicherstabilität bei großen Übertragungen zu gewährleisten. Es verwaltet zudem die Organisation von Dateien durch eine lokale Verzeichnishierarchie basierend auf Chat-Identifikatoren und Zeitstempeln, während es gleichzeitig eine Fortschrittsüberwachung in Echtzeit bietet.

This project is a collection of browser automation scripts and user interface customization tools designed for cloud storage link extraction and batch file download management. Its primary purpose is to retrieve direct download URLs from cloud storage providers to bypass web restrictions and enable external downloads. The tool integrates with external download managers by forwarding extracted links via HTTP requests or JSON-RPC. It automates the detection of storage links and extraction codes on webpages to facilitate the simultaneous collection of multiple file URLs. Beyond link extraction,

Pennywise is a cross-platform desktop utility that functions as a floating web browser and media player. It allows users to maintain a persistent, always-on-top window for monitoring web content or viewing media while interacting with other applications. The tool distinguishes itself through window management controls that include adjustable opacity and an interaction passthrough toggle. This mechanism disables window interactivity, allowing mouse and keyboard inputs to reach processes positioned behind the interface. The application also includes capabilities for distraction-free media view

Scraperjs is a JavaScript web scraping library and headless browser automation tool designed to extract structured data from both static HTML and JavaScript-rendered websites. It functions as an asynchronous scraping workflow orchestrator and a selector-based engine for transforming unstructured web content into usable data. The library distinguishes itself by managing a shared browser instance across multiple tasks to optimize resource usage and reduce startup latency. It supports custom script injection into sandboxed browser environments to manipulate the DOM or execute browser-side logic

This project is a LinkedIn data scraper and professional profile extractor designed to collect information from professional networking sites. It functions as a headless browser scraper that extracts professional profiles, company details, and job listings using automated browser sessions. The tool includes a session manager that saves and loads authentication cookies to maintain persistent access to protected profiles. It employs configurable browser settings and user-agent mimicry to simulate human activity and bypass bot detection. Data extraction capabilities cover person profiles, compa

Markdownload is a browser extension that functions as a markdown web clipper, converting webpages and selected text into clean markdown files for offline storage and archiving. It operates as a content extractor that isolates the main document from the page while removing navigation elements and advertisements. The tool includes a template generator for injecting dynamic front-matter and metadata into documents via user-defined placeholders. It also serves as a local media downloader that saves remote images to the filesystem and updates links to reference those local files. Additionally, it

This project is a markdown web clipper and local-first web archiver. It functions as a browser extension that extracts web page content and highlights, saving them as structured markdown files for personal knowledge management and long-term preservation. The utility acts as a template-based content extractor, transforming raw website data into formatted notes. It uses custom variables and processing filters to organize how captured information is structured before it is sent to a local directory.

This project is a web scraping and automation tool designed to collect public data from Instagram and perform automated social media interactions. It functions by gathering profile details, captions, media files, and engagement metrics directly from web pages, bypassing the need for official developer interfaces or platform-specific credentials. The tool distinguishes itself by combining data extraction with automated engagement capabilities. It allows users to programmatically interact with content by liking posts that match specific search criteria or hashtags, aiming to increase account vi

My-budget is a cross-platform desktop application designed for personal finance management. It functions as a local-first budgeting tool that allows users to track income and expenses while maintaining complete control over their financial data without relying on cloud services. The application distinguishes itself by integrating automated transaction ingestion, which retrieves and parses financial records directly from banking websites. To ensure privacy, all stored transaction history and budget records are protected by local encryption using user-defined passphrases, keeping sensitive info