1 repositorio
Awesome GitHub RepositoriesCrawl Data Streaming
Streaming discovered web page data in real-time via websockets or webhooks.
Distinct from Real-Time Data Streaming: Distinct from general Real-Time Data Streaming: specifically targets the streaming of web crawl results as they are discovered.
Explore 1 awesome GitHub repository matching data & databases · Crawl Data Streaming. Refine with filters or upvote what's useful.
Awesome Crawl Data Streaming GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- mendableai/firecrawl-mcp-server
mendableai/firecrawl-mcp-server
6,602Ver en GitHubThis project is a Model Context Protocol server that connects large language models to web scraping and crawling tools. It functions as a bridge, allowing LLM clients to utilize a web crawling engine and scraping utilities to extract and process web data. The server integrates a markdown web converter that transforms dynamic web pages and PDF documents into clean markdown to optimize consumption by AI models. It also provides a browser automation interface for controlling headless sessions and bypassing access restrictions. The system covers broad capabilities including large-scale website d
Delivers page data in real-time via websockets or webhooks as it is discovered during a crawl.
JavaScript
