3 repos
Awesome GitHub RepositoriesEvent-Driven Data Pipelines
Reactive systems that trigger automated data movement or reconciliation based on incremental changes or streaming events.
Explore 3 awesome GitHub repositories matching data & databases · Event-Driven Data Pipelines. Refine with filters or upvote what's useful.
Awesome Event-Driven Data Pipelines GitHub Repositories
We'll search the best matching repositories with AI.
- firecrawl/firecrawl
Firecrawl is a web data extraction platform designed to convert unstructured web content into clean, LLM-ready formats like markdown or JSON. It functions as an autonomous web crawler and scraper, capable of mapping entire domains, performing recursive navigation, and executing complex data gathering tasks. By leveragi
TypeScriptaiai-agentsai-crawler - macrozheng/mall
This project is an enterprise-grade Java framework designed for building scalable, full-stack e-commerce applications. It provides a comprehensive foundation for microservice-based distributed architectures, enabling the development of complex retail platforms that include product management, order processing, and secu
Javadockerelasticsearchelk - syncthing/syncthing
Syncthing is a decentralized file synchronization engine that maintains consistent data states across multiple devices through peer-to-peer mesh networking. It operates as a background daemon that automatically replicates file creations, modifications, and deletions between trusted nodes without requiring central serve
Gogop2ppeer-to-peer
Explore sub-tags
- Change Data Capture ToolsUtilities that monitor database logs to identify and stream data changes to other systems in real time.
- Event-Driven State ReconciliationMechanisms that detect and resolve inconsistencies between distributed data sources by reacting to specific state-change events.
- Web Data PipelinesAutomated workflows designed to extract, transform, and load data specifically from web-based sources and internet services.