Back to slotix/dataflowkit
Open-source alternatives to Dataflowkit
30 open-source projects similar to slotix/dataflowkit, ranked by how many features they have in common. Compare stars, activity and what each one does to find the best Dataflowkit alternative.
- asciimoo/colly
asciimoo/colly
25,348Auf GitHub ansehenColly is a web scraping framework and concurrent crawler written in Go. It provides a system for traversing web pages, following links, and extracting structured data from HTML and XML documents. The framework includes a distributed scraping engine designed to spread data collection tasks across multiple instances to increase throughput. It ensures compliance with website owner policies by automatically reading and respecting robots.txt files. The system manages request lifecycles through domain-based rate limiting, concurrency controls, and session management via a stateful cookie jar. It s
Go - moabukar/tech-vault
moabukar/tech-vault
3,351Auf GitHub ansehentech-vault is a command-line technical interview bank and knowledge base designed for practicing engineering questions across various technical domains. It functions as a terminal-based application that stores structured study materials and interview questions as markdown files, which are then rendered directly within the system console. The project distinguishes itself through a delivery model that uses command-line argument parsing to filter content by topic or difficulty. It also includes a random selection algorithm to pick individual questions from the collection for spontaneous study se
HCL - adrianmo/go-nmea
adrianmo/go-nmea
- ai/nanoid
ai/nanoid
26,821Auf GitHub ansehenNanoid is a library for generating unique, fixed-length identifiers designed for distributed systems and database indexing. It produces compact, URL-safe strings by mapping random byte values to a custom character set, allowing for consistent memory allocation and predictable indexing performance across independent nodes without the need for central coordination. The library distinguishes itself by utilizing system-level, cryptographically secure entropy sources to ensure that every generated identifier is statistically unpredictable. This approach provides resistance against collision attack
JavaScript
