A high performance web crawler / scraper in Elixir.
Las características principales de fredwu/crawler son: HTTP Clients and Servers.
Las alternativas de código abierto para fredwu/crawler incluyen: ipfs/js-ipfs — js-ipfs is an HTTP client library that connects to any IPFS daemon, enabling JavaScript applications to interact with… twisted/twisted — Twisted is an event-driven networking engine for Python that provides a framework for building asynchronous network… micronaut-projects/micronaut-core — Micronaut Application Framework. codeplea/hands-on-network-programming-with-c — This project serves as a comprehensive tutorial and technical resource for developing network applications in the C… crowdhailer/raxx — Interface for HTTP webservers, frameworks and clients. clj-commons/aleph — Asynchronous streaming communication for Clojure - web server, web client, and raw TCP/UDP.
Twisted is an event-driven networking engine for Python that provides a framework for building asynchronous network applications. At its core, it uses a reactor-based event loop to drive all input and output, dispatching callbacks in a single thread without blocking. The library implements a deferred promise chain for composing asynchronous logic, along with a protocol and factory pattern that separates connection state management from protocol handling, enabling reusable handlers for different network protocols. The framework supports multiple event loops across platforms, including select,
Micronaut Application Framework
js-ipfs is an HTTP client library that connects to any IPFS daemon, enabling JavaScript applications to interact with the InterPlanetary File System. It provides a promise-based asynchronous API for managing content-addressed storage, where all data is identified by cryptographic hashes (CIDs) for immutable references and deduplication. The library communicates with a remote IPFS node through HTTP requests, supporting cancellation of in-flight operations via standard AbortController signals. The library offers a comprehensive set of capabilities for working with IPFS, including adding and ret
This project serves as a comprehensive tutorial and technical resource for developing network applications in the C programming language. It focuses on the practical application of the Berkeley socket interface, guiding users through the implementation of low-level network protocols and the management of data transmission across both connection-oriented and connectionless streams. The material distinguishes itself by covering the full lifecycle of network communication, from initializing system-level protocol stacks and resolving domain names to managing complex connection behaviors. It provi