typhoeus/typhoeus
Typhoeus
Typhoeus is a Ruby wrapper for libcurl that functions as a session-based HTTP client. It provides an interface for making both synchronous and asynchronous network requests.
The project acts as a parallel request manager, using a managed queue to execute multiple network requests concurrently. It further distinguishes itself as a mocking tool for stubbing requests with predefined responses and as a caching layer that stores responses to avoid redundant network calls.
The library covers a broad range of capabilities including session cookie management, response body streaming for large files, and proxy server routing. It also includes security features such as basic authentication and SSL configuration, alongside traffic management tools for request timeouts and verbose debug logging.
Features
- libcurl Wrappers - Provides a Ruby wrapper around the libcurl C library for making synchronous and asynchronous HTTP requests.
- HTTP Request Clients - Provides a session-based HTTP client for executing synchronous and asynchronous network requests.
- Asynchronous HTTP Clients - Sends non-blocking network requests to remote web services to keep the application responsive.
- C-Library Bindings - Functions as a Ruby wrapper for the C-based libcurl library to handle low-level socket and protocol management.
- Client Session Persistence - Maintains client-level state and session cookies across multiple requests to preserve user sessions.
- Non-Blocking Event Loops - Manages multiple network requests simultaneously using a non-blocking event loop to improve throughput.
- HTTP Mock Servers - Returns predefined responses for specific URLs to simulate server behavior during testing.
- Stub Registries - Bypasses the network layer to return predefined mock data for specific URLs during testing.
- Concurrent Request Pooling - Executes multiple network requests concurrently using a managed queue to optimize throughput.
- Response Caching - Stores results of network requests in a local backend to avoid redundant calls and increase loading speeds.
- Response Body Streaming - Processes large response bodies in chunks via callbacks to reduce memory usage and allow mid-stream abortion.
- Response Streaming - Processes large responses in chunks via a callback to reduce memory usage.
- Chunked Response Processing - Processes incoming network data in small fragments via callbacks to maintain a low memory footprint.
- Request Timeout Management - Sets time limits for connections and total request durations to prevent application hangs.
- HTTP File Uploads - Sends files to servers via POST requests with automatic content-type detection and original filenames.
- Proxy Routing - Directs network traffic through proxy servers with optional support for basic authentication.
- Basic Authentication - Applies username and password pairs to requests using standard HTTP basic authentication.
- Session & Cookie Handlers - Reads and writes session cookies to maintain user state across multiple network requests.
- SSL/TLS Connection Security - Implements secure transport layers via SSL configuration and basic authentication for protected web services.
- HTTP Response Memoization - Intercepts duplicate requests within a session to return cached responses instead of initiating new network calls.
- HTTP Request Caching - Stores and reuses HTTP responses in a local backend to reduce redundant network traffic.
- API Request Mocking - Provides tools to intercept network requests and return predefined responses to simulate server behavior during testing.
- Web Automation and Scraping - Provides infrastructure for automated web retrieval by managing cookies, following redirects, and routing traffic through proxies.
- HTTP Clients - Fast HTTP client wrapping libcurl.
