27 Repos
Abstractions over native networking stacks for managing HTTP task lifecycles.
Distinguishing note: Focuses on wrapping native URL loading systems.
Explore 27 awesome GitHub repositories matching web development · HTTP Client Wrappers. Refine with filters or upvote what's useful.
Alamofire is an HTTP networking library that provides a foundation for managing network requests and responses through a chainable, type-safe interface. It serves as an asynchronous request manager, coordinating concurrent network operations and data streams while maintaining application responsiveness. The library distinguishes itself through a protocol-oriented request adaptation system, which utilizes interceptors to modify or authenticate requests before dispatch. It employs a middleware-driven pipeline to process traffic, handling encoding, authentication, and error recovery in a modular
Wraps the native networking stack to manage the lifecycle of HTTP tasks through a unified and extensible interface.
httpx is a suite of tools and libraries for HTTP reconnaissance, infrastructure discovery, and DNS resolution. It functions as a command line toolkit for extracting metadata and status codes from HTTP targets and CIDR ranges, as well as a Go library for integrating these probing capabilities into custom programs. The project distinguishes itself through specialized infrastructure profiling, using TLS fingerprinting to extract JARM hashes and certificate details. It identifies underlying components such as CDN usage, Autonomous System Numbers, and CNAMEs to map web server software and infrastr
Wraps the HTTP client with automated retry and backoff logic to navigate unstable network connections and firewalls.
Tenacity is a Python retry library and fault tolerance framework designed to automatically re-execute failing functions based on custom conditions, wait intervals, and stop criteria. It provides a mechanism to apply retry logic to both synchronous functions and asynchronous coroutines. The library implements exponential backoff to increase delays between retries, helping to manage transient network failures and prevent the overloading of services. Its capabilities cover the definition of retry conditions based on exception types or return values, as well as the enforcement of duration limits
Manages unstable API calls or database connections using exponential backoff and specific retry conditions.
pysheeet ist eine technische Referenzbibliothek, die eine kuratierte Sammlung von Code-Snippets und Implementierungsmustern für fortgeschrittene Python-Entwicklung, Systemintegration und High-Performance-Computing bereitstellt. Sie dient als umfassender Leitfaden für die Implementierung von Low-Level-Netzwerkprogrammierung, nativen C-Erweiterungen sowie asynchroner und nebenläufiger Programmierung. Das Projekt bietet spezialisierte Frameworks für die Entwicklung und Bereitstellung von Large Language Models, einschließlich Werkzeugen für verteilte GPU-Inferenz und High-Performance-Serving. Es enthält zudem detaillierte Muster für die Orchestrierung von High-Performance-Computing-Clustern, die GPU-Ressourcenzuweisung und Multi-Node-Workload-Management abdecken. Die Bibliothek deckt ein breites Spektrum an Funktionen ab, einschließlich sicherer Netzwerkkommunikation und Kryptografie, Object-Relational-Mapping und Datenbankverwaltung sowie die Implementierung komplexer Datenstrukturen und Algorithmen. Sie bietet zudem Utilities für Speicherverwaltung, native Interoperabilität via Foreign-Function-Interfaces und systemnahe OS-Integration.
Implements resilient request logic using timeout patterns and exponential backoff to handle transient failures.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Re-enqueues failed bulk operations using an exponential backoff algorithm to handle transient server errors.
This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It provides a concurrent data pipeline system for chaining sources, filters, and sinks to process text and JSON streams. The library distinguishes itself through a comprehensive toolkit for shell-like operations, including a text processing engine for regular expression filtering and frequency analysis, a filesystem utility toolkit for recursive search and path manipulation, and an integrated HTTP client wrapper for building data pipelines that fetch web content. The capability s
Provides an HTTP client wrapper to fetch web content and integrate requests directly into scripting pipelines.
pydoll is a Chrome DevTools Protocol automation library and headless browser controller used for web data extraction and parallel browser automation. It controls Chromium-based browsers via direct WebSocket connections, allowing it to manage isolated browser contexts and tabs while bypassing the overhead and detection associated with WebDriver. The project features an anti-bot evasion framework that mimics natural human behavior, including mouse movements generated via Bezier curves and variable typing patterns. It provides specialized stealth capabilities to bypass behavioral analysis and au
Ships a function wrapper that handles execution exceptions using exponential backoff for unstable environments.
Boltons is a comprehensive utility toolkit and extension of the Python standard library. It provides a collection of reusable recipes and specialized data structures, system utilities, and helper libraries designed to support common programming tasks across various domains. The project is distinguished by a standard-library-only dependency model, ensuring maximum portability with zero external dependencies. It provides advanced implementations for data structures, such as immutable mappings and priority queues, alongside recursive data transformation tools for reshaping complex nested diction
Implements an exponential backoff retry mechanism to improve network service stability and prevent congestion.
Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it
Implements exponential backoff for retrying failed tasks, increasing delay between retries to allow service recovery.
This is a tool for downloading videos, images, and audio from the Douyin social media platform using shareable URLs or profile links. It can download individual posts, entire user profiles including all posts and liked content, collections, and music tracks, with options for watermark-free and high-quality output. The tool also supports live stream recording, comment collection, and keyword-based content search with JSONL export. The project distinguishes itself through an integrated REST API server that accepts download and transcription requests, tracks job status, and exposes health check
Retries failed downloads with exponential backoff to improve reliability and reduce manual intervention.
JMComic-Crawler-Python is a high-performance asynchronous web scraper and API client designed to programmatically retrieve images and metadata from a comic hosting service. It functions as a media archiving tool for batch downloading albums and chapters, automating the process of saving content to a local filesystem. The project is distinguished by its ability to reverse server-side pixel obfuscation, using a decryption tool to reconstruct sliced and shuffled images. To maintain stable connectivity, it utilizes a network bypass utility featuring dynamic domain rotation and proxy routing to ci
Implements automated retry strategies and domain blacklisting to recover from network timeouts.
Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome browser sessions. It enables programmatic browsing and web scraping using standard automation tools like Puppeteer, Playwright, and Selenium, connecting to cloud-hosted browser instances via WebSocket and the Chrome DevTools Protocol. The platform supports both headless and headful browser sessions, with language-specific SDKs for TypeScript and Python. The service distinguishes itself through comprehensive anti-detection capabilities, including residential proxy rotation, CAPTCHA
Re-attempts failed browser operations with exponential backoff and jitter to handle transient errors gracefully.
Faktory is an open-source work server that queues, dispatches, and manages background jobs across multiple programming languages. It stores job payloads as JSON hashes in a Redis-backed queue and provides language-specific client and worker libraries that enable any language to push jobs to the server or fetch and execute them. The server includes a batch workflow orchestrator that groups jobs into batches with completion tracking for coordinating multi-step asynchronous workflows. It features a configurable job uniqueness filter that prevents duplicate enqueues within a time window, an expon
Features an exponential backoff retry engine that automatically requeues failed jobs to handle transient errors.
Naabu is a port scanner library and tool that probes hosts for open ports using SYN, CONNECT, and UDP methods to identify active services. It functions as a Go library for embedding port scanning into programs, and as a standalone tool that accepts targets as hostnames, IP addresses, CIDR ranges, or ASN numbers. The tool discovers live hosts before scanning, filters ports by range or top lists, and can integrate with Nmap for service version detection. The project distinguishes itself through its SYN-based port probing approach that sends TCP SYN packets and analyzes responses without complet
Retries failed probes with backoff logic when encountering WAFs or other blocking mechanisms.
Web3.py ist eine Python-Bibliothek, die ein umfassendes Interface für die Interaktion mit der Ethereum-Blockchain bereitstellt. Sie fungiert als JSON-RPC-Client, der es Anwendungen ermöglicht, sich über HTTP, WebSocket oder IPC mit Blockchain-Nodes zu verbinden, um den Netzwerkzustand zu lesen und Transaktionen zu senden. Die Bibliothek enthält ein dediziertes Smart-Contract-Interface, das Application-Binary-Interface-Definitionen verwendet, um Contracts bereitzustellen und On-Chain-Funktionen auszuführen. Sie bietet zudem ein Kryptografie-Toolkit zum Signieren von Transaktionen und zum Hashing von Daten mit Keccak, neben Utilities zur Übersetzung von ENS-Domainnamen in Blockchain-Adressen. Breite Funktionen decken das Transaktionsmanagement und das Abrufen von Blockchain-Daten ab, einschließlich der Möglichkeit, Block-Header abzurufen, Event-Logs zu filtern und Währungseinheiten umzurechnen. Das System unterstützt das Netzwerkmanagement durch Request-Interception-Middleware, RPC-Call-Batching und die Überwachung persistenter Verbindungen für Echtzeit-Events.
Executes automatic retries for network calls using customizable backoff strategies to handle instability.
Dieses Projekt ist eine chinesische Übersetzung eines umfassenden Leitfadens zur Programmiersprache Go. Es dient als lokalisierte Bildungsressource und technisches Handbuch, das Orientierung zu Sprachsyntax, Design und Softwareentwicklung bietet. Die Ressource deckt ein breites Spektrum der Go-Sprachausbildung ab, einschließlich der Implementierung von Programmiermustern und Systemdesign. Sie enthält übersetzte Lektionen und Beispiele, die sich auf Kernfunktionen der Sprache wie Concurrency und die Verwendung von Interfaces konzentrieren. Der Inhalt umfasst verschiedene Kompetenzbereiche, darunter Sprachgrundlagen, Datenmodellierung, Runtime-Reflection und Speicherverwaltung. Zudem bietet es detaillierte Abhandlungen zu Softwarearchitektur, Fehlerbehandlung, Qualitätssicherung und Web-Networking. Die Dokumentation ist als technisches Handbuch strukturiert, das übersetzte Inhalte, Errata und Korrekturen enthält, um ein präzises Lernen zu gewährleisten.
Provides implementation strategies for retrying failed operations using time intervals and exponential back-off.
This is a Go client library for interacting with the Slack API, providing a programmatic interface to manage channels, users, and workspace settings. It functions as a bot framework and event handler, allowing for the development of automated assistants that respond to workspace activities. The library includes a dedicated Block Kit builder for constructing complex UI layouts, such as interactive elements, data tables, and visualizations, for rich messaging. It also provides a full implementation for managing user authentication and identity verification through OAuth2 and OpenID Connect. Br
Provides built-in retry logic with exponential backoff to handle API rate limits and network instability.
req ist eine verkettbare HTTP-Client-Bibliothek für Go, die darauf ausgelegt ist, die Anfragekonfiguration und die automatische Antwort-Dekodierung in Strukturen zu vereinfachen. Sie bietet einen Request-Builder mit flüssiger Schnittstelle, der es Entwicklern ermöglicht, Anfrageeigenschaften inkrementell zu definieren und HTTP-Logik in wiederverwendbare API-SDKs zu kapseln. Das Projekt zeichnet sich durch einen TLS-Fingerprint-Emulator aus, der Netzwerk-Signaturen von Browsern nachahmt, um Bot-Erkennung und Crawler-Filter zu umgehen. Es enthält zudem einen parallelen Datei-Downloader, der Übertragungsgeschwindigkeiten durch das Abrufen großer Remote-Dateien in parallelen Segmenten erhöht. Die Bibliothek deckt eine breite Oberfläche an Netzwerkfunktionen ab, einschließlich einer steckbaren Middleware-Pipeline für zentralisierte Fehlerbehandlung und Telemetrie, zustandsbehaftetes Cookie-Management und automatische Proxy-Rotation. Sie unterstützt verschiedene Authentifizierungsschemata, detaillierte Messungen der Netzwerkleistung und anpassbare Logik für Anfrage-Wiederholungen. Zudem bietet sie Dienstprogramme für das Mocking von HTTP-Antworten, um Unit-Tests ohne Remote-Server zu erleichtern.
Implements automated retry strategies and exponential backoff to handle network instability.
orpc is a contract-first API development framework for TypeScript that starts with a shared contract definition and generates type-safe clients and servers from that single source of truth. It guarantees end-to-end type safety, meaning inputs, outputs, errors, and streaming data are all checked at compile time across the client–server boundary. What distinguishes orpc from typical RPC frameworks is its ability to export contracts as OpenAPI specifications, to optimize server-side rendering by calling API handlers directly inside the server process, and to support real‑time bidirectional commu
Implements automatic retry with exponential backoff for failed client requests.
Dieses Projekt ist eine JavaScript-Integrationsbibliothek für Analysedaten und ein Client-Side-Event-Collector, der entwickelt wurde, um Nutzerverhalten aufzuzeichnen und diese Daten über eine einheitliche Schnittstelle an verschiedene Analyse-Dienste von Drittanbietern zu verteilen. Es fungiert als Customer Data Platform, die Nutzer identifiziert, Merkmale verwaltet und Event-Streams an verschiedene Analysetools und Data Warehouses weiterleitet. Die Bibliothek zeichnet sich durch einen Multi-Destination-Event-Router und HTTP-Tracking-Middleware aus, die Event-Payloads vor der Übertragung abfängt und modifiziert. Sie implementiert Identitätsmanagement-Primitive für die Nutzeridentifizierung, Identitäts-Aliasing zur Zusammenführung von Profilen sowie Cross-Subdomain-Tracking durch Speicherung von Identifikatoren auf der Top-Level-Domain. Das System deckt ein breites Spektrum an Funktionen ab, darunter die Überwachung von Nutzerinteraktionen wie Seitenaufrufe, Formularübermittlungen und Link-Klicks sowie das Tracking von Marketingkampagnen durch Extraktion von UTM-Parametern. Für eine hohe Zuverlässigkeit nutzt es Event-Request-Batching, auf Local Storage basierende Retry-Queues mit exponentiellem Backoff sowie Browser-Keepalive-Flags, um die Datenerfassung bei Seitenumleitungen sicherzustellen. Die Bibliothek unterstützt zudem Tracking-Pixel für Umgebungen, die die JavaScript-Ausführung einschränken, und bietet Mechanismen zur Verschleierung von Integrations-URLs, um Request-Blockierungen zu verhindern.
Persists failed network requests in the browser's local storage and attempts redelivery with exponential backoff.