28 repositorios
Abstractions over native networking stacks for managing HTTP task lifecycles.
Distinguishing note: Focuses on wrapping native URL loading systems.
Explore 28 awesome GitHub repositories matching web development · HTTP Client Wrappers. Refine with filters or upvote what's useful.
Alamofire is an HTTP networking library that provides a foundation for managing network requests and responses through a chainable, type-safe interface. It serves as an asynchronous request manager, coordinating concurrent network operations and data streams while maintaining application responsiveness. The library distinguishes itself through a protocol-oriented request adaptation system, which utilizes interceptors to modify or authenticate requests before dispatch. It employs a middleware-driven pipeline to process traffic, handling encoding, authentication, and error recovery in a modular
Wraps the native networking stack to manage the lifecycle of HTTP tasks through a unified and extensible interface.
httpx is a suite of tools and libraries for HTTP reconnaissance, infrastructure discovery, and DNS resolution. It functions as a command line toolkit for extracting metadata and status codes from HTTP targets and CIDR ranges, as well as a Go library for integrating these probing capabilities into custom programs. The project distinguishes itself through specialized infrastructure profiling, using TLS fingerprinting to extract JARM hashes and certificate details. It identifies underlying components such as CDN usage, Autonomous System Numbers, and CNAMEs to map web server software and infrastr
Wraps the HTTP client with automated retry and backoff logic to navigate unstable network connections and firewalls.
Tenacity is a Python retry library and fault tolerance framework designed to automatically re-execute failing functions based on custom conditions, wait intervals, and stop criteria. It provides a mechanism to apply retry logic to both synchronous functions and asynchronous coroutines. The library implements exponential backoff to increase delays between retries, helping to manage transient network failures and prevent the overloading of services. Its capabilities cover the definition of retry conditions based on exception types or return values, as well as the enforcement of duration limits
Manages unstable API calls or database connections using exponential backoff and specific retry conditions.
pysheeet es una biblioteca de referencia técnica que proporciona una colección curada de fragmentos de código y patrones de implementación para el desarrollo avanzado en Python, integración de sistemas y computación de alto rendimiento. Sirve como una guía completa para implementar programación de red de bajo nivel, extensiones nativas en C y programación asíncrona y concurrente. El proyecto proporciona frameworks especializados para el desarrollo y despliegue de modelos de lenguaje de gran tamaño, incluyendo herramientas para inferencia distribuida en GPU y servicio de alto rendimiento. También incluye patrones detallados para la orquestación de clústeres de computación de alto rendimiento, cubriendo la asignación de recursos de GPU y la gestión de cargas de trabajo en múltiples nodos. La biblioteca cubre una amplia superficie de capacidades, incluyendo comunicación de red segura y criptografía, mapeo objeto-relacional y gestión de bases de datos, y la implementación de estructuras de datos y algoritmos complejos. También proporciona utilidades para la gestión de memoria, interoperabilidad nativa a través de interfaces de funciones externas e integración de sistemas operativos a nivel de sistema.
Implements resilient request logic using timeout patterns and exponential backoff to handle transient failures.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Re-enqueues failed bulk operations using an exponential backoff algorithm to handle transient server errors.
This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It provides a concurrent data pipeline system for chaining sources, filters, and sinks to process text and JSON streams. The library distinguishes itself through a comprehensive toolkit for shell-like operations, including a text processing engine for regular expression filtering and frequency analysis, a filesystem utility toolkit for recursive search and path manipulation, and an integrated HTTP client wrapper for building data pipelines that fetch web content. The capability s
Provides an HTTP client wrapper to fetch web content and integrate requests directly into scripting pipelines.
pydoll is a Chrome DevTools Protocol automation library and headless browser controller used for web data extraction and parallel browser automation. It controls Chromium-based browsers via direct WebSocket connections, allowing it to manage isolated browser contexts and tabs while bypassing the overhead and detection associated with WebDriver. The project features an anti-bot evasion framework that mimics natural human behavior, including mouse movements generated via Bezier curves and variable typing patterns. It provides specialized stealth capabilities to bypass behavioral analysis and au
Ships a function wrapper that handles execution exceptions using exponential backoff for unstable environments.
Boltons is a comprehensive utility toolkit and extension of the Python standard library. It provides a collection of reusable recipes and specialized data structures, system utilities, and helper libraries designed to support common programming tasks across various domains. The project is distinguished by a standard-library-only dependency model, ensuring maximum portability with zero external dependencies. It provides advanced implementations for data structures, such as immutable mappings and priority queues, alongside recursive data transformation tools for reshaping complex nested diction
Implements an exponential backoff retry mechanism to improve network service stability and prevent congestion.
Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it
Implements exponential backoff for retrying failed tasks, increasing delay between retries to allow service recovery.
This is a tool for downloading videos, images, and audio from the Douyin social media platform using shareable URLs or profile links. It can download individual posts, entire user profiles including all posts and liked content, collections, and music tracks, with options for watermark-free and high-quality output. The tool also supports live stream recording, comment collection, and keyword-based content search with JSONL export. The project distinguishes itself through an integrated REST API server that accepts download and transcription requests, tracks job status, and exposes health check
Retries failed downloads with exponential backoff to improve reliability and reduce manual intervention.
JMComic-Crawler-Python is a high-performance asynchronous web scraper and API client designed to programmatically retrieve images and metadata from a comic hosting service. It functions as a media archiving tool for batch downloading albums and chapters, automating the process of saving content to a local filesystem. The project is distinguished by its ability to reverse server-side pixel obfuscation, using a decryption tool to reconstruct sliced and shuffled images. To maintain stable connectivity, it utilizes a network bypass utility featuring dynamic domain rotation and proxy routing to ci
Implements automated retry strategies and domain blacklisting to recover from network timeouts.
Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome browser sessions. It enables programmatic browsing and web scraping using standard automation tools like Puppeteer, Playwright, and Selenium, connecting to cloud-hosted browser instances via WebSocket and the Chrome DevTools Protocol. The platform supports both headless and headful browser sessions, with language-specific SDKs for TypeScript and Python. The service distinguishes itself through comprehensive anti-detection capabilities, including residential proxy rotation, CAPTCHA
Re-attempts failed browser operations with exponential backoff and jitter to handle transient errors gracefully.
Faktory is an open-source work server that queues, dispatches, and manages background jobs across multiple programming languages. It stores job payloads as JSON hashes in a Redis-backed queue and provides language-specific client and worker libraries that enable any language to push jobs to the server or fetch and execute them. The server includes a batch workflow orchestrator that groups jobs into batches with completion tracking for coordinating multi-step asynchronous workflows. It features a configurable job uniqueness filter that prevents duplicate enqueues within a time window, an expon
Features an exponential backoff retry engine that automatically requeues failed jobs to handle transient errors.
Naabu is a port scanner library and tool that probes hosts for open ports using SYN, CONNECT, and UDP methods to identify active services. It functions as a Go library for embedding port scanning into programs, and as a standalone tool that accepts targets as hostnames, IP addresses, CIDR ranges, or ASN numbers. The tool discovers live hosts before scanning, filters ports by range or top lists, and can integrate with Nmap for service version detection. The project distinguishes itself through its SYN-based port probing approach that sends TCP SYN packets and analyzes responses without complet
Retries failed probes with backoff logic when encountering WAFs or other blocking mechanisms.
Web3.py es una librería de Python que proporciona una interfaz integral para interactuar con la blockchain de Ethereum. Funciona como un cliente JSON-RPC, permitiendo que las aplicaciones se conecten a nodos de blockchain a través de HTTP, WebSocket o IPC para leer el estado de la red y enviar transacciones. La librería incluye una interfaz de contrato inteligente dedicada que utiliza definiciones de Interfaz Binaria de Aplicación (ABI) para desplegar contratos y ejecutar funciones en cadena. También cuenta con un kit de herramientas de criptografía para firmar transacciones y hashear datos con Keccak, junto con utilidades para traducir nombres de dominio de Ethereum Name Service a direcciones de blockchain. Las capacidades amplias cubren la gestión de transacciones y la recuperación de datos de blockchain, incluida la capacidad de obtener encabezados de bloque, filtrar registros de eventos y convertir unidades de moneda. El sistema admite la gestión de red a través de middleware de interceptación de solicitudes, procesamiento por lotes de llamadas RPC y monitoreo de conexión persistente para eventos en tiempo real.
Executes automatic retries for network calls using customizable backoff strategies to handle instability.
Este proyecto es una traducción al chino de una guía completa sobre el lenguaje de programación Go. Sirve como un recurso educativo localizado y un manual técnico diseñado para proporcionar orientación sobre la sintaxis del lenguaje, su diseño y el desarrollo de software. El recurso cubre una amplia gama de educación sobre el lenguaje Go, incluida la implementación de patrones de programación y diseño de sistemas. Incluye lecciones traducidas y ejemplos que se centran en características principales del lenguaje como la concurrencia y el uso de interfaces. El contenido abarca varias áreas de capacidad, incluidos los fundamentos del lenguaje, modelado de datos, reflexión en tiempo de ejecución y gestión de memoria. También proporciona una cobertura detallada de la arquitectura de software, manejo de errores, control de calidad y redes web. La documentación está estructurada como un manual técnico que incluye contenido traducido, erratas y correcciones para garantizar un aprendizaje preciso.
Provides implementation strategies for retrying failed operations using time intervals and exponential back-off.
This is a Go client library for interacting with the Slack API, providing a programmatic interface to manage channels, users, and workspace settings. It functions as a bot framework and event handler, allowing for the development of automated assistants that respond to workspace activities. The library includes a dedicated Block Kit builder for constructing complex UI layouts, such as interactive elements, data tables, and visualizations, for rich messaging. It also provides a full implementation for managing user authentication and identity verification through OAuth2 and OpenID Connect. Br
Provides built-in retry logic with exponential backoff to handle API rate limits and network instability.
req es una biblioteca de cliente HTTP encadenable para Go diseñada para simplificar la configuración de solicitudes y la decodificación automática de respuestas en estructuras. Proporciona un constructor de solicitudes de interfaz fluida que permite a los desarrolladores definir incrementalmente las propiedades de la solicitud y encapsular la lógica HTTP en SDKs de API reutilizables. El proyecto se distingue por un emulador de huella digital TLS que imita las firmas de red del navegador para saltar la detección de bots y filtros de rastreadores. También incluye un descargador de archivos concurrente que aumenta las velocidades de transferencia al obtener archivos remotos grandes en segmentos paralelos. La biblioteca cubre una amplia superficie de capacidades de red, incluyendo un pipeline de middleware conectable para el manejo centralizado de errores y telemetría, gestión de cookies con estado y rotación automática de proxy. Admite varios esquemas de autenticación, medición detallada del rendimiento de la red y lógica de reintento de solicitud personalizable. También proporciona utilidades para la simulación (mocking) de respuestas HTTP para facilitar las pruebas unitarias sin servidores remotos.
Implements automated retry strategies and exponential backoff to handle network instability.
orpc is a contract-first API development framework for TypeScript that starts with a shared contract definition and generates type-safe clients and servers from that single source of truth. It guarantees end-to-end type safety, meaning inputs, outputs, errors, and streaming data are all checked at compile time across the client–server boundary. What distinguishes orpc from typical RPC frameworks is its ability to export contracts as OpenAPI specifications, to optimize server-side rendering by calling API handlers directly inside the server process, and to support real‑time bidirectional commu
Implements automatic retry with exponential backoff for failed client requests.
Este proyecto es una biblioteca de integración de analíticas en JavaScript y un recolector de eventos del lado del cliente, diseñado para registrar el comportamiento del usuario y distribuir esos datos a múltiples destinos de analíticas de terceros a través de una interfaz unificada. Funciona como una plataforma de datos de clientes que identifica usuarios, gestiona atributos y enruta flujos de eventos a diversas herramientas de analítica y almacenes de datos. La biblioteca se distingue por un enrutador de eventos multidestino y un middleware de seguimiento HTTP que intercepta y modifica las cargas útiles de los eventos antes de su transmisión. Implementa primitivas de gestión de identidad para la identificación de usuarios, alias de identidad para combinar perfiles y seguimiento entre subdominios mediante el almacenamiento de identificadores en el dominio de nivel superior. El sistema cubre una amplia gama de capacidades, incluyendo el monitoreo de la interacción del usuario para vistas de página, envíos de formularios y clics en enlaces, así como el seguimiento de campañas de marketing mediante la extracción de parámetros UTM. Para mayor fiabilidad, utiliza procesamiento por lotes de solicitudes de eventos, colas de reintento basadas en almacenamiento local con retroceso exponencial y flags de keepalive del navegador para asegurar la captura de datos durante las redirecciones de página. La biblioteca también admite píxeles de seguimiento para entornos que restringen la ejecución de JavaScript y proporciona mecanismos para la ofuscación de URLs de integración para evitar el bloqueo de solicitudes.
Persists failed network requests in the browser's local storage and attempts redelivery with exponential backoff.