28 个仓库
Abstractions over native networking stacks for managing HTTP task lifecycles.
Distinguishing note: Focuses on wrapping native URL loading systems.
Explore 28 awesome GitHub repositories matching web development · HTTP Client Wrappers. Refine with filters or upvote what's useful.
Alamofire is an HTTP networking library that provides a foundation for managing network requests and responses through a chainable, type-safe interface. It serves as an asynchronous request manager, coordinating concurrent network operations and data streams while maintaining application responsiveness. The library distinguishes itself through a protocol-oriented request adaptation system, which utilizes interceptors to modify or authenticate requests before dispatch. It employs a middleware-driven pipeline to process traffic, handling encoding, authentication, and error recovery in a modular
Wraps the native networking stack to manage the lifecycle of HTTP tasks through a unified and extensible interface.
httpx is a suite of tools and libraries for HTTP reconnaissance, infrastructure discovery, and DNS resolution. It functions as a command line toolkit for extracting metadata and status codes from HTTP targets and CIDR ranges, as well as a Go library for integrating these probing capabilities into custom programs. The project distinguishes itself through specialized infrastructure profiling, using TLS fingerprinting to extract JARM hashes and certificate details. It identifies underlying components such as CDN usage, Autonomous System Numbers, and CNAMEs to map web server software and infrastr
Wraps the HTTP client with automated retry and backoff logic to navigate unstable network connections and firewalls.
Tenacity is a Python retry library and fault tolerance framework designed to automatically re-execute failing functions based on custom conditions, wait intervals, and stop criteria. It provides a mechanism to apply retry logic to both synchronous functions and asynchronous coroutines. The library implements exponential backoff to increase delays between retries, helping to manage transient network failures and prevent the overloading of services. Its capabilities cover the definition of retry conditions based on exception types or return values, as well as the enforcement of duration limits
Manages unstable API calls or database connections using exponential backoff and specific retry conditions.
pysheeet 是一个技术参考库,提供了一系列精选的代码片段和实现模式,用于高级 Python 开发、系统集成和高性能计算。它充当实现底层网络编程、原生 C 扩展以及异步和并发编程的综合指南。 该项目为大语言模型的开发和部署提供了专门的框架,包括用于分布式 GPU 推理和高性能服务的工具。它还包括用于高性能计算集群编排的详细模式,涵盖 GPU 资源分配和多节点工作负载管理。 该库涵盖了广泛的功能,包括安全网络通信和加密、对象关系映射和数据库管理,以及复杂数据结构和算法的实现。它还提供用于内存管理、通过外部函数接口(FFI)进行原生互操作以及系统级 OS 集成的实用程序。
Implements resilient request logic using timeout patterns and exponential backoff to handle transient failures.
This project is a Go client library and API wrapper for interacting with Elasticsearch clusters. It serves as a programmatic interface for managing documents, indices, and cluster health, allowing Go applications to perform search and indexing operations via the REST API. The library functions as a distributed search orchestrator, providing specialized tools for high-throughput data ingestion and cluster administration. It features a buffered bulk processor with exponential backoff retries for optimizing write performance and supports automated index lifecycle transitions and historical data
Re-enqueues failed bulk operations using an exponential backoff algorithm to handle transient server errors.
This project is a Go shell scripting library and framework designed for writing automation scripts and CLI tools. It provides a concurrent data pipeline system for chaining sources, filters, and sinks to process text and JSON streams. The library distinguishes itself through a comprehensive toolkit for shell-like operations, including a text processing engine for regular expression filtering and frequency analysis, a filesystem utility toolkit for recursive search and path manipulation, and an integrated HTTP client wrapper for building data pipelines that fetch web content. The capability s
Provides an HTTP client wrapper to fetch web content and integrate requests directly into scripting pipelines.
pydoll is a Chrome DevTools Protocol automation library and headless browser controller used for web data extraction and parallel browser automation. It controls Chromium-based browsers via direct WebSocket connections, allowing it to manage isolated browser contexts and tabs while bypassing the overhead and detection associated with WebDriver. The project features an anti-bot evasion framework that mimics natural human behavior, including mouse movements generated via Bezier curves and variable typing patterns. It provides specialized stealth capabilities to bypass behavioral analysis and au
Ships a function wrapper that handles execution exceptions using exponential backoff for unstable environments.
Boltons is a comprehensive utility toolkit and extension of the Python standard library. It provides a collection of reusable recipes and specialized data structures, system utilities, and helper libraries designed to support common programming tasks across various domains. The project is distinguished by a standard-library-only dependency model, ensuring maximum portability with zero external dependencies. It provides advanced implementations for data structures, such as immutable mappings and priority queues, alongside recursive data transformation tools for reshaping complex nested diction
Implements an exponential backoff retry mechanism to improve network service stability and prevent congestion.
Hatchet is an open-source durable workflow engine and task orchestration platform. It provides a framework for building and executing fault-tolerant, multi-step pipelines as directed acyclic graphs (DAGs), with automatic retries, scheduling, and real-time observability. The system is built around durable task checkpointing, which persists execution state after each step so work can resume from the last checkpoint after a worker crash or restart, and it supports event-driven task resumption that pauses a task until a matching external event arrives. The platform distinguishes itself through it
Implements exponential backoff for retrying failed tasks, increasing delay between retries to allow service recovery.
This is a tool for downloading videos, images, and audio from the Douyin social media platform using shareable URLs or profile links. It can download individual posts, entire user profiles including all posts and liked content, collections, and music tracks, with options for watermark-free and high-quality output. The tool also supports live stream recording, comment collection, and keyword-based content search with JSONL export. The project distinguishes itself through an integrated REST API server that accepts download and transcription requests, tracks job status, and exposes health check
Retries failed downloads with exponential backoff to improve reliability and reduce manual intervention.
JMComic-Crawler-Python is a high-performance asynchronous web scraper and API client designed to programmatically retrieve images and metadata from a comic hosting service. It functions as a media archiving tool for batch downloading albums and chapters, automating the process of saving content to a local filesystem. The project is distinguished by its ability to reverse server-side pixel obfuscation, using a decryption tool to reconstruct sliced and shuffled images. To maintain stable connectivity, it utilizes a network bypass utility featuring dynamic domain rotation and proxy routing to ci
Implements automated retry strategies and domain blacklisting to recover from network timeouts.
Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome browser sessions. It enables programmatic browsing and web scraping using standard automation tools like Puppeteer, Playwright, and Selenium, connecting to cloud-hosted browser instances via WebSocket and the Chrome DevTools Protocol. The platform supports both headless and headful browser sessions, with language-specific SDKs for TypeScript and Python. The service distinguishes itself through comprehensive anti-detection capabilities, including residential proxy rotation, CAPTCHA
Re-attempts failed browser operations with exponential backoff and jitter to handle transient errors gracefully.
Faktory is an open-source work server that queues, dispatches, and manages background jobs across multiple programming languages. It stores job payloads as JSON hashes in a Redis-backed queue and provides language-specific client and worker libraries that enable any language to push jobs to the server or fetch and execute them. The server includes a batch workflow orchestrator that groups jobs into batches with completion tracking for coordinating multi-step asynchronous workflows. It features a configurable job uniqueness filter that prevents duplicate enqueues within a time window, an expon
Features an exponential backoff retry engine that automatically requeues failed jobs to handle transient errors.
Naabu is a port scanner library and tool that probes hosts for open ports using SYN, CONNECT, and UDP methods to identify active services. It functions as a Go library for embedding port scanning into programs, and as a standalone tool that accepts targets as hostnames, IP addresses, CIDR ranges, or ASN numbers. The tool discovers live hosts before scanning, filters ports by range or top lists, and can integrate with Nmap for service version detection. The project distinguishes itself through its SYN-based port probing approach that sends TCP SYN packets and analyzes responses without complet
Retries failed probes with backoff logic when encountering WAFs or other blocking mechanisms.
Web3.py is a Python library that provides a comprehensive interface for interacting with the Ethereum blockchain. It functions as a JSON-RPC client, allowing applications to connect to blockchain nodes via HTTP, WebSocket, or IPC to read network state and send transactions. The library includes a dedicated smart contract interface that uses Application Binary Interface definitions to deploy contracts and execute on-chain functions. It also features a cryptography toolkit for signing transactions and hashing data with Keccak, alongside utilities for translating Ethereum Name Service domain nam
Executes automatic retries for network calls using customizable backoff strategies to handle instability.
本项目是 Go 编程语言综合指南的中文翻译版。它作为一个本地化的教育资源和技术手册,旨在为语言语法、设计和软件开发提供指导。 该资源涵盖了广泛的 Go 语言教育内容,包括编程模式的实现和系统设计。它包含翻译后的课程和示例,重点关注并发和接口使用等核心语言特性。 内容跨越了多个能力领域,包括语言基础、数据建模、运行时反射和内存管理。它还详细介绍了软件架构、错误处理、质量保证和 Web 网络编程。 该文档结构为技术手册,包含翻译内容、勘误和修正,以确保学习的准确性。
Provides implementation strategies for retrying failed operations using time intervals and exponential back-off.
This is a Go client library for interacting with the Slack API, providing a programmatic interface to manage channels, users, and workspace settings. It functions as a bot framework and event handler, allowing for the development of automated assistants that respond to workspace activities. The library includes a dedicated Block Kit builder for constructing complex UI layouts, such as interactive elements, data tables, and visualizations, for rich messaging. It also provides a full implementation for managing user authentication and identity verification through OAuth2 and OpenID Connect. Br
Provides built-in retry logic with exponential backoff to handle API rate limits and network instability.
req 是一个用于 Go 的可链式 HTTP 客户端库,旨在简化请求配置并将响应自动解码为结构体。它提供了一个流畅接口的请求构建器,允许开发者逐步定义请求属性并将 HTTP 逻辑封装到可重用的 API SDK 中。 该项目以 TLS 指纹模拟器为特色,该模拟器模仿浏览器网络签名以绕过机器人检测和爬虫过滤器。它还包括一个并发文件下载器,通过并行分段获取大型远程文件来提高传输速度。 该库涵盖了广泛的网络功能,包括用于集中式错误处理和遥测的可插拔中间件流水线、有状态 Cookie 管理和自动代理轮换。它支持各种身份验证方案、详细的网络性能测量和可自定义的请求重试逻辑。 它还提供用于 HTTP 响应模拟的实用程序,以便在没有远程服务器的情况下进行单元测试。
Implements automated retry strategies and exponential backoff to handle network instability.
orpc is a contract-first API development framework for TypeScript that starts with a shared contract definition and generates type-safe clients and servers from that single source of truth. It guarantees end-to-end type safety, meaning inputs, outputs, errors, and streaming data are all checked at compile time across the client–server boundary. What distinguishes orpc from typical RPC frameworks is its ability to export contracts as OpenAPI specifications, to optimize server-side rendering by calling API handlers directly inside the server process, and to support real‑time bidirectional commu
Implements automatic retry with exponential backoff for failed client requests.
本项目是一个 JavaScript 分析集成库和客户端事件收集器,旨在记录用户行为并通过统一接口将数据分发到多个第三方分析目的地。它作为一个客户数据平台,用于识别用户、管理特征,并将事件流路由到各种分析工具和数据仓库。 该库的独特之处在于其多目的地事件路由器和 HTTP 跟踪中间件,可在传输前拦截并修改事件负载。它实现了用于用户识别的身份管理原语、用于合并配置文件的身份别名,以及通过在顶级域名上存储标识符来实现跨子域名跟踪。 系统涵盖了广泛的功能,包括针对页面浏览、表单提交和链接点击的用户交互监控,以及通过 UTM 参数提取进行的营销活动跟踪。为保证可靠性,它利用事件请求批处理、基于本地存储的带指数退避的重试队列,以及浏览器 keepalive 标志,以确保页面重定向期间的数据捕获。 该库还支持针对限制 JavaScript 执行环境的跟踪像素,并提供集成 URL 混淆机制以防止请求被拦截。
Persists failed network requests in the browser's local storage and attempts redelivery with exponential backoff.