Awesome GitHub RepositoriesMulti-Threaded Request Handling

KeyDB is a multithreaded in-memory key-value store and distributed cache. It functions as a NoSQL database utilizing multi-version concurrency control to execute non-blocking queries and scans. The project is a multithreaded fork of Redis that maintains protocol compatibility while utilizing a multithreaded architecture to scale across multi-core hardware. It distinguishes itself with flash-tiered storage, allowing the system to offload data from primary RAM to SSD or flash storage to increase total capacity. The system supports high availability through active-active mesh replication and mu

Garnet is a multi-threaded in-memory database and distributed key-value store. It functions as a high-performance remote cache store that implements the RESP wire protocol to maintain compatibility with existing Redis clients and libraries. The project is distinguished by a shared-memory architecture that enables parallel request processing across multiple cores for sub-millisecond latency. It features a tiered storage system that automatically offloads colder data from system memory to SSD or cloud storage layers, and includes a specialized vector search database for high-dimensional similar

Webmagic is a Java web crawling framework designed for building scalable automated crawlers to download and process large volumes of web pages. It functions as a distributed web crawler and dynamic content crawler, utilizing an XPath HTML parser to locate and extract specific data points from page structures. The framework distinguishes itself through its ability to handle dynamic content by rendering JavaScript and executing asynchronous requests to extract data from non-static pages. It also allows users to define and execute crawler logic via scripting languages, enabling the update of col

This project is a command-line utility and Python-based scraper designed to download and archive educational media from Coursera for offline access. It functions as a tool for saving course syllabi, videos, subtitles, and notebooks to a local file system to ensure a secure backup of academic materials. The tool distinguishes itself by providing capabilities for course quiz extraction, retrieving questions and answers from both graded and ungraded quizzes. It supports the retrieval of learning materials from both legacy and on-demand platforms and implements interrupted download resumption to

Puma is a concurrent HTTP server for Ruby applications that implements the Rack interface. It operates as a clustered web server, using a combination of worker processes and threads to handle multiple simultaneous web connections via TCP ports or UNIX domain sockets. The server features a master-worker process model that utilizes multiple CPU cores and employs copy-on-write preloading to reduce memory usage. It supports zero-downtime restarts through socket-handover capabilities, allowing application updates without dropping pending network requests. The project includes a token-authenticate

Robyn is a high-performance asynchronous web framework and server for Python that utilizes a Rust-powered runtime to execute code. It functions as an asynchronous Python web server designed to handle many concurrent requests efficiently through a multithreaded execution model. The project includes specialized capabilities for AI agent request routing, managing communication between agents and external tools. It also serves as a WebSocket communication server, maintaining persistent bidirectional channels for real-time data exchange. The framework covers a broad range of web infrastructure, i

This project is a proxy aggregation platform designed to collect and verify free proxy server lists from web platforms, social media, and public repositories. It functions as a crawler framework that gathers proxy data and subscription links, a validation tool for testing server liveness, and a synchronization service for distributing the results. The system uses a plugin-based architecture that allows for the integration of custom Python scripts to handle diverse web source structures. It also includes utilities to transform raw proxy data into standardized configuration formats compatible w

CocoaHTTPServer is a lightweight embedded web server designed to handle incoming network requests and serve local application content. The project implements Bonjour-based service discovery to broadcast server availability on local networks and supports WebDAV for remote file management, allowing files to be created, moved, and edited over HTTP. Network security is handled through certificate-based TLS encryption and password-based resource authentication. Request routing is managed via a delegate-based system, while concurrent connections are handled using Grand Central Dispatch.

MiniOB is an open-source educational relational database kernel designed for learning the internals of database systems. It implements a dual-engine storage architecture combining B+ Tree and LSM-Tree, supports SQL parsing and query execution, and provides transactional processing with multi-version concurrency control. The system communicates with clients using the MySQL wire protocol and includes a vector database extension for storing and querying high-dimensional vectors. The project distinguishes itself through its comprehensive coverage of core database concepts in a single, learnable c

该项目是一个专为 Linux 环境设计的 C++ HTTP Web 服务器。它作为一个高性能网络服务器，处理 HTTP 请求并交付静态文件。 该服务器利用 Reactor 模型和线程池来处理大量并发连接。它采用状态机和正则表达式进行请求解析，同时使用最小堆定时器系统管理连接超时，以自动关闭非活动套接字。 其他能力包括用于减少握手开销的数据库连接池，以及用于注册和登录的集成用户认证系统。系统可观测性通过异步日志系统提供，该系统在后台记录运行时事件。

SocialBox-Termux is a credential bruteforce suite and security tool collection designed to run within the Termux Android environment. It functions as an automated account cracker used to test password lists against usernames to discover valid login credentials for social media and email platforms. The toolkit incorporates network traffic masking by routing requests through the Tor network to conceal the origin IP address. It utilizes signature-based rate bypass to mimic legitimate client traffic and avoid automated login blocks. The suite provides capabilities for account validation to verif

Swifter 是一个用于 Swift 编程语言的轻量级 HTTP 服务器引擎和网络库。它提供了一个最小化的网络层，旨在托管内部 Web 服务、构建服务端应用程序以及实现自定义 HTTP 服务器。 该项目支持创建用于远程控制或状态监控的嵌入式 Web 服务，并支持以极小的资源占用进行轻量级 Web 托管。 其功能涵盖了原始 TCP 连接和网络套接字的管理，使用请求-响应周期将传入数据解析为 HTTP 请求，并将其映射到处理函数。

sourcekit-lsp is a language server protocol implementation and IDE code intelligence backend. It functions as a Swift language server and source code indexer, providing semantic analysis, autocomplete, and navigation features to compatible text editors. The project integrates directly with the Swift toolchain and SourceKit framework to deliver precise type information. It also leverages Clang-integrated parsing to provide semantic analysis for C-family languages, enabling cross-language navigation across project files. The server manages source code indexing and symbol lookups while using a

NFS-Ganesha is a user-mode file server that provides network access to storage resources using the NFSv3, v4, and v4.1 protocols. By operating entirely in user space, it functions as a storage gateway that enables remote file sharing across Linux and Unix systems while avoiding the complexities and stability risks associated with kernel-level file system development. The project distinguishes itself through a modular file system abstraction that allows it to translate network requests into operations for diverse back-end storage systems. It maintains stateful protocol handling to support adva