16 repository-uri
Architectures that distribute network IO and query processing across multiple CPU cores.
Distinct from Network Request Processing: Specific to the multi-threaded execution of database queries rather than general network request lifecycles.
Explore 16 awesome GitHub repositories matching software engineering & architecture · Multi-Threaded Request Handling. Refine with filters or upvote what's useful.
KeyDB is a multithreaded in-memory key-value store and distributed cache. It functions as a NoSQL database utilizing multi-version concurrency control to execute non-blocking queries and scans. The project is a multithreaded fork of Redis that maintains protocol compatibility while utilizing a multithreaded architecture to scale across multi-core hardware. It distinguishes itself with flash-tiered storage, allowing the system to offload data from primary RAM to SSD or flash storage to increase total capacity. The system supports high availability through active-active mesh replication and mu
Distributes network IO and query parsing across multiple CPU cores to handle concurrent requests without blocking.
Garnet is a multi-threaded in-memory database and distributed key-value store. It functions as a high-performance remote cache store that implements the RESP wire protocol to maintain compatibility with existing Redis clients and libraries. The project is distinguished by a shared-memory architecture that enables parallel request processing across multiple cores for sub-millisecond latency. It features a tiered storage system that automatically offloads colder data from system memory to SSD or cloud storage layers, and includes a specialized vector search database for high-dimensional similar
Distributes network IO and query processing across multiple CPU cores to maintain high throughput and low latency.
Webmagic is a Java web crawling framework designed for building scalable automated crawlers to download and process large volumes of web pages. It functions as a distributed web crawler and dynamic content crawler, utilizing an XPath HTML parser to locate and extract specific data points from page structures. The framework distinguishes itself through its ability to handle dynamic content by rendering JavaScript and executing asynchronous requests to extract data from non-static pages. It also allows users to define and execute crawler logic via scripting languages, enabling the update of col
Distributes web requests and page parsing across multiple concurrent threads to increase total data collection throughput.
This project is a command-line utility and Python-based scraper designed to download and archive educational media from Coursera for offline access. It functions as a tool for saving course syllabi, videos, subtitles, and notebooks to a local file system to ensure a secure backup of academic materials. The tool distinguishes itself by providing capabilities for course quiz extraction, retrieving questions and answers from both graded and ungraded quizzes. It supports the retrieval of learning materials from both legacy and on-demand platforms and implements interrupted download resumption to
Distributes network requests across multiple threads to increase throughput and optimize download performance.
Puma is a concurrent HTTP server for Ruby applications that implements the Rack interface. It operates as a clustered web server, using a combination of worker processes and threads to handle multiple simultaneous web connections via TCP ports or UNIX domain sockets. The server features a master-worker process model that utilizes multiple CPU cores and employs copy-on-write preloading to reduce memory usage. It supports zero-downtime restarts through socket-handover capabilities, allowing application updates without dropping pending network requests. The project includes a token-authenticate
Scales web traffic by distributing network IO and request handling across multiple CPU cores using threads and processes.
Robyn is a high-performance asynchronous web framework and server for Python that utilizes a Rust-powered runtime to execute code. It functions as an asynchronous Python web server designed to handle many concurrent requests efficiently through a multithreaded execution model. The project includes specialized capabilities for AI agent request routing, managing communication between agents and external tools. It also serves as a WebSocket communication server, maintaining persistent bidirectional channels for real-time data exchange. The framework covers a broad range of web infrastructure, i
Distributes network traffic across multiple operating system threads to process concurrent requests in parallel.
This project is a proxy aggregation platform designed to collect and verify free proxy server lists from web platforms, social media, and public repositories. It functions as a crawler framework that gathers proxy data and subscription links, a validation tool for testing server liveness, and a synchronization service for distributing the results. The system uses a plugin-based architecture that allows for the integration of custom Python scripts to handle diverse web source structures. It also includes utilities to transform raw proxy data into standardized configuration formats compatible w
Utilizes multi-threaded execution to increase the throughput of high-volume proxy data collection and validation.
CocoaHTTPServer este un server web embedded ușor, conceput pentru a gestiona cererile de rețea primite și a servi conținutul aplicației locale. Proiectul implementează descoperirea serviciilor bazată pe Bonjour pentru a difuza disponibilitatea serverului în rețelele locale și suportă WebDAV pentru gestionarea fișierelor la distanță, permițând crearea, mutarea și editarea fișierelor prin HTTP. Securitatea rețelei este gestionată prin criptare TLS bazată pe certificate și autentificarea resurselor bazată pe parolă. Rutarea cererilor este gestionată printr-un sistem bazat pe delegare, în timp ce conexiunile concurente sunt gestionate folosind Grand Central Dispatch.
Uses Grand Central Dispatch to manage concurrent network connections via a pool of worker threads.
MiniOB is an open-source educational relational database kernel designed for learning the internals of database systems. It implements a dual-engine storage architecture combining B+ Tree and LSM-Tree, supports SQL parsing and query execution, and provides transactional processing with multi-version concurrency control. The system communicates with clients using the MySQL wire protocol and includes a vector database extension for storing and querying high-dimensional vectors. The project distinguishes itself through its comprehensive coverage of core database concepts in a single, learnable c
Assign each client connection its own thread that listens for messages, processes SQL, and sends responses.
Acest proiect este un server web HTTP scris în C++ pentru mediul Linux. Acesta funcționează ca un server de rețea de înaltă performanță care procesează cereri HTTP și livrează fișiere statice. Serverul utilizează un model reactor și un pool de thread-uri pentru a gestiona volume mari de conexiuni simultane. Folosește o mașină de stări și expresii regulate pentru parsarea cererilor, în timp ce un sistem de temporizare bazat pe min-heap gestionează timeout-urile conexiunilor pentru a închide automat socket-urile inactive. Capabilitățile suplimentare includ un pooler de conexiuni la baza de date pentru a reduce overhead-ul de handshake și un sistem integrat de autentificare a utilizatorilor pentru înregistrare și login. Observabilitatea sistemului este asigurată printr-un sistem de logare asincron care înregistrează evenimentele de runtime în fundal.
Implements a reactor model and thread pool to distribute network IO and request processing across multiple CPU cores.
SocialBox-Termux is a credential bruteforce suite and security tool collection designed to run within the Termux Android environment. It functions as an automated account cracker used to test password lists against usernames to discover valid login credentials for social media and email platforms. The toolkit incorporates network traffic masking by routing requests through the Tor network to conceal the origin IP address. It utilizes signature-based rate bypass to mimic legitimate client traffic and avoid automated login blocks. The suite provides capabilities for account validation to verif
Implements multi-threaded network request handling to accelerate the process of testing password lists.
Swifter este un motor de server HTTP ușor și o bibliotecă de rețelistică pentru limbajul de programare Swift. Oferă un strat de rețelistică minimal conceput pentru găzduirea serviciilor web interne, construirea de aplicații server-side și implementarea de servere HTTP personalizate. Proiectul permite crearea de servicii web încorporate pentru control de la distanță sau monitorizarea stării și suportă găzduirea web ușoară cu o amprentă minimală. Capabilitățile sale acoperă gestionarea conexiunilor TCP brute și a socket-urilor de rețea, utilizând un ciclu cerere-răspuns pentru a parsa datele primite în cereri HTTP și a le mapa către funcții handler.
Processes incoming HTTP requests sequentially on a blocking thread.
coq_nvim is an asynchronous code completion engine for Neovim. It aggregates suggestions from multiple sources, including language servers, tag files, and local buffers, to provide non-blocking code completion. The engine distinguishes itself through a typo-resistant fuzzy completion filter and a two-stage weighted ranking system that prioritizes candidates based on recency and proximity. It utilizes an embedded SQLite database for local caching and background symbol indexing to accelerate lookups without freezing the editor interface. The project also includes a system for defining and expa
Processes heavy completion data and indexing in the background via a concurrent scheduler to maintain editor responsiveness.
sourcekit-lsp is a language server protocol implementation and IDE code intelligence backend. It functions as a Swift language server and source code indexer, providing semantic analysis, autocomplete, and navigation features to compatible text editors. The project integrates directly with the Swift toolchain and SourceKit framework to deliver precise type information. It also leverages Clang-integrated parsing to provide semantic analysis for C-family languages, enabling cross-language navigation across project files. The server manages source code indexing and symbol lookups while using a
Implements non-blocking request handling to ensure the text editor remains responsive during heavy indexing tasks.
lspsaga.nvim is a Neovim LSP UI enhancement and floating window manager. It provides a visual system for presenting Language Server Protocol data through interactive overlays, serving as a code navigation tool and a refactoring interface. The project focuses on improving the interaction flow of LSP features by rendering documentation hovers, symbol definitions, and diagnostic data in floating windows. It distinguishes itself by integrating a floating window framework that also manages embedded terminal sessions for executing shell commands without leaving the editor workspace. The plugin cov
Handles non-blocking processing of language server requests to ensure the editor remains responsive during data retrieval.
NFS-Ganesha este un server de fișiere user-mode care oferă acces la rețea către resursele de stocare utilizând protocoalele NFSv3, v4 și v4.1. Operând în întregime în user space, funcționează ca un gateway de stocare care permite partajarea fișierelor la distanță între sistemele Linux și Unix, evitând în același timp complexitățile și riscurile de stabilitate asociate cu dezvoltarea sistemelor de fișiere la nivel de kernel. Proiectul se distinge printr-o abstractizare modulară a sistemului de fișiere care îi permite să traducă cererile de rețea în operațiuni pentru diverse sisteme de stocare back-end. Menține gestionarea stateful a protocolului pentru a suporta funcționalități avansate precum blocarea fișierelor și delegațiile, utilizând în același timp un model de dispatching al cererilor multi-threaded și un nucleu asincron bazat pe evenimente pentru a gestiona traficul concurent pe hardware multi-core. Dincolo de capabilitățile sale de bază de server, software-ul suportă gestionarea dinamică a configurației, permițând administratorilor să actualizeze exporturile și politicile de securitate la runtime fără a întrerupe conexiunile active ale clienților. Servește drept interfață unificată pentru integrarea stocării distribuite, facilitând accesul la fișiere cross-platform și gestionarea centralizată a directoarelor partajate într-o rețea.
Distributes incoming network traffic across a pool of worker threads to maximize performance on multi-core server hardware.