Awesome GitHub RepositoriesResponse Caching

Colly is a web scraping framework and concurrent crawler written in Go. It provides a system for traversing web pages, following links, and extracting structured data from HTML and XML documents. The framework includes a distributed scraping engine designed to spread data collection tasks across multiple instances to increase throughput. It ensures compliance with website owner policies by automatically reading and respecting robots.txt files. The system manages request lifecycles through domain-based rate limiting, concurrency controls, and session management via a stateful cookie jar. It s

Deepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai

Reselect is a state management optimization tool and memoization utility designed to minimize redundant calculations and UI re-renders. It functions as a library for creating memoized selectors that derive specific data from a state store. The library implements input-based memoization and recursive selector composition to create a hierarchy of derived data dependencies. It ensures reference-stable result caching and provides custom equality checking to determine when a cache should be invalidated. The project covers capabilities for derived data computation, frontend performance optimizatio

BrasilAPI is a REST API gateway that aggregates and exposes official Brazilian public data from fragmented government sources. It functions as a multi-provider data aggregator that normalizes heterogeneous information into a standardized JSON schema for consistent delivery. The system utilizes a multi-provider fallback pipeline to ensure reliable data resolution, querying several external APIs in sequence if a primary provider fails. It also incorporates a caching proxy gateway to reduce latency and avoid redundant requests for frequently accessed public data. The platform covers a broad ran

OkHttp-OkGo is a network request framework that wraps OkHttp to simplify the process of sending and receiving data from web services. It provides a structured system for managing asynchronous data streams and concurrency through integration with RxJava. The project includes dedicated managers for batch file transfers, enabling the simultaneous upload and download of multiple files. The download system supports breakpoint-based management, allowing interrupted transfers to be paused and resumed from the last saved position. Additional capabilities include a custom HTTP cache manager for defin

This project is a technical interview preparation resource focused on JavaScript. It provides a collection of common technical questions, detailed answers, and conceptual quizzes designed to help users master core language fundamentals and browser APIs. The resource utilizes an interactive infrastructure that includes a coding workspace with in-browser runtime execution and an automated test suite to validate code correctness. It organizes content through curated learning paths and modular concept mapping to decompose complex language fundamentals into searchable study modules. The curriculu

This project is a curated directory and catalog of privacy-respecting software and security-focused services. It serves as a structured resource for finding alternatives to corporate services, focusing on tools that prioritize data sovereignty, end-to-end encryption, and user anonymity. The directory is maintained as a markdown-based resource list and rendered via a static site generator. It further extends its utility through a CORS-enabled public API and a JSON-based data schema, allowing the curated catalog of tools and providers to be retrieved programmatically. The collection covers a w

Ce projet est une boîte à outils pour créer et gérer des autorités de certification X.509, fournissant des outils pour l'émission, la signature et la gestion de certificats TLS et de clés privées. Il inclut un utilitaire en ligne de commande pour générer des demandes de signature de certificat, regrouper des chaînes de certificats et analyser des fichiers PEM ou DER. Le système dispose d'un serveur API HTTP qui permet la signature et la vérification à distance des certificats en utilisant des requêtes et réponses JSON. Cette architecture prend en charge le provisionnement automatisé de certificats et inclut un proxy de signature pour transférer les requêtes vers des services backend distants. Le projet couvre un large éventail de capacités d'infrastructure PKI, incluant la création d'autorités racines et intermédiaires, la révocation de certificats et la construction de chaînes de confiance compatibles. Il fournit également des utilitaires pour le protocole OCSP (Online Certificate Status Protocol) afin de signer et mettre en cache les réponses pour vérifier le statut de révocation des certificats. La boîte à outils gère le cycle de vie des certificats via un suivi d'état basé sur une base de données et prend en charge diverses transformations d'encodage de données pour la compatibilité système.

CleanRL is a reinforcement learning library and PyTorch framework providing a suite of reproducible implementations for online reinforcement learning algorithms. It serves as a deep reinforcement learning benchmark suite and experiment orchestrator designed for research and agent development across both discrete and continuous action spaces. The project is distinguished by its single-file algorithm implementation approach, which encapsulates each algorithm in a standalone script to eliminate complex class hierarchies. This structure is paired with a system for scheduling and executing large-s

The inspector is a diagnostic and validation tool for the Model Context Protocol. It provides an interactive interface and a transport proxy to discover, inspect, and execute the tools, prompts, and resources provided by an MCP server. The project serves as a debugger and compliance tester to verify that server implementations adhere to the protocol specification and JSON-RPC standards. It allows for real-time monitoring of message exchanges and logs between clients and servers across various transport layers, such as standard input/output and Server-Sent Events. The tool covers a broad rang

Vaex is a high-performance Apache Arrow DataFrame library and out-of-core data processing engine designed to handle billion-row tabular datasets in Python. It functions as a lazy evaluation framework that defers computations and transformations until results are required, enabling the processing of datasets that exceed available system RAM by mapping files directly from disk. The project distinguishes itself as a tool for big data visualization and exploration, specifically integrated for use within interactive notebooks. It provides specialized capabilities for machine learning feature engin

Wego is a terminal-based weather client and dashboard that functions as an API wrapper for retrieving atmospheric data. It provides a command-line interface for accessing current weather conditions and multi-day forecasts across various provider backends. The tool features a provider-based abstraction to decouple data retrieval from specific API implementations and utilizes disk-based response caching to reduce redundant network requests. It supports local configuration storage for persisting API credentials and preferred locations across separate command executions. The system includes capa

Lean 4 is a functional programming language and interactive proof assistant used to formalize mathematics and verify software correctness. It functions as a dependent type theorem prover and a formal verification tool that allows users to construct mathematical proofs and ensure program correctness. Additionally, it serves as a logic-based source for generating verified datasets used to train and benchmark artificial intelligence reasoning systems. The system distinguishes itself through a small-kernel verification model, where all proofs are verified by a trusted core of basic logical rules.

Xget est un proxy réseau basé sur la périphérie (edge) et un routeur de requêtes conçu pour optimiser la connectivité et réduire la latence pour les ressources distantes. Il fonctionne comme une interface haute performance pour les requêtes API d'inférence IA, la mise en miroir de registres de conteneurs et l'accélération des opérations de dépôt Git et des miroirs de paquets logiciels. Le système se distingue par un proxy conscient du protocole qui préserve l'authentification et les en-têtes pour les registres Git et de conteneurs. Il utilise une transformation d'URL basée sur des règles pour mapper les requêtes vers des points de terminaison de fournisseurs amont accélérés et emploie un mécanisme de réécriture de réponse pour garantir que les dépendances se téléchargent via le proxy. Les capacités larges incluent la mise en cache des réponses en périphérie pour les artefacts immuables, la fiabilité des requêtes via des tentatives de backoff linéaire, et la surveillance des performances fournie via les en-têtes de réponse. Le projet fournit également une interface de ligne de commande pour récupérer des fichiers et des dossiers à partir de sources web vers le stockage local. Le moteur prend en charge le déploiement via des runtimes edge serverless, l'hébergement conteneurisé ou l'exécution de conteneurs auto-hébergés.

This PHP caching library provides a key-value storage abstraction designed to reduce application computation time by storing and retrieving frequently accessed data. It implements the PSR-6 standard for caching interfaces to ensure interoperability between different libraries. The project includes a legacy cache adapter that wraps modern standardized cache pools. This allows systems in transition to maintain compatibility by converting between legacy caching implementations and unified interfaces. The library covers a range of storage capabilities, including a filesystem cache store for pers

This project is a comprehensive Lisp AI implementation library that provides reference implementations for various artificial intelligence paradigms and symbolic algorithms. It functions as a multi-purpose toolkit containing a logic programming engine, a natural language processing suite, and a symbolic mathematics toolkit. The library is distinguished by its diverse architectural frameworks, including a Prolog-style execution engine that uses unification and goal-driven backtracking, and a system for simulating human decision-making through expert system shells and certainty factors. It also

Undici is a high-performance HTTP client for Node.js designed to execute network requests while minimizing resource overhead and latency. The project provides specialized capabilities for HTTP request pipelining to increase throughput and memory-based response caching to reduce redundant network calls. It also supports HTTP tunneling and proxying through the establishment of secure two-way communication channels via the connect method. Additionally, the client includes tools for web API polyfilling to provide standard browser network interfaces within Node.js environments. Its functional sur

Riverpod is a reactive state management framework for Dart that manages application state through providers which automatically track dependencies and rebuild dependents when values change. It functions as an asynchronous data caching library, caching results of async operations and exposing loading, error, and data states to widgets without manual future handling. The framework includes a provider composition system that combines multiple providers into derived values that recompute automatically when any dependency changes, along with code generation for state providers that reduces boilerpl

This project is a Lua-based theme plugin for Neovim that provides a set of customizable color schemes and a synchronized color palette across the editor user interface. It functions as a theme framework that manages highlight groups and color configurations to define the visual appearance of the workspace. The framework distinguishes itself through a cross-plugin color system that synchronizes visual identity across third-party Neovim extensions and language tools. It allows for granular customization via palette overrides, enabling users to redefine specific hex codes and map abstract semant

Lura is an API gateway and traffic router that directs network requests to backend services using a configurable pipeline of processing steps. It functions as a backend load balancer and a request middleware engine designed to validate, modify, and transform incoming requests and responses. The system specializes in API response aggregation, allowing it to execute concurrent requests to multiple backend services and merge the results into a single unified output. This includes the ability to perform dynamic response mapping by renaming fields and filtering data to optimize the final client pa