21 Repos
Extracting origin information and other metadata from incoming requests.
Distinguishing note: Focuses on request-level metadata extraction.
Explore 21 awesome GitHub repositories matching web development · Request Metadata. Refine with filters or upvote what's useful.
Koa is a lightweight web framework for Node.js designed for building HTTP applications and servers. It functions as an asynchronous middleware engine that processes network requests through a sequence of functions sharing a common context. The framework distinguishes itself by using an onion-model middleware stack and promise-based flow control. This architecture allows requests to flow downstream and responses to flow back upstream through the same chain, enabling non-blocking request cycles and a modular approach to handling network traffic. The system provides high-level capabilities for
Extracts HTTP method, URL, host, and remote IP addresses, including support for reverse proxy headers.
Echo is a high-performance, lightweight web framework for Go designed for building scalable RESTful APIs and web services. It provides a centralized environment for mapping network requests to handler functions, utilizing a fast radix-tree routing engine to ensure efficient request dispatching. The framework is built around a modular, middleware-centric pipeline that allows developers to execute reusable logic for cross-cutting concerns like authentication, logging, and security across the entire application. What distinguishes Echo is its focus on developer productivity through structured da
Identifies the origin of incoming traffic by extracting client IP addresses.
This project is a privacy-focused, self-hosted metasearch engine that aggregates results from a wide array of web, academic, and media sources into a single, unified interface. By acting as a proxy between the user and external search providers, it strips identifying headers and tracking parameters from requests, ensuring that search activity remains anonymous and protected from third-party profiling. The platform distinguishes itself through a modular, plugin-based architecture that allows for extensive customization of search behavior, result filtering, and interface branding. It supports a
Displays technical request metadata like IP addresses within the search interface.
Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
Analyzes and summarizes failed requests to help identify and resolve issues with target websites.
FastMCP is a Python framework designed for building servers that expose functions, resources, and prompts to AI models using the Model Context Protocol. It simplifies the development process by automatically deriving tool metadata, input schemas, and documentation directly from Python function signatures and type hints. The framework provides a unified container for managing these components, allowing developers to build modular applications that integrate seamlessly with AI assistants. The project distinguishes itself through its support for interactive, server-defined user interface compone
Accesses unique identifiers and client-provided metadata for the current request to enable context-aware tool behavior.
Elysia is a high-performance TypeScript web framework designed for building type-safe backend services. It provides a modular, plugin-based architecture that allows developers to compose server logic, middleware, and validation schemas into scalable application instances. By leveraging native web standards, the framework ensures portability across diverse JavaScript runtimes, including Node.js, Deno, and various edge computing environments. The framework distinguishes itself through its focus on end-to-end type safety, automatically synchronizing request and response definitions between the s
Extracts payloads, query parameters, and path variables for use within route handlers.
websocketd is a CGI web server and process-to-WebSocket wrapper that transforms command line programs into WebSocket servers by bridging standard input and output streams to remote clients. It functions as a TLS-secured gateway that routes traffic to backend processes, allowing any executable using standard IO to be exposed via a web interface. The project uses directory-based endpoint mapping to automate the creation of URL paths from local executable files. It employs a process-per-connection model to isolate execution and forwards HTTP request metadata, such as cookies and query parameters
Forwards remote host, cookies, and query parameters to backend processes through standard environment variables.
Hammerspoon is a programmable automation engine for macOS that enables deep system-level control through a Lua scripting environment. By bridging high-level scripts with native Objective-C APIs, it allows users to interact with the operating system's accessibility tree, intercept hardware input streams, and manage the lifecycle of running applications. The project distinguishes itself through an event-driven architecture that registers asynchronous hooks for system notifications and hardware events. This allows for real-time automation, such as remapping keyboard and mouse inputs, managing wi
Extracts environment variables and HTTP headers from incoming requests.
Tinyhttpd is a minimal HTTP web server designed to process requests, deliver static files, and execute CGI scripts via network sockets. It serves as an educational implementation for studying the fundamental mechanics of the HTTP protocol and network programming. The server supports the Common Gateway Interface to generate dynamic content by launching external programs as subprocesses. It manages these dynamic requests by redirecting data through pipes and system environment variables. The system provides capabilities for parsing HTTP request methods and URLs, mapping those requests to local
Implements the transfer of request metadata to CGI subprocesses via system environment variables.
EmDash is an open-source content management system built on Astro that combines a visual admin panel with a plugin-driven architecture and server-side rendering. It provides a complete content management system with structured content modeling, a rich text editor using Portable Text format, and a TypeScript API for type-safe content queries. The system supports authentication through passkeys, OAuth 2.1, and external providers, with role-based access control and fine-grained permission scopes. What distinguishes EmDash is its plugin development framework, which supports both native plugins ru
Provides access to the current request's URL, method, headers, and platform-normalized metadata like IP and user agent.
This project is a comprehensive sample library and implementation guide for ASP.NET Core. It provides a collection of practical examples and projects that demonstrate how to build web applications, RESTful APIs, and high-performance services. The repository focuses on a variety of architectural patterns, including the development of Minimal APIs, contract-first gRPC services, and real-time communication using WebSockets and Server-Sent Events. It includes detailed implementations for user identity and security, such as token-based authentication and CSRF protection. The codebase covers a bro
Provides examples of capturing and examining HTTP request metadata such as verbs and headers.
Warp is a Rust HTTP web framework designed for building high-performance web servers. It provides a system for managing request pipelines, implementing WebSocket servers for bidirectional communication, and serving static assets from the local filesystem. The framework is characterized by its use of type-safe request pipelines and routing. It utilizes a filter-based approach to extract and validate metadata from headers, query strings, and request bodies before they reach the application handler. Broad capability areas include HTTP API development, asynchronous task execution, and state-base
Extracts and validates metadata from headers and query strings to control request flow.
Sub-Store is a proxy subscription management server that aggregates multiple subscription links into a single unified stream for distribution to various clients. It functions as a transformation pipeline that filters, modifies, and reformats proxy node metadata. The system acts as a cross-platform format converter to ensure compatibility across diverse client applications. It includes an encryption decryption gateway that uses private keys to handle age-standard encrypted subscription content and a cache-layered aggregator to reduce external requests. The server provides capabilities for dyn
Specifies custom User-Agents and proxy nodes when fetching remote data to bypass regional blocks.
OrbStack is a native macOS application that replaces Docker Desktop, providing an all-in-one environment for running Docker containers, full Linux virtual machines, and local Kubernetes clusters. It runs Linux VMs directly on the macOS hypervisor framework for near-native performance, uses VirtioFS for fast bidirectional file sharing between macOS and Linux, and leverages Rosetta for near-native x86 emulation on Apple Silicon. The system assigns predictable local domain names to containers and VMs with automatic HTTPS certificate generation, forwards ports via event-driven updates, and stores
Controls which host environment variables are passed into Linux machines via a configurable list.
Cross is a container-based build environment and cross-compilation tool for Rust. It functions as a multi-architecture binary builder and testing framework, allowing users to compile crates into binaries for different operating systems and CPU architectures without installing local toolchains on the host system. The project distinguishes itself by using Docker images to provide consistent toolchains and system dependencies for foreign target architectures. It integrates the Zig toolchain within container images to facilitate compilation across various architectures and library versions, and i
Forwards selected host environment variables and user identifiers into the isolated build environment to maintain configuration consistency.
Waku is a minimal React framework built around React Server Components. It renders components exclusively on the server for data fetching and server-side logic, then hydrates client components in the browser for interactivity. The framework supports hybrid rendering, mixing static prerendering at build time with dynamic per-request rendering within a single application, and allows independently loading slice components that can be static or dynamic. The framework distinguishes itself through its file-based routing system that defines pages, layouts, and API endpoints by placing files in a dir
Reads incoming request metadata and passes it to server components and server functions.
Helicone is an AI gateway and observability platform designed to intercept, manage, and monitor interactions with large language models. By acting as a reverse-proxy, it provides a centralized layer for routing requests across multiple AI providers, allowing developers to maintain consistent application logic while gaining deep visibility into model performance, usage, and costs. The platform distinguishes itself through a robust suite of traffic management and prompt engineering tools. It enables policy-driven control, including automatic failover between providers, rate limiting, and edge-b
Labels and categorizes interactions with custom dimensions and unique identifiers to simplify searching, filtering, and session tracking.
Hono ist ein minimales JavaScript-HTTP-Framework, das für den Aufbau von Webservern über mehrere Runtimes hinweg entwickelt wurde, einschließlich Node.js, Edge-Runtimes und Serverless-Plattformen. Es fungiert als Cross-Runtime-Webserver und Web-Standard-API-Wrapper, der verschiedene Runtime-Request- und Response-Objekte in Standard-Web-API-Signaturen normalisiert. Das Projekt dient als HTTP-Middleware-Orchestrator und Request-Handler, der eine Middleware-basierte Request-Pipeline und hierarchisches Routen-Mounting nutzt, um modulare Serverstrukturen zu erstellen. Es zeichnet sich durch einen Runtime-agnostischen Event-Wrapper aus, der konsistentes Verhalten unabhängig von der Bereitstellungsumgebung gewährleistet. Das Framework deckt ein breites Spektrum an Funktionen ab, einschließlich HTTP-Request-Routing mit dynamischer Parametererfassung, Echtzeit-WebSocket-Kommunikation und umfassenden Sicherheitsmaßnahmen wie CORS-Management und Basic-Authentifizierung. Zudem bietet es Hilfsmittel für das Sitzungsmanagement via Cookies, statisches Asset-Serving und Traffic-Management durch Request-Proxying und URL-Weiterleitung. Das Projekt ist in TypeScript implementiert.
Retrieves the hostname, client IP, and protocol from the incoming request.
Connexion ist ein Spec-First-Python-Webframework, das darauf ausgelegt ist, Serververhalten und Validierungslogik direkt aus einem vordefinierten API-Vertrag abzuleiten. Es ermöglicht die Entwicklung von Webdiensten durch die Verwendung einer OpenAPI-Spezifikation, um Routing, Request-Validierung und Response-Serialisierung automatisch zu handhaben. Das Framework zeichnet sich dadurch aus, dass es als OpenAPI-Request-Validator und Mock-Server fungiert. Es kann API-Verhalten simulieren, indem es Beispielantworten basierend auf Spezifikationsschemata bereitstellt, was Frontend-Entwicklung und Prototyping vor Abschluss der Backend-Implementierung ermöglicht. Zudem hostet es eine interaktive API-Dokumentationsschnittstelle, die Benutzern eine Konsole zur Visualisierung und zum Testen von Endpunkten bietet. Das Projekt deckt ein breites Spektrum an Funktionen ab, einschließlich automatisierter Routenregistrierung, Parameter-Injektion und Sicherheitsdurchsetzung basierend auf Vertragsdefinitionen. Es bietet zudem Tools zur Schema-Validierung von Requests und Responses sowie die Möglichkeit, Anwendungs-Exceptions auf standardisierte maschinenlesbare Fehlerantworten abzubilden.
Extracts raw headers, content types, path segments, and query parameters from the request object.
Gowitness is a system for rendering web interfaces at scale to capture visual snapshots, HTTP metadata, and network scan results. It functions as a headless browser screenshot tool and a web surface mapper used to identify and visually document the attack surface of network ranges and URL lists. The tool includes a screenshot gallery server that provides a web-based interface for browsing, filtering, and managing a database of captures. It specifically serves as an Nmap target visualizer, parsing network scan results to automatically capture screenshots of discovered web services. Capabiliti
Records HTTP headers, cookies, console logs, and request traffic during page rendering.