16 Repos
Frameworks and utilities for building and exposing HTTP-based service layers.
Distinguishing note: Focuses on the server-side implementation of API endpoints rather than client-side consumption.
Explore 16 awesome GitHub repositories matching web development · API Servers. Refine with filters or upvote what's useful.
Focalboard is a self-hosted project management tool designed for tracking tasks and organizing workflows on private infrastructure or local hardware. It functions as a cross-platform collaboration solution, providing a unified environment for distributed teams to manage data while maintaining full control over security and storage. The platform distinguishes itself by offering both a server-based deployment model and a standalone desktop productivity application. By packaging web-based tools into native shells, it enables reliable offline access and a dedicated workspace for individual users.
Exposes core business logic through standard HTTP endpoints.
Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob
Transforms scraping tasks into persistent server processes that expose extracted data via HTTP endpoints.
gpt-crawler is a web scraping utility designed to extract website content and convert it into structured text files for use as AI model knowledge bases. It functions as a data generator that crawls specified web addresses to produce the knowledge files required for building custom GPTs, grounding large language models, and providing context to AI agents. The system transforms raw HTML into clean Markdown text to reduce token usage and improve readability for AI models. It utilizes token-aware content chunking and output file size limitations to ensure generated datasets remain compatible with
Provides a REST API server to programmatically trigger and manage web scraping jobs.
Wasp is a declarative full-stack web framework that enables developers to build and deploy applications by defining their architecture in a centralized configuration. By using a high-level specification, the framework automates the orchestration of frontend, backend, and database components, ensuring that infrastructure concerns like routing, authentication, and data modeling are handled consistently across the entire stack. The framework distinguishes itself through its compiler-driven approach, which translates declarative configurations into cohesive, production-ready codebases. It provide
Maps server-side logic to network addresses to ensure reliable communication between client and backend services.
BBDown is a command line media downloader and API client designed for downloading videos, audio, and subtitles from Bilibili. It functions as a tool for video archiving and content scraping, capable of parsing video metadata and extracting stream URLs via Bilibili web, TV, and mobile interfaces. The project provides a media download server that hosts a network interface, allowing its parsing and downloading capabilities to be exposed as an API for remote clients. It utilizes multi-API stream resolution to identify the highest quality streams across different platform endpoints. The tool incl
Provides a hosted network interface to expose parsing and downloading logic as an API for remote clients.
LoopBack is a Node.js API framework used to build RESTful services and backend applications. It functions as a model-driven API generator that automatically maps predefined data models to network endpoints to create standardized web interfaces. The project features a database abstraction layer that unifies access across diverse SQL databases, NoSQL stores, and remote data sources. It includes a backend application scaffolder using command-line generators to automate the creation of project structures and data connectors. Additionally, it provides an API authentication system to manage applica
Provides a framework for building servers that expose data and business logic through programmable HTTP-based service layers.
CrowdSec is a collaborative, distributed security engine designed for threat detection and infrastructure protection. It functions as an intrusion detection system that parses logs and network traffic to identify malicious patterns, utilizing a bucket-based threshold detection model to aggregate events and trigger alerts. The platform is built on a modular architecture that includes a centralized local API server for managing security signals and a relational database for persistent storage of remediation decisions. What distinguishes the project is its decoupled enforcement model, which offl
Provides a centralized API service for aggregating security signals and coordinating remediation decisions across distributed agents.
atproto is a decentralized social networking protocol implementation and a schema-driven API framework. It provides the networking and data standards required to build interoperable social networks where users control their own identity and data through a personal data server specification. The project distinguishes itself through a DID-based identity system for managing cryptographic keys and verifiable profiles, alongside a lexicon-based protocol definition that uses versioned schemas to ensure consistency across network services. It utilizes Merkle Search Trees for verifiable data storage,
Provides a server implementation that validates requests and responses using predefined schemas.
Crawlee-python is a web crawling framework for building scalable scrapers using Python. It serves as a comprehensive tool for web scraping automation, providing a system to extract structured data from websites using both lightweight HTTP requests and headless browser automation. The framework is distinguished by its anti-bot evasion capabilities, which include browser fingerprint impersonation and tiered proxy rotation to bypass detection systems and solve challenges such as Cloudflare. It also incorporates artificial intelligence for autonomous website navigation and schema-based data extra
Transforms a scraping process into a persistent server that listens for requests and returns real-time data.
Sapper is a universal web application framework and server-side rendering framework for Svelte. It enables the development of applications that render views on the server for fast initial loads and hydrate them on the client for subsequent interactivity. The project features a file-based routing engine that maps URL paths to components based on the file system structure. It also functions as a static site generator, exporting production-ready HTML, CSS, and JavaScript files for hosting in environments without a live server. The framework covers full-stack development capabilities, including
Allows the creation of server-side API endpoints using modules that handle HTTP requests and responses.
Metrics Server is a lightweight, single-purpose daemon that collects CPU and memory usage data from every node and pod in a Kubernetes cluster and exposes those metrics through a standard Kubernetes API endpoint. It registers as an aggregated extension API server behind the Kubernetes apiserver, making resource utilization data available to the Horizontal Pod Autoscaler and Vertical Pod Autoscaler for automatic replica count and resource request adjustments. The project distinguishes itself by operating as a focused, in-cluster resource metrics collector that polls kubelet summary endpoints a
Registers as an aggregated extension API server behind the Kubernetes apiserver for custom metric endpoints.
Webhook.site is a web-based tool that captures, inspects, and debugs incoming HTTP requests and emails sent to a unique URL, without requiring any server setup. It also functions as an API mocking and response modification tool, capable of generating mock APIs from OpenAPI specifications and altering HTTP responses, headers, and status codes for testing purposes. Beyond inspection, it serves as a platform for webhook automation and workflow orchestration, triggering multi-step automations—including database queries, SSH commands, and HTTP calls—when a webhook is received. The service distingu
Webhook.site creates a functional API endpoint on the fly without provisioning any infrastructure or writing server code.
Terrascan ist ein Security-Scanner für Infrastructure-as-Code und ein Cloud-Konfigurations-Auditor, der entwickelt wurde, um Sicherheitsverletzungen und Compliance-Risiken in Cloud-Templates und Dockerfiles vor der Bereitstellung zu erkennen. Es nutzt den Open Policy Agent, um Infrastruktur-Templates sowohl gegen Standard-Sicherheitsrichtlinien als auch gegen benutzerdefinierte organisatorische Regeln zu evaluieren. Das Projekt fungiert als Sicherheitsleitplanke innerhalb von Build-Pipelines und blockiert riskante Deployments, indem es die Scanning-Logik direkt in CI/CD-Workflows integriert. Es enthält zudem einen Container-Registry-Vulnerability-Scanner, der Schwachstellendaten aus Registries sammelt, um Sicherheitsberichte für die Infrastruktur zu ergänzen. Das Toolset deckt Cloud-Compliance-Auditing, lokale Sicherheits-Tests während der Entwicklung und Policy-Enforcement ab. Es bietet eine Abfragesprache zur Definition benutzerdefinierter Sicherheitsanforderungen und unterstützt die Unterdrückung von Ergebnissen über Konfigurationsdateien, um Richtlinienverstöße zu verwalten. Scanning-Funktionen können über ein Command-Line-Interface oder einen Hintergrund-API-Server für externe Orchestrierung aufgerufen werden.
Provides a background HTTP server to expose scanning capabilities for external integration.
orpc is a contract-first API development framework for TypeScript that starts with a shared contract definition and generates type-safe clients and servers from that single source of truth. It guarantees end-to-end type safety, meaning inputs, outputs, errors, and streaming data are all checked at compile time across the client–server boundary. What distinguishes orpc from typical RPC frameworks is its ability to export contracts as OpenAPI specifications, to optimize server-side rendering by calling API handlers directly inside the server process, and to support real‑time bidirectional commu
Serves the defined API contract over HTTP using a server runtime, supporting multiple platforms.
BilibiliSponsorBlock is a content filtering system and API server designed to identify and remove sponsored segments and filler content from Bilibili video playback. It utilizes a crowdsourced segment database where users contribute and vote on timestamps to create a shared repository of skippable video sections. The project features a video metadata synchronizer that links equivalent videos across different platforms, allowing skip markers and timing data to be shared between mirrored content. It implements a reputation-based permission system to manage submissions and edits, alongside a pri
Provides a backend for managing and retrieving community-sourced timestamps to skip sponsored content in Bilibili videos.
TheHive is a security incident response platform and multi-tenant case management system. It functions as a Security Orchestration, Automation, and Response (SOAR) tool and a threat intelligence platform designed to coordinate security investigations by managing alerts, cases, and observables. The platform is distinguished by its multi-tenant architecture, which isolates data across different organizations while supporting selective cross-tenant sharing. It features a SOAR automation engine capable of executing sandboxed JavaScript logic to automate workflows and trigger response actions thro
Automatically generates public API endpoints upon function creation for external triggering of internal logic.