88 مستودعات
Support for connecting diverse external storage drivers.
Distinguishing note: Focuses on the integration of external drivers rather than internal storage.
Explore 88 awesome GitHub repositories matching data & databases · External Storage Integrations. Refine with filters or upvote what's useful.
Karakeep is a self-hosted, open-source platform designed for personal knowledge management and web content archiving. It functions as a centralized repository where users can capture, organize, and preserve bookmarks, notes, and media files, ensuring long-term access to digital information even if original sources are removed or modified. The system distinguishes itself through its automated content processing and security-focused architecture. It utilizes headless browser crawling and optical character recognition to ingest and index web content, while a modular artificial intelligence pipel
Configures local or cloud-based object storage backends to manage archived media and bookmark files for improved scalability.
This project is an asynchronous key-value store designed for client-side data persistence. It provides a unified interface that allows applications to save and retrieve complex data types, including binary objects, while maintaining responsiveness through non-blocking operations. By enabling offline-first functionality, it ensures that data remains accessible even when a network connection is unavailable. The library distinguishes itself through a driver-based abstraction layer that automatically detects the most efficient storage mechanism available in the current browser or mobile environme
Connects external storage drivers to persist data across diverse environments.
Iris is a high-performance web framework and API toolkit for the Go programming language. It provides the infrastructure necessary to build HTTP/2 web applications, REST APIs, and MVC-based websites. The project distinguishes itself through a flexible architectural model that supports multiple isolated application instances within a single process and allows for binary-embedded asset loading to eliminate external filesystem dependencies. It features dynamic router hot-reloading and a pluggable view engine for rendering dynamic HTML content. The framework covers a broad range of capabilities,
Establishes type-safe access to external databases within the request lifecycle.
Crystal is a statically typed, compiled programming language designed for high performance and memory safety. It leverages an LLVM-based compiler to translate source code into optimized machine-executable binaries, while its type-inference-based static analysis enforces strict safety rules during the build process. The language distinguishes itself through a fiber-based concurrent runtime that manages lightweight execution units for asynchronous input and output without blocking the main process. It also features a powerful compile-time macro system that allows for the inspection and transfor
Configures and connects to persistent storage services to support data-driven integration testing.
Luigi is a Python framework designed for building and managing complex batch data pipelines. It functions as a workflow orchestration engine that organizes tasks into directed acyclic graphs, ensuring that jobs execute in the correct logical order based on their dependencies. By utilizing a centralized scheduler, the system coordinates task execution across distributed environments, tracks global workflow state, and prevents redundant processing by verifying the existence of output targets before triggering any work. The project distinguishes itself through a robust state-tracking mechanism t
Connects to cloud storage and databases to maintain consistent data access across environments.
Opik is an observability and evaluation platform designed for generative AI applications and agentic workflows. It provides a centralized environment for tracing execution flows, managing prompt templates, and monitoring production performance, allowing teams to gain visibility into complex model interactions and tool usage without requiring manual application code changes. The platform distinguishes itself through its integrated approach to the AI development lifecycle, combining distributed trace instrumentation with automated evaluation frameworks. It supports model-as-a-judge scoring, syn
Connects to external object storage services using cloud-native identity roles or credentials.
node-lessons is a comprehensive Node.js programming course and instructional guide. It provides a collection of guided lessons and code examples designed to teach the fundamentals of the Node.js runtime and server-side JavaScript development. The project serves as a practical guide for building web servers and backend applications, specifically covering the implementation of HTTP servers, request routing, and middleware chains. It includes specialized instructional material on managing asynchronous JavaScript workflows through promises and flow control, as well as guides for integrating NoSQL
Offers lessons on connecting applications to various database backends with a focus on document mapping.
Cayley is a graph database and query engine designed to store and retrieve interconnected data. It functions as a quad store, persisting information as four-element tuples to maintain complex relationships and semantic linked data. The system features a backend-agnostic storage layer that decouples the graph API from the underlying data store. This allows for the integration of external backends through a modular adapter system, enabling the synchronization of data across different storage engines. The project provides a pattern-matching query engine for extracting specific nodes and relatio
Enables synchronization across different systems by connecting to various external storage drivers.
Filestash is a unified storage management platform that provides a web-based interface for browsing, managing, and accessing files across diverse local and cloud storage backends. It functions as a centralized gateway, aggregating services such as S3, SFTP, WebDAV, and FTP into a single, consistent environment for remote filesystem administration and secure document handling. The platform distinguishes itself through a modular, plugin-based architecture that supports custom storage drivers, authentication providers, and authorization logic. It includes built-in capabilities for server-side me
Supports connecting to remote storage backends via standard SFTP protocols for seamless file browsing and management.
Flysystem is a PHP storage library that provides a filesystem abstraction layer. It enables the management of files across local disks, cloud buckets, and remote servers using a unified interface, decoupling application logic from provider-specific APIs. The project facilitates storage provider migration by allowing developers to swap underlying adapters without changing application code. It includes a multi-backend manager capable of mounting volumes and coordinating file movements between diverse storage systems. The library covers a broad range of file operations, including directory list
Coordinates multiple storage adapters as virtual volumes to facilitate moving files between different backends.
This is a virtualization tool designed to run macOS guest operating systems, such as Catalina, Mojave, and High Sierra, inside VirtualBox on Windows, Linux, or Mac hardware. It provides a system for deploying these operating systems on x86 CPUs using official installation files. The project includes specialized utilities to manage EFI and NVRAM settings, enabling the emulation of device serial numbers and board identifiers to allow connectivity for cloud services and messaging. It also features a configurator for adjusting CPUID profiles and display resolutions to ensure hardware compatibilit
Handles macOS version upgrades by attaching additional virtual volumes to the guest.
TinaCMS is a headless content management framework that bridges local Git-based file storage with a visual, in-context editing interface. By treating your repository as the single source of truth, it enables developers to manage content as structured data files while providing editors with a browser-based dashboard to modify website content directly within a live preview. The framework distinguishes itself by transforming local files into a unified GraphQL API, which powers both the administrative interface and the application's data retrieval layer. This architecture allows for compile-time
Supports connecting external database services to maintain state and support multi-user collaboration.
Kubeshark is a network observability platform designed for Kubernetes environments, functioning as an eBPF-powered engine for cluster-wide traffic analysis. It captures, indexes, and visualizes network activity and API calls directly from the kernel, providing deep visibility into service-to-service communication without requiring sidecar proxies or manual code instrumentation. The platform distinguishes itself through its ability to perform protocol-aware traffic dissection and user-space cryptographic hooking, which allows for the inspection of encrypted traffic and the reconstruction of ap
Mounts external file system volumes to store captured traffic data, supporting both dynamic provisioning and static infrastructure configurations.
Kepler.gl is a web-based geospatial visualization framework designed for rendering large-scale location datasets. It functions as a modular React mapping component that enables developers to embed interactive, high-performance geographic visualizations into web applications, serving as a comprehensive engine for building browser-based GIS dashboards. The library distinguishes itself through a highly extensible architecture that centers on centralized state management. By utilizing a predictable state-driven model, it allows for the programmatic control of map layers, filters, and viewport set
Supports connecting diverse external storage drivers for consistent file management and data persistence.
Grist is a relational spreadsheet platform that combines the flexibility of a spreadsheet with the power of a relational database. At its core, it manages structured data across multiple linked tables, using a relational database engine to organize information while providing a familiar grid interface. The platform supports Python-based formulas for complex calculations and data transformations, with automatic recalculation when referenced cells change. The system is designed for self-hosted deployment, storing data in either portable SQLite files or enterprise-grade PostgreSQL databases. It
Integrates with Google Drive for file management and configures external attachment storage limits.
Perspective is a columnar data analytics engine and high-performance visualization component powered by WebAssembly. It provides a system for analyzing and visualizing large or streaming datasets through interactive data grids and charts, utilizing a compiled binary to achieve near-native performance within the browser. The project distinguishes itself through a WebSocket-based data streaming interface and deep Apache Arrow integration, which minimize memory overhead when synchronizing tables between servers and clients. It acts as a remote query proxy capable of translating visualization con
Integrates external DuckDB instances as virtual servers to query and visualize data natively.
Talos is a minimal, immutable Linux distribution designed specifically for deploying and managing Kubernetes clusters. It functions as an API-driven infrastructure manager that replaces traditional shell access with a declarative gRPC interface to control operating system state and configuration. The system is distinguished by its use of a read-only root filesystem and a security-hardened kernel, which removes standard GNU utilities to reduce the attack surface. It ensures environment consistency by distributing the operating system as versioned, signed images and utilizes TPM-backed verified
Integrates external storage using virtiofs to provide the system with access to volumes outside the local disk.
Umbrel is a home server operating system designed to centralize the management of self-hosted applications and personal data services. It provides a unified, web-based graphical dashboard that abstracts complex system administration tasks, allowing users to deploy and maintain private cloud infrastructure, blockchain nodes, and media streaming services without requiring command-line interaction. The platform distinguishes itself through a modular application marketplace that automates the retrieval, configuration, and lifecycle management of containerized software. It integrates local artific
Supports external storage configuration to separate system files from data and prevent boot media wear.
PyCaret is a Python AutoML platform and MLOps lifecycle manager designed to automate machine learning workflows. It functions as a low-code environment that leverages a scikit-learn native engine to execute preprocessing, training, and evaluation for tabular data. The platform distinguishes itself as an LLM-powered ML copilot, using large language model agents to analyze datasets, design experiment configurations, and explain model results. It also serves as a Kubernetes ML orchestrator and model registry, enabling the versioning of trained pipelines and their promotion to production API endp
Supports integrating external managed databases, caches, and object storage drivers instead of bundled containers.
OpenEBS is a container-native storage platform that provides persistent volumes for stateful applications running on Kubernetes. It operates through a Kubernetes-native microservice architecture, where storage controllers are managed entirely with kubectl and standard Kubernetes APIs, and offers both local and replicated block storage options. The platform distinguishes itself through synchronous NVMe-TCP replication, which replicates block data across nodes to enable pod rescheduling after node failure without data loss. It also includes a snapshot and clone engine for capturing point-in-tim
Mounts host paths, attached drives, and LVM/ZFS stacks directly into pods for low-latency access.