awesome-repositories.com
Blog
MCP
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektMCP-ServerÜber unsRanking-MethodikPresse
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

89 Repos

Awesome GitHub RepositoriesFile Storage Services

Interfaces for managing file uploads, storage, and retrieval across local or cloud-based backends.

Explore 89 awesome GitHub repositories matching data & databases · File Storage Services. Refine with filters or upvote what's useful.

Awesome File Storage Services GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • awesome-selfhosted/awesome-selfhostedAvatar von awesome-selfhosted

    awesome-selfhosted/awesome-selfhosted

    299,516Auf GitHub ansehen↗

    Dieses Projekt ist ein von der Community kuratiertes Verzeichnis von Open-Source-Software, die für den Einsatz in privaten Serverumgebungen und Home-Labs konzipiert ist. Es dient als umfassende Ressource zur Entdeckung unabhängiger, selbst gehosteter Alternativen zu gängigen Cloud-Diensten und ermöglicht es Nutzern, die volle Datenhoheit und Kontrolle über ihre digitale Infrastruktur zu behalten. Das Verzeichnis ist durch eine hierarchische Taxonomie strukturiert, die eine riesige Sammlung von Anwendungen in logische Kategorien organisiert, von Medienmanagement und Datenanalyse bis hin zu privater Kommunikation und Tools für die Teamproduktivität. Es zeichnet sich durch einen kollaborativen Peer-Review-Prozess aus, bei dem Community-Mitglieder die Qualität und Relevanz jeder Einreichung validieren, um sicherzustellen, dass das Verzeichnis korrekt und zuverlässig bleibt. Das Projekt deckt ein breites Spektrum an Fähigkeiten ab, einschließlich Infrastruktur-Automatisierung, containerbasierter Service-Bereitstellung und deklarativem Konfigurationsmanagement. Diese Tools unterstützen Nutzer bei der Aufrechterhaltung reproduzierbarer Serverumgebungen und der Verwaltung komplexer Service-Abhängigkeiten auf privater Hardware. Das Verzeichnis wird als versionskontrolliertes Repository gepflegt, wodurch sichergestellt wird, dass alle Updates und Community-gesteuerten Änderungen nachverfolgt und transparent sind.

    Utilizes object storage backends to manage file persistence and scale storage capacity.

    awesomeawesome-listcloud
    Auf GitHub ansehen↗299,516
  • pocketbase/pocketbaseAvatar von pocketbase

    pocketbase/pocketbase

    59,120Auf GitHub ansehen↗

    Pocketbase is a backend-as-a-service platform that provides a self-contained, single-binary server for building full-stack applications. It integrates a relational database, authentication, and file storage into one executable process, eliminating the need for external infrastructure or complex server management. The platform distinguishes itself through an embedded database engine that runs directly within the application process and a reactive communication layer that pushes live updates to connected clients. By monitoring internal transaction logs, it synchronizes data across multiple user

    Abstracts file upload and retrieval processes to support both local disk and cloud-based storage backends.

    Goauthenticationbackendgolang
    Auf GitHub ansehen↗59,120
  • ncw/rcloneAvatar von ncw

    ncw/rclone

    57,898Auf GitHub ansehen↗

    rclone is a command-line utility and sync engine for managing, synchronizing, and migrating files across numerous cloud storage providers. It functions as a storage management tool that enables bidirectional or one-way synchronization between local filesystems and remote cloud backends. The project acts as a unified cloud storage gateway, capable of merging multiple remote providers into a single directory tree. It further provides a filesystem mount to expose remote cloud storage as a local disk for direct operating system access and a transparent encryption wrapper to secure data before it

    Verifies file integrity by checking hash values and preserving timestamps across storage backends.

    Go
    Auf GitHub ansehen↗57,898
  • lenve/vhrAvatar von lenve

    lenve/vhr

    28,090Auf GitHub ansehen↗

    This project is a human resources management system built using Spring Boot and Vue. It serves as a platform for managing employee records, professional titles, and organizational hierarchies. The system features a role-based access control framework that maps users to specific roles and resources to secure API endpoints and user interface elements. It includes a real-time communication hub utilizing WebSockets for internal corporate chat and system notifications, as well as a dedicated manager for defining and modifying nested organizational department structures. Additional capabilities co

    Handles binary file uploads and downloads by interfacing with a remote storage server for scalability.

    Java
    Auf GitHub ansehen↗28,090
  • livewire/livewireAvatar von livewire

    livewire/livewire

    23,448Auf GitHub ansehen↗

    Livewire is a full-stack framework for PHP that enables the development of reactive, dynamic user interfaces using server-side classes and templates. By bridging the gap between server-side logic and client-side DOM updates, it allows developers to build interactive web applications without writing custom JavaScript. The framework operates as a component-based library, where modular units encapsulate interface logic, state, and event handling directly on the server. The framework distinguishes itself through a reactive architecture that automatically synchronizes state between the browser and

    Configures temporary file upload storage locations to optimize server resource usage.

    PHP
    Auf GitHub ansehen↗23,448
  • timescale/timescaledbAvatar von timescale

    timescale/timescaledb

    21,876Auf GitHub ansehen↗

    TimescaleDB is an open-source PostgreSQL extension that adds native time-series capabilities to the database. At its core, it transforms standard PostgreSQL tables into hypertables—automatically partitioned by time intervals—so data is stored in fixed-size chunks without manual sharding. The extension includes a library of over 200 built-in SQL functions purpose-built for time-series workloads, such as time bucketing, gap filling, percentile estimation, and time-weighted averages. What distinguishes TimescaleDB from generic PostgreSQL is its set of integrated time-series features that work th

    Provides functions for manually creating, dropping, merging, splitting, and moving individual data chunks.

    Canalyticsdatabasefinancial-analysis
    Auf GitHub ansehen↗21,876
  • prefecthq/prefectAvatar von PrefectHQ

    PrefectHQ/prefect

    21,640Auf GitHub ansehen↗

    Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which sep

    Downloads files from specified containers and folders in cloud storage to local environments for workflow execution.

    Pythonautomationdatadata-engineering
    Auf GitHub ansehen↗21,640
  • gofr-dev/gofrAvatar von gofr-dev

    gofr-dev/gofr

    21,321Auf GitHub ansehen↗

    Gofr is a comprehensive framework for building production-ready microservices in Go. It provides a unified toolkit for developing RESTful APIs and gRPC services, offering built-in support for observability, database management, and distributed system communication. The framework distinguishes itself through its focus on developer productivity and system resilience. It automates common backend tasks such as CRUD handler generation, schema-driven code creation, and database migration orchestration, while preventing race conditions in clustered environments. To maintain stability, it includes in

    Provides unified interfaces for connecting to local and cloud-based file storage backends.

    Goframeworkgogo-framework
    Auf GitHub ansehen↗21,321
  • wekan/wekanAvatar von wekan

    wekan/wekan

    20,971Auf GitHub ansehen↗

    Wekan ist ein Open-Source, selbst gehostetes Kanban-Projektmanagement-Tool, das zur Organisation von Arbeitsabläufen mittels Boards, Listen und Karten verwendet wird. Es ist eine Echtzeit-Webanwendung, die es Teams ermöglicht, Aufgaben auf privater Infrastruktur zu verwalten. Die Plattform zeichnet sich durch umfangreiche Datenmigrationswerkzeuge aus, insbesondere für den Import von Boards und Karten aus Trello. Sie unterstützt Identitätsintegration auf Unternehmensebene via LDAP, OpenID Connect und OAuth2 und bietet flexible Speicheroptionen, einschließlich PostgreSQL als primäres relationales Backend und anschließbarem Cloud-Speicher für Anhänge. Das System deckt eine breite Palette von Aufgabenmanagement-Funktionen ab, einschließlich Gantt-Diagramm-Visualisierungen, Zeiterfassung und aufgabenübergreifender Aggregation. Es enthält administrative Werkzeuge für rollenbasierte Zugriffskontrolle, automatisierte Backup-Planung und programmatische Erweiterbarkeit über eine REST-API und ereignisgesteuerte Webhooks. Die Anwendung ist für die Bereitstellung via Docker verfügbar und unterstützt Multi-Tenant-Konfigurationen.

    Uses chunked storage to manage large binary attachments within a distributed database.

    JavaScript
    Auf GitHub ansehen↗20,971
  • openlistteam/openlistAvatar von OpenListTeam

    OpenListTeam/OpenList

    20,814Auf GitHub ansehen↗

    OpenList is a cloud storage indexing platform that transforms remote file collections into searchable lists and standardized streaming media endpoints. It functions as a centralized gateway, allowing users to connect external storage providers and manage their data through a unified interface. The platform distinguishes itself by providing a dedicated security layer for API authentication and traffic proxying, which protects user credentials while managing connectivity for distributed components. It also features automated service lifecycle management, enabling the deployment and maintenance

    Provides interfaces for managing file storage operations programmatically to support custom workflows.

    Goalistaliyunpanbaidupan
    Auf GitHub ansehen↗20,814
  • wagtail/wagtailAvatar von wagtail

    wagtail/wagtail

    20,366Auf GitHub ansehen↗

    Wagtail is an open-source content management system built on the Django web framework. It provides a structured, tree-based approach to content modeling, allowing developers to define custom page types and reusable content components that are managed through a highly customizable administrative interface. The platform distinguishes itself through its flexible, block-based content composition system, which enables editors to assemble complex page layouts dynamically. It also offers robust support for multi-site and multi-lingual environments, allowing organizations to manage distinct websites

    Allows overriding default file path generation logic to control where uploaded media is saved.

    Pythoncmsdjangohacktoberfest
    Auf GitHub ansehen↗20,366
  • nats-io/nats-serverAvatar von nats-io

    nats-io/nats-server

    20,076Auf GitHub ansehen↗

    NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t

    Enables reliable storage and retrieval of arbitrary-sized files by chunking data into buckets.

    Gocloudcloud-computingcloud-native
    Auf GitHub ansehen↗20,076
  • xi-editor/xi-editorAvatar von xi-editor

    xi-editor/xi-editor

    19,816Auf GitHub ansehen↗

    xi-editor is a high-performance text editor core written in Rust. It employs a client-server architecture that separates the backend editor logic from the user interface, allowing diverse frontends to communicate with the core via a standardized protocol. The project is distinguished by its use of rope-based text buffers for efficient manipulation of large documents and a collaborative engine powered by conflict-free replicated data types to synchronize concurrent edits. It further features an extensible plugin system that integrates external binaries and third-party tools through JSON-based

    Chunks large datasets into linked lists or ordered keys to keep commit sizes proportional to change size.

    Rust
    Auf GitHub ansehen↗19,816
  • snapdrop/snapdropAvatar von SnapDrop

    SnapDrop/snapdrop

    19,715Auf GitHub ansehen↗

    Snapdrop is a browser-based peer-to-peer file sharing tool that transfers files directly between devices on the same local network without uploading to any intermediate server. It operates as a progressive web app, meaning it works across devices without installation, and uses end-to-end encryption to ensure only the sender and receiver can read the content being transferred. The application establishes direct browser-to-browser connections using WebRTC, splitting large files into chunks for real-time streaming with progress tracking. It discovers nearby devices on the same subnet through loc

    Splits large files into smaller chunks for real-time streaming over WebRTC data channels with progress tracking.

    JavaScriptpwasnapdropwebrtc
    Auf GitHub ansehen↗19,715
  • shuzheng/zhengAvatar von shuzheng

    shuzheng/zheng

    16,672Auf GitHub ansehen↗

    Zheng is a Spring Boot microservices framework and enterprise J2EE development platform. It functions as a distributed service gateway and identity provider, providing a foundation for building complex business applications and microservices infrastructure. The project includes a comprehensive enterprise content management system and an OAuth2 identity provider for managing single sign-on and third-party social login integrations. It also features a MyBatis ORM code generator that automatically creates database models and boilerplate functions from existing tables. The platform covers a broa

    Abstracts file upload and storage operations to support both local and cloud providers.

    Javaactivemqaliossdruid
    Auf GitHub ansehen↗16,672
  • nodebb/nodebbAvatar von NodeBB

    NodeBB/NodeBB

    15,144Auf GitHub ansehen↗

    NodeBB is a real-time, self-hosted community forum platform built on Node.js. It is designed to support scalable discussion environments by utilizing a document-oriented database for content storage and an in-memory engine for high-speed data retrieval and session management. The platform provides a comprehensive administrative interface for managing user groups, forum settings, and system health. What distinguishes the platform is its native support for federated social networking via the ActivityPub protocol, allowing forums to exchange content, synchronize discussions, and interact with de

    Redirects user-uploaded media to external cloud storage providers to optimize local disk usage.

    JavaScriptcommunityforumjavascript
    Auf GitHub ansehen↗15,144
  • chocobozzz/peertubeAvatar von Chocobozzz

    Chocobozzz/PeerTube

    14,520Auf GitHub ansehen↗

    PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer

    Offloads transcoded video files to remote object storage to reduce local disk consumption while maintaining public access.

    TypeScriptactivitypubangulardecentralized
    Auf GitHub ansehen↗14,520
  • dmlc/dglAvatar von dmlc

    dmlc/dgl

    14,283Auf GitHub ansehen↗

    DGL is a Python library for building and training graph neural networks. It functions as a graph message passing framework and a geometric deep learning tool, enabling the development of models that analyze graph-structured data. The library is designed for large-scale graph processing, utilizing distributed training and neighbor sampling to handle datasets with billions of edges. It provides specialized support for heterogeneous graph modeling, allowing for the representation of complex real-world entities with multiple node and edge types. Its capabilities cover a wide range of graph tasks

    Persists large graph structures in a chunked binary format to allow efficient loading and partial access.

    Pythondeep-learninggraph-neural-networks
    Auf GitHub ansehen↗14,283
  • dask/daskAvatar von dask

    dask/dask

    13,746Auf GitHub ansehen↗

    Dask ist ein Framework für paralleles Rechnen und ein verteilter Task-Scheduler, der darauf ausgelegt ist, Python-Data-Science-Workflows von einzelnen Maschinen auf große Cluster zu skalieren. Es fungiert als Cluster-Ressourcenmanager, der die Berechnungslogik orchestriert, indem Aufgaben und deren Abhängigkeiten als gerichtete azyklische Graphen dargestellt werden. Diese Architektur ermöglicht es dem System, die Verteilung von Workloads auf verfügbare Hardware zu automatisieren und gleichzeitig komplexe Ausführungsanforderungen zu verwalten. Das Projekt zeichnet sich durch eine Lazy-Evaluation-Engine aus, die Datenoperationen verzögert, bis sie explizit angefordert werden, was eine globale Graphoptimierung und effiziente Ressourcenzuweisung ermöglicht. Es integriert speicherbewusstes Data-Spilling, um Systemabstürze bei der Verarbeitung von Datensätzen zu verhindern, die den verfügbaren Speicher überschreiten, und nutzt Task-Graph-Fusion, um Sequenzen von Operationen in einzelne Ausführungsschritte zu kombinieren, wodurch Scheduling-Overhead und Inter-Node-Kommunikation minimiert werden. Die Plattform bietet eine umfassende Oberfläche für die Datenanalyse im großen Maßstab, einschließlich Unterstützung für verteiltes maschinelles Lernen, Integration in das Hochleistungsrechnen und parallele Datenverarbeitung. Sie bietet umfangreiche Werkzeuge für das Cluster-Lebenszyklusmanagement, Performance-Profiling und die Echtzeitüberwachung der Aufgabenausführung. Benutzer können diese Umgebungen über verschiedene Infrastrukturen hinweg bereitstellen, einschließlich lokaler Hardware, Cloud-Anbietern, containerisierten Systemen und Hochleistungsrechner-Clustern.

    Enables integration with proprietary storage services by registering custom file system implementations.

    Pythondasknumpypandas
    Auf GitHub ansehen↗13,746
  • wasp-lang/open-saasAvatar von wasp-lang

    wasp-lang/open-saas

    13,405Auf GitHub ansehen↗

    Open SaaS is a full-stack starter kit and development framework designed for building and deploying commercial web applications. It provides a production-ready foundation that integrates essential services, including user authentication, payment processing, file storage, and administrative oversight, into a single cohesive environment. The framework utilizes a declarative configuration approach to define application structure, which automatically generates the necessary boilerplate for both frontend and backend components. By employing database-first schema modeling, it ensures type-safe comm

    Offers unified interfaces for managing file uploads and retrieval across cloud storage backends.

    TypeScriptaiauthenticationaws-s3
    Auf GitHub ansehen↗13,405
Vorherige1234…5Nächste
  1. Home
  2. Data & Databases
  3. Storage Abstraction
  4. File Storage Services

Unter-Tags erkunden

  • Azure Storage Operations2 Sub-TagsInteracting with Azure storage services for tables, blobs, files, and queues in Python applications. **Distinct from File Storage Services:** Distinct from File Storage Services: focuses on Azure-specific storage APIs (tables, blobs, files, queues), not generic file storage interfaces.
  • Binary Data Streaming1 Sub-TagSpecialized mechanisms for streaming binary content that exceeds standard document size limits. **Distinct from Chunked File Storages:** Distinct from Chunked File Storages: focuses on the streaming of oversized blobs within a document database context.
  • Chunked File Storages10 Sub-TagsSystems for managing large files by chunking data into buckets for reliable storage. **Distinct from File Storage Services:** Distinct from File Storage Services: focuses on the chunking mechanism for arbitrary-sized files within a messaging context.
  • Configurable Storage Backends6 Sub-TagsSwitches between local disk, S3, or SFTP backends for storing static and media files. **Distinct from File Storage Services:** Distinct from File Storage Services: focuses on the ability to switch between multiple backends rather than providing a single storage interface.
  • File Storage MigrationsTransitioning from built-in file storage to a dedicated object storage service while maintaining access to existing files. **Distinct from File Storage Services:** Distinct from File Storage Services: focuses on the migration process between storage backends, not the storage service itself.
  • Multi-Entry File BundlingStorage formats that group multiple distinct data entries into a single physical file. **Distinct from File Storage Services:** Focuses on a descriptor syntax for grouping entries within one file, distinct from general storage services.
  • Network File Sharing ServicesConfigures and runs file sharing protocols such as SMB/CIFS, FTP, and rsync to make storage accessible over a network. **Distinct from File Storage Services:** Distinct from File Storage Services: focuses on running network file sharing protocols, not general file storage interfaces.
  • Storage Protocol ExtensionsRegistration of custom file system implementations for proprietary storage services. **Distinct from File Storage Services:** Distinct from general file storage services: focuses on the extensibility of the protocol layer.
  • Storage PrototypesSimplified functional representations of storage services for exploring architectural concepts. **Distinct from File Storage Services:** Distinct from File Storage Services: focuses on educational prototypes and architectural exploration rather than production-ready storage interfaces.