# Cloud Storage > Search results for `cloud storage` on awesome-repositories.com. 114 total matches; showing the first 50. Explore on the web: https://awesome-repositories.com/q/cloud-storage **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [this search on awesome-repositories.com](https://awesome-repositories.com/q/cloud-storage).** ## Results - [heyputer/puter](https://awesome-repositories.com/repository/heyputer-puter.md) (42,318 ⭐) — Puter is a browser-based desktop environment and cloud-native development platform that provides a virtualized graphical workspace. It enables developers to build and deploy full-stack web applications by integrating cloud storage, authentication, and serverless backend logic directly into the browser, eliminating the need for traditional server infrastructure. The platform distinguishes itself through a unified cloud storage layer and a distributed network runtime that facilitates peer-to-peer communication and cross-origin resource fetching. It features a sophisticated cross-window orchestration framework that coordinates state, user actions, and lifecycle events between isolated browser windows, allowing for complex, multi-component application workflows. Beyond its core desktop and storage capabilities, the system includes a comprehensive suite of artificial intelligence tools, including conversational response generation, image and video creation, and speech synthesis. It also provides a serverless backend platform that executes event-driven functions and manages persistent key-value storage, all accessible through a consistent programmatic interface. The project offers extensive documentation and examples covering AI integration, authentication, and object management to assist developers in building scalable applications. - [cvat-ai/cvat](https://awesome-repositories.com/repository/cvat-ai-cvat.md) (15,317 ⭐) — CVAT is an open-source, web-based platform designed for annotating images, videos, and 3D point clouds to create high-quality training datasets for machine learning. It functions as a containerized server that orchestrates the entire lifecycle of computer vision data, from initial task creation and manual labeling to quality assurance and final dataset export. The platform distinguishes itself through deep integration with machine learning models, allowing users to deploy custom AI models as serverless functions for automated object detection, tracking, and skeleton annotation. It supports complex collaborative workflows by providing role-based access control, organizational workspace management, and consensus-based quality assurance tools that allow teams to merge diverse labeling opinions and resolve annotation conflicts. Beyond manual and automated labeling, the system provides a comprehensive suite of administrative and integration capabilities. It includes support for cloud-native storage mounting, programmatic interaction via a RESTful API, and automated event notifications. The platform is built for scalability, utilizing a microservices architecture that can be deployed across containerized environments or Kubernetes clusters to handle large-scale data processing and distributed annotation tasks. - [humansignal/label-studio](https://awesome-repositories.com/repository/humansignal-label-studio.md) (27,619 ⭐) — Label Studio is a multi-modal data annotation platform designed to create and manage high-quality training datasets for machine learning. It functions as a self-hosted, containerized environment that supports secure, private deployments, including air-gapped configurations. The platform provides a centralized workspace for labeling diverse media types, such as images, text, audio, and time-series data, to support supervised and reinforcement learning workflows. The platform distinguishes itself through deep integration with machine learning backends, enabling active learning loops, automated pre-labeling, and real-time model-assisted annotation. It features a declarative interface configuration system that uses markup to define custom labeling tools, alongside plugin-based extensibility that allows for the injection of custom logic. To support enterprise-scale operations, it includes granular role-based access control, collaborative feedback tools, and automated task distribution management. The system covers a broad capability surface, including automated data ingestion from cloud storage, programmatic pipeline management via REST APIs, and comprehensive data export options. It also provides built-in observability tools to monitor annotator performance, inter-annotator agreement, and model quality. The application is packaged as a portable, container-ready microservice designed for deployment in scalable, cloud-native environments. - [dask/dask](https://awesome-repositories.com/repository/dask-dask.md) (13,746 ⭐) — Dask is a parallel computing framework and distributed task scheduler designed to scale Python data science workflows from single machines to large clusters. It functions as a cluster resource manager that orchestrates computational logic by representing tasks and their dependencies as directed acyclic graphs. This architecture allows the system to automate the distribution of workloads across available hardware while managing complex execution requirements. The project distinguishes itself through a lazy evaluation engine that defers data operations until they are explicitly requested, enabling global graph optimization and efficient resource allocation. It incorporates memory-aware data spilling to prevent system crashes when processing datasets that exceed available memory, and it utilizes task graph fusion to combine sequences of operations into single execution steps, minimizing scheduling overhead and inter-node communication. The platform provides a comprehensive capability surface for large-scale data analytics, including support for distributed machine learning, high-performance computing integration, and parallel data processing. It offers extensive tools for cluster lifecycle management, performance profiling, and real-time monitoring of task execution. Users can deploy these environments across diverse infrastructure, including local hardware, cloud providers, containerized systems, and high-performance computing clusters. - [automaapp/automa](https://awesome-repositories.com/repository/automaapp-automa.md) (21,414 ⭐) — Automa is a browser-based automation platform that enables users to build, schedule, and execute repetitive web tasks through a visual, no-code interface. By operating as a browser extension, it provides a canvas-based environment where users construct workflows by connecting functional blocks to interact with web elements, manage browser state, and process data. The platform distinguishes itself through its deep integration with the browser environment, allowing for complex orchestration such as event-driven triggers, cross-origin request handling, and the ability to package workflows as standalone extensions. It supports sophisticated logic including conditional branching, loop execution, and persistent state management, which allows for the creation of dynamic automation sequences that can handle data extraction, form filling, and multi-step navigation across different websites. Beyond basic interaction, the system covers a broad range of capabilities including cloud-based spreadsheet synchronization, secure credential management, and proxy configuration for network traffic control. It also facilitates collaboration through a centralized marketplace where users can share, discover, and import pre-built automation templates. The project is distributed as a browser extension, providing a self-contained environment for designing and running automation tasks directly within the browser. - [cube-js/cube](https://awesome-repositories.com/repository/cube-js-cube.md) (19,521 ⭐) — Cube is a semantic data layer that provides a unified framework for defining business metrics, dimensions, and relationships across diverse data sources. By acting as a headless business intelligence engine, it transforms raw data into a governed model that can be queried via SQL, REST, and GraphQL interfaces. This architecture ensures consistent data definitions and logic across all downstream analytical applications and reporting tools. The platform distinguishes itself through its integrated conversational AI capabilities, which allow users to explore data using natural language. It orchestrates these interactions by mapping questions to the underlying semantic model, ensuring that AI-generated insights remain accurate and context-aware. Furthermore, Cube is designed for multi-tenant environments, offering robust infrastructure isolation, row-level security, and dynamic context injection to ensure that data access is strictly governed and personalized for every user or tenant. Beyond its core modeling and AI features, the platform includes a comprehensive suite of tools for performance optimization, including automated pre-aggregation caching and asynchronous query queuing. It supports a wide range of data sources and deployment models, from self-hosted containers to managed cloud environments. The system also provides extensive programmatic control over report management, dashboard publishing, and user identity synchronization, making it suitable for embedding interactive analytics directly into custom software applications. - [oven-sh/bun](https://awesome-repositories.com/repository/oven-sh-bun.md) (93,257 ⭐) — Bun is a high-performance runtime environment designed to execute JavaScript and TypeScript applications with minimal latency and high throughput. Built on a native core implemented in Zig, it provides a unified execution engine that leverages JavaScriptCore for efficient memory management and low-latency startup. The project functions as an all-in-one toolchain, integrating a native bundler, transpiler, package manager, and test runner into a single command-line interface. What distinguishes Bun is its focus on native system integration and developer productivity. It features a high-performance server runtime with built-in support for HTTP, WebSockets, and SQLite database management, allowing for the creation of scalable network applications without external dependencies. The platform includes a sophisticated build pipeline that supports incremental bundling, build-time macro execution, and the generation of standalone, cross-platform binaries. It also provides a low-level foreign function interface, enabling direct execution of native C and C++ libraries to bypass traditional runtime bottlenecks. The project covers a broad capability surface, including automated task scheduling, file-system-based routing, and comprehensive dependency management. It offers built-in utilities for cryptographic hashing, secure password verification, and real-time hot module replacement during development. Additionally, the runtime maintains compatibility with existing ecosystems by implementing standard APIs and module resolution patterns, facilitating seamless integration into existing workflows. Bun is distributed as a command-line tool that manages the entire application lifecycle, from dependency installation and auditing to production asset building and binary distribution. - [managedcode/storage](https://awesome-repositories.com/repository/managedcode-storage.md) (134 ⭐) — Storage library provides a universal interface for accessing and manipulating data in different cloud blob storage providers - [cockroachdb/cockroach](https://awesome-repositories.com/repository/cockroachdb-cockroach.md) (32,207 ⭐) — Cockroach is a distributed SQL database designed to scale horizontally across multiple nodes while maintaining strict ACID compliance and global data consistency. It functions as a relational database engine that automatically partitions data into ranges, rebalancing them across a cluster to accommodate growing storage and throughput requirements. By utilizing a distributed consensus protocol, the system ensures that all nodes agree on the order of operations, providing fault tolerance and continuous availability even in the event of hardware failures. The system distinguishes itself through a layered architecture that separates the relational SQL abstraction from a distributed key-value store. It achieves global consistency without requiring perfectly synchronized hardware clocks by employing a hybrid logical clock synchronization mechanism. To support high-concurrency environments, it utilizes multi-version concurrency control and lock-free transaction execution, which allow for consistent snapshots and efficient conflict resolution. Furthermore, the engine is built for compatibility, implementing the standard wire protocol to support existing relational database drivers and tools. Beyond its core transactional capabilities, the platform includes comprehensive tooling for cluster orchestration, security, and performance diagnostics. It supports a variety of deployment models, ranging from self-hosted on-premises configurations to fully managed cloud services. The system provides a command-line interface for session management and query execution, ensuring that administrators can monitor cluster health and manage workloads through standard relational interfaces. - [supabase/supabase](https://awesome-repositories.com/repository/supabase-supabase.md) (104,317 ⭐) — This project provides an integrated backend platform built around a relational database. It automatically generates REST and GraphQL APIs from database schemas, allowing for direct data interaction through standard requests and client libraries. The platform includes a comprehensive authentication system that manages user identity, session handling, and fine-grained access control through database-native row-level security policies. Beyond core data management, the platform offers specialized services for object storage, vector data processing for semantic search, and real-time communication features like broadcast messaging and database change subscriptions. It also supports server-side logic execution through globally distributed edge functions, database-resident functions, and a native job scheduler for automated tasks. Developers can manage the entire project lifecycle using a command-line interface and containerized local development environments. The platform supports both managed cloud services and self-hosted deployments, providing options for infrastructure control and data sovereignty. - [jschneier/django-storages](https://awesome-repositories.com/repository/jschneier-django-storages.md) (2,950 ⭐) — https://django-storages.readthedocs.io/ - [zendesk/cross-storage](https://awesome-repositories.com/repository/zendesk-cross-storage.md) (2,216 ⭐) — Cross domain local storage, with permissions - [dokploy/dokploy](https://awesome-repositories.com/repository/dokploy-dokploy.md) (34,901 ⭐) — Dokploy is a self-hosted platform-as-a-service designed to simplify the deployment and management of containerized applications and databases. It provides a centralized control plane that decouples administrative management from application workloads, allowing users to oversee infrastructure across multiple server nodes through a unified web interface or a command-line tool. The platform distinguishes itself through an extensive library of pre-configured application templates, enabling the rapid deployment of databases, identity providers, and various productivity or development tools. It supports complex orchestration by allowing users to define multi-container services using standard configuration files, which can be managed through automated build pipelines, Git integration, and real-time performance monitoring. Beyond core deployment, the system includes robust infrastructure management capabilities such as automated backups to external object storage, horizontal and vertical scaling, and granular access control. It also provides secure configuration management, including environment variable synchronization, HTTPS certificate handling, and zero-downtime deployment strategies to ensure application stability and security. The platform is designed for ease of use, offering an interactive API documentation interface and instructional resources to guide users through installation and configuration. It supports a wide range of modern web frameworks and runtimes, providing a flexible environment for hosting and maintaining services on private server hardware. - [macrozheng/mall](https://awesome-repositories.com/repository/macrozheng-mall.md) (83,878 ⭐) — This project is an enterprise-grade Java framework designed for building scalable, full-stack e-commerce applications. It provides a comprehensive foundation for microservice-based distributed architectures, enabling the development of complex retail platforms that include product management, order processing, and secure user authentication. By leveraging modular service patterns and centralized API gateways, the framework supports the construction of resilient systems that decompose monolithic business logic into independent, manageable services. The platform distinguishes itself through a robust suite of infrastructure and operational tools that facilitate high-scale deployments. It features integrated support for container-orchestrated environments, event-driven message brokering, and centralized security via token-based authentication. To ensure operational visibility, the framework includes a centralized log aggregation pipeline, real-time health monitoring, and distributed system observability, allowing teams to maintain stability across complex service boundaries. Beyond its core architecture, the platform offers extensive developer tooling and data management capabilities. It supports advanced database operations, including read-write splitting, query routing, and data synchronization, alongside integration with distributed search engines and object storage systems. The development environment is further enhanced by utilities for code quality enforcement, automated entity generation, dependency management, and architectural visualization, providing a complete ecosystem for the lifecycle of enterprise-grade web applications. - [cloud-custodian/cloud-custodian](https://awesome-repositories.com/repository/cloud-custodian-cloud-custodian.md) (6,011 ⭐) — Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources - [dragondrop-cloud/cloud-concierge](https://awesome-repositories.com/repository/dragondrop-cloud-cloud-concierge.md) (245 ⭐) — "Terraform best practices as a Pull Request." Codify resources outside of Terraform control, detect drift, estimate cloud costs, identify security risks, and more. - [prefecthq/prefect](https://awesome-repositories.com/repository/prefecthq-prefect.md) (21,640 ⭐) — Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as Python code. It functions as a container-native engine that wraps individual tasks in isolated environments, ensuring consistent dependencies and resource allocation across diverse infrastructure. By utilizing a state-machine-based orchestration model, the system tracks execution progress through discrete transitions and persistent event logs to maintain reliable and observable task processing. The platform distinguishes itself through a decoupled worker-API architecture, which separates task scheduling from execution by allowing remote workers to poll a central API for pending work units. This design enables distributed task concurrency, allowing parallel workloads to scale horizontally across clusters or remote nodes. Furthermore, the system supports event-driven workflow triggering, enabling pipelines to initiate or resume automatically in response to system state changes or external signals. The project provides a comprehensive capability surface for managing the entire lifecycle of data operations. This includes modular block-based configuration for injecting credentials and infrastructure settings, result persistence caching for optimizing redundant computations, and extensive integration support for cloud services, databases, and version control systems. Users can also leverage built-in tools for infrastructure automation, data lineage tracking, and automated notification management. The software is distributed as a Python-based framework, with documentation and installation guides available to assist in configuring self-hosted deployments or connecting to managed orchestration services. - [zw008/vmware-storage](https://awesome-repositories.com/repository/zw008-vmware-storage.md) (0 ⭐) — VMware vSphere storage management: datastores, iSCSI, vSAN. Domain-focused MCP skill with 11 tools. - [appwrite/appwrite](https://awesome-repositories.com/repository/appwrite-appwrite.md) (56,318 ⭐) — Appwrite is a backend-as-a-service platform that provides a unified development environment for building full-stack applications. It integrates essential infrastructure components—including authentication, databases, storage, and serverless functions—into a single, centralized interface to simplify application development and resource management. The platform distinguishes itself through a container-based microservices architecture that ensures consistent execution across diverse infrastructure. It features a versatile connectivity layer that links frontend applications with third-party services, databases, and external APIs through standardized interfaces. Developers can manage and automate the configuration of these backend resources using infrastructure-as-code tools, while granular role-based access control enforces security policies across all platform resources and API endpoints. Beyond its core services, the platform offers a broad capability surface that includes cross-platform data synchronization, event-driven webhooks, and comprehensive billing and usage monitoring. It supports extensive integrations for AI utilities, payment processing, messaging, and logging, allowing developers to extend application functionality through modular, event-driven workflows. The platform is designed for both managed and self-hosted deployments, providing tools for production environment optimization, data migration, and custom domain configuration. - [camel-ai/camel](https://awesome-repositories.com/repository/camel-ai-camel.md) (16,055 ⭐) — This project is a comprehensive framework for building and managing autonomous agent systems. It provides a unified architecture for orchestrating multi-agent societies, where specialized agents collaborate through roleplay to decompose and solve complex tasks. The system integrates language models with external environments, enabling agents to perform real-world actions through a standardized tool-calling abstraction layer. The framework distinguishes itself through its focus on iterative reasoning and data reliability. It employs automated feedback loops to refine agent outputs and self-evaluate reasoning traces, ensuring high-quality results. To maintain operational integrity, the system enforces schema-based output parsing for reliable workflow integration and utilizes sandboxed environments for secure, isolated code execution. Beyond its core orchestration capabilities, the project includes a suite of utilities for retrieval-augmented generation and synthetic data production. It supports persistent memory management via vector-based context retrieval and provides extensive tooling for web automation, API integration, and human-in-the-loop oversight. The platform is designed to be model-agnostic, offering a consistent interface for interacting with a wide range of proprietary and open-source language models. - [telegramdesktop/tdesktop](https://awesome-repositories.com/repository/telegramdesktop-tdesktop.md) (32,099 ⭐) — This project is a cross-platform messaging client that implements a secure, real-time communication protocol. It provides a comprehensive development toolkit, including a database library and messaging SDK, which allows for the creation of custom messaging applications that maintain synchronized state across multiple devices. The core architecture relies on an asynchronous event-driven model to ensure responsive performance while managing persistent local database synchronization with server-side state. The client distinguishes itself through a robust end-to-end encryption layer that supports forward secrecy for private messages, voice calls, and video calls. It features an integrated framework for building and managing interactive bots and embedded web applications, which run directly within the native interface. This ecosystem is supported by a formal, versioned schema-driven protocol that enables automated type-safe code generation for network communication. Beyond core messaging, the platform includes extensive capabilities for group administration, business automation, and content monetization. It supports a wide range of interactive features such as message threading, reactions, scheduled delivery, and rich media handling, alongside tools for geolocation sharing and community discovery. The interface is highly customizable, allowing for personalized themes, chat organization, and expressive visual elements like animated stickers and emojis. The repository provides the foundational runtime and source code necessary to build and deploy these messaging clients across various operating systems. - [cyclejs/storage](https://awesome-repositories.com/repository/cyclejs-storage.md) (0 ⭐) - [huggingface/smolagents](https://awesome-repositories.com/repository/huggingface-smolagents.md) (27,885 ⭐) — This framework provides a development toolkit for building autonomous agents that utilize language models to solve complex, non-deterministic tasks. Its core design centers on a code-executing architecture where agents generate and run Python code snippets to perform logic, data manipulation, and tool interactions. By moving beyond structured data formats, the system enables agents to manage program flow and object state through iterative reasoning cycles. The project distinguishes itself through its focus on code-based agent implementation and secure execution environments. Developers can choose between code-generating agents for complex logic or structured tool-calling agents for reliable, schema-validated interactions. To ensure safety when running model-generated scripts, the framework supports isolated runtime environments, including containers and remote virtual machines, which prevent unauthorized system access while maintaining state across task cycles. The platform offers a comprehensive suite of capabilities for managing agentic workflows, including multi-agent orchestration, stateful memory management, and interactive planning. It provides a unified interface for integrating diverse language model providers and simplifies tool creation by automatically converting Python functions into executable tools via metadata and type hints. Users can monitor the decision-making process through an interactive interface that visualizes reasoning steps and supports manual intervention during task execution. - [gofiber/storage](https://awesome-repositories.com/repository/gofiber-storage.md) (0 ⭐) - [alistgo/alist](https://awesome-repositories.com/repository/alistgo-alist.md) (49,653 ⭐) — Alist is a unified cloud storage gateway that aggregates disparate remote storage providers into a single, navigable virtual file system. By acting as a remote file system proxy, it decouples file operations from specific provider implementations, allowing users to browse, download, and manage files across heterogeneous backends through a standardized interface. The platform utilizes a driver-based storage abstraction that translates generic file system operations into provider-specific API calls. This architecture supports a wide range of cloud storage services, S3-compatible object storage, and software release assets, presenting them as a cohesive directory structure. To ensure data privacy, the system includes an encrypted data vault that provides transparent, password-based obfuscation for file and directory names across remote platforms. The system operates as a stateless gateway, dynamically fetching metadata without maintaining persistent local copies of the underlying content. It employs a modular middleware layer to handle on-the-fly data transformations, such as the encryption and decryption of file metadata, while maintaining a consistent interaction model across all connected storage backends. - [unstructured-io/unstructured](https://awesome-repositories.com/repository/unstructured-io-unstructured.md) (14,019 ⭐) — Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture that supports directed acyclic graph orchestration, allowing users to chain complex transformation pipelines while maintaining metadata, spatial context, and hierarchical relationships across extracted elements. The system covers a broad capability surface, including extensive connectivity to cloud storage, databases, and collaboration platforms, alongside robust data export options for vector databases and search indices. It enforces enterprise security standards through isolated multi-tenant infrastructure, role-based access control, and private network connectivity, ensuring that sensitive data remains secure throughout the entire transformation lifecycle. Operational visibility is maintained through integrated job monitoring, event-driven notification systems, and audit logging. The platform is designed for deployment within private cloud environments, supporting scalable, asynchronous processing of high-volume document batches. - [huggingface/pytorch-image-models](https://awesome-repositories.com/repository/huggingface-pytorch-image-models.md) (36,893 ⭐) — This project is a comprehensive library of state-of-the-art neural network architectures designed for image classification and feature extraction. It provides a complete deep learning training framework that supports distributed execution, allowing users to build, train, and fine-tune vision models using optimized schedulers and pre-configured training recipes. The library distinguishes itself through a modular backbone architecture that treats neural networks as decoupled feature extractors, enabling the retrieval of multi-scale outputs for downstream tasks like object detection and segmentation. A centralized registry-based model factory allows for the dynamic instantiation of architectures via string identifiers, while externalized hyperparameter files ensure that training workflows remain reproducible. Users can also exercise granular control over the training process through layer-wise optimization configurations and a flexible hook system for intercepting intermediate tensor states. The platform includes extensive utilities for managing the entire lifecycle of a vision model, from data loading and augmentation to inference and deployment. It features a dynamic transformation pipeline that automatically resolves preprocessing requirements based on the chosen model architecture, ensuring that input data is correctly aligned for both training and evaluation. Integration with remote model hubs further facilitates the sharing and retrieval of pre-trained weights and configurations. - [canonical/cloud-init](https://awesome-repositories.com/repository/canonical-cloud-init.md) (3,729 ⭐) — Official upstream for the cloud-init: cloud instance initialization - [huggingface/transformers.js](https://awesome-repositories.com/repository/huggingface-transformers-js.md) (15,420 ⭐) — This library is a web-native engine designed to execute pretrained machine learning models directly within the browser. It functions as a client-side inference framework, enabling developers to run complex neural networks for natural language processing, computer vision, and audio tasks without requiring a backend server or external API calls. The framework distinguishes itself by providing a unified pipeline-based abstraction that handles the entire lifecycle of model execution. It manages the dynamic retrieval of model weights and configurations from remote registries, while simultaneously supporting local storage caching to facilitate offline functionality and reduce latency. By leveraging hardware acceleration, the library performs tensor-based computations and data transformations locally on the user's device. The toolkit encompasses a broad range of capabilities, including multimodal data processing, automated input preparation, and output decoding. It provides utilities for tokenization and chat conversation formatting, ensuring that raw data is correctly structured for specific model architectures. Additionally, the library includes security mechanisms for authenticating requests to gated model repositories and performance tools for monitoring resource usage and optimizing execution efficiency. - [talut/rn-secure-storage](https://awesome-repositories.com/repository/talut-rn-secure-storage.md) (210 ⭐) — Secure Storage for React Native (Android & iOS) - [juicedata/juicefs](https://awesome-repositories.com/repository/juicedata-juicefs.md) (13,233 ⭐) — JuiceFS is a distributed file system designed to mount object storage as a local, POSIX-compliant drive. It functions as a cloud-native persistent storage layer that decouples file metadata from raw data, storing metadata in a transactional database while keeping data blocks in object storage. This architecture enables multiple hosts across different regions to access the same storage simultaneously while maintaining strong consistency. The system distinguishes itself by performing data processing, including compression and encryption, directly on the client side before transmission. By splitting files into fixed-size chunks, it optimizes storage management and enables parallel data access. It provides standardized interfaces for big data frameworks and container orchestrators, allowing existing applications to interact with object storage through familiar file system protocols without requiring custom storage drivers. Beyond its core mounting capabilities, the project supports concurrent file access management through distributed metadata locking to prevent data corruption. It serves as a bridge for big data engines and containerized environments, ensuring that data remains secure and consistent across distributed clusters. - [clickhouse/clickhouse](https://awesome-repositories.com/repository/clickhouse-clickhouse.md) (48,042 ⭐) — ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through advanced storage and execution techniques, including vectorized query processing and a merge tree storage engine that maintains performance during massive insertions. It features adaptive subcolumn mapping for semi-structured data and supports native vector search for machine learning and generative AI applications. To facilitate efficient data movement, the engine utilizes zero-copy shared memory buffers, minimizing overhead when interacting with external analytical tools or processing diverse file formats like Parquet, JSON, and Arrow. Beyond its core storage and processing capabilities, the project provides a comprehensive suite of tools for observability, security, and data integration. It includes built-in support for natural language querying, automated workflow orchestration for AI agents, and extensive diagnostic features for query plan inspection. The platform also offers robust cloud infrastructure management, including support for private networking, compliant deployment strategies, and integrated billing consolidation. - [jasondavies/d3-cloud](https://awesome-repositories.com/repository/jasondavies-d3-cloud.md) (3,944 ⭐) — Create word clouds in JavaScript. - [rustfs/rustfs](https://awesome-repositories.com/repository/rustfs-rustfs.md) (28,850 ⭐) — Rustfs is a distributed object storage system designed for high availability and horizontal scalability. It functions as a cluster-based platform that manages data across multiple nodes, providing a self-hosted infrastructure for large-scale storage requirements. The system is built to be container-native, utilizing an operator to automate deployment and management within orchestrated environments. It provides compatibility with standard object storage protocols, allowing existing applications and tools to interact with the storage layer through a translation interface. To ensure long-term reliability, the platform employs erasure-coded redundancy and automated background scrubbing to detect and repair silent data corruption. The architecture supports extensibility through a modular plugin system, enabling custom logic to be integrated into the request pipeline. Security and compliance are prioritized through support for external identity providers, transport layer encryption, and strict data sovereignty controls that operate without external telemetry. - [awesome-selfhosted/awesome-selfhosted](https://awesome-repositories.com/repository/awesome-selfhosted-awesome-selfhosted.md) (299,516 ⭐) — This project is a community-curated directory of open-source software designed for deployment in private server environments and home labs. It serves as a comprehensive resource for discovering independent, self-hosted alternatives to mainstream cloud services, enabling users to maintain full data ownership and control over their digital infrastructure. The directory is structured through a hierarchical taxonomy that organizes a vast collection of applications into logical categories, ranging from media management and data analytics to private communication and team productivity tools. It distinguishes itself through a collaborative peer-review process, where community members validate the quality and relevance of each submission to ensure the directory remains accurate and reliable. The project covers a broad capability surface, including infrastructure automation, container-based service deployment, and declarative configuration management. These tools assist users in maintaining reproducible server environments and managing complex service dependencies across private hardware. The directory is maintained as a version-controlled repository, ensuring that all updates and community-driven changes are tracked and transparent. - [alejoar/flask-azure-storage](https://awesome-repositories.com/repository/alejoar-flask-azure-storage.md) (22 ⭐) — Flask extension that provides integration with Azure Storage - [beekeeper-studio/beekeeper-studio](https://awesome-repositories.com/repository/beekeeper-studio-beekeeper-studio.md) (22,030 ⭐) — Beekeeper Studio is a cross-platform desktop application designed for database management and SQL development. It provides a unified graphical interface to connect to, query, and modify data across a wide range of relational and NoSQL database systems. The application functions as a comprehensive workspace, integrating tools for schema design, record editing, and data visualization. The project distinguishes itself through a focus on secure, flexible connectivity and AI-assisted workflows. It supports advanced authentication methods, including enterprise single sign-on, multi-factor authentication, and token-based access, alongside secure traffic routing via SSH tunneling and SSL encryption. Users can leverage AI-driven query generation to translate natural language into executable SQL, while the interface allows for direct, spreadsheet-like data editing and transactional staging to ensure data integrity. The platform covers a broad capability surface, including robust import and export management, schema inspection, and visual entity relationship diagram generation. It also offers extensive customization options, such as editor behavior settings, native extension loading for SQLite, and third-party add-on integration. The application is distributed as a native desktop installer for Windows, Linux, and MacOS, with support for portable execution and offline-only operation modes. - [kushneryk/join.cloud](https://awesome-repositories.com/repository/kushneryk-join-cloud.md) (64 ⭐) — Join.cloud lets AI agents work together in real-time rooms. Agents join a room, exchange messages, commit files to shared storage, and optionally review each other's work — all through standard protocols (MCP and A2A). - [apache/mxnet](https://awesome-repositories.com/repository/apache-mxnet.md) (20,829 ⭐) — This project is a deep learning framework designed for constructing, training, and deploying neural networks across diverse hardware environments. It functions as a high-performance tensor computation library that provides both imperative and symbolic programming interfaces, allowing developers to balance flexible, step-by-step model building with the efficiency of compiled computation graphs. The framework distinguishes itself through a hybrid execution engine that integrates declarative graph compilation with imperative runtime logic. It supports scalable, distributed training across multiple compute nodes and devices, utilizing a shared key-value store and sophisticated synchronization strategies to manage parameters and gradient updates. The system is built on a language-agnostic native core, ensuring consistent performance and behavior when accessed through its various language bindings. Beyond core training and inference, the project includes comprehensive tools for managing data pipelines, including utilities for streaming, resizing, and prefetching datasets from local or cloud storage. It also provides extensive monitoring, profiling, and visualization capabilities to track performance metrics, inspect intermediate outputs, and identify bottlenecks during the development process. The software is designed for production-grade deployment, offering support for model serialization, mobile optimization, and secure execution environments. It includes specialized memory planning and hardware-specific tuning to maximize throughput and minimize resource usage across CPUs and graphics cards. - [googlechrome/lighthouse](https://awesome-repositories.com/repository/googlechrome-lighthouse.md) (30,355 ⭐) — Lighthouse is an automated diagnostic tool that evaluates web pages against industry standards for performance, accessibility, and search engine optimization. It functions as a programmatic analysis engine and a command-line utility, allowing developers to integrate comprehensive web quality checks directly into continuous integration pipelines and local development workflows. The project distinguishes itself through a modular architecture that utilizes artifact-based data collection to ensure consistent analysis across different environments. It supports a headless execution mode for automated testing and provides a plugin-driven framework, enabling developers to register custom audit logic and specialized reporting categories to meet unique project requirements. Beyond its core auditing capabilities, the tool detects underlying web frameworks and content management systems to provide tailored optimization recommendations. It generates structured, machine-readable reports and offers multiple interfaces, including a browser-integrated panel and a dedicated extension, to facilitate real-time feedback during the development process. - [capsoftware/cap](https://awesome-repositories.com/repository/capsoftware-cap.md) (17,026 ⭐) — Cap is a self-hosted screen recording and video collaboration platform designed for teams to replace synchronous meetings with asynchronous video updates. It provides a comprehensive suite for capturing high-resolution desktop activity, including system audio, microphone input, and camera overlays, which are then processed through an integrated post-production workflow. The platform distinguishes itself by offering full data sovereignty through containerized deployment and object storage abstractions, allowing users to host their media assets on private infrastructure or S3-compatible buckets. Beyond simple recording, it features keyframe-based video compositing, automated AI-powered transcription, and visual branding tools that enable creators to polish and annotate their content before sharing. The system facilitates team engagement through a centralized workspace where viewers can provide feedback via timestamped comments, reactions, and playback analytics. It also includes programmatic interfaces for embedding videos into external applications, managing media assets, and automating distribution workflows. The project is distributed as a containerized application, enabling deployment on private servers to maintain complete control over data storage and access permissions. - [coollabsio/coolify](https://awesome-repositories.com/repository/coollabsio-coolify.md) (57,055 ⭐) — This project is a self-hosted platform-as-a-service that provides a centralized management interface for deploying, configuring, and monitoring containerized applications and databases on private infrastructure. It functions as a visual control plane, automating the end-to-end lifecycle of services from source code to production. By managing container orchestration, networking, and resource allocation, it allows users to maintain full control over their own hardware while streamlining the delivery of software. The platform distinguishes itself through its agentless architecture, which uses secure shell connections to execute administrative tasks and manage remote servers without requiring persistent local software. It integrates directly with version control systems to trigger automated build and deployment pipelines, including the creation of temporary, isolated preview environments for every pull request. This workflow is supported by a declarative engine that uses templates to standardize the deployment of complex multi-container architectures and persistent database engines. Beyond core orchestration, the system handles the operational requirements of hosted services by managing dynamic reverse-proxy routing and automated SSL certificate lifecycles. It provides a comprehensive suite of infrastructure management tools, including browser-based terminal access for debugging, automated system dependency installation, and persistent state management via a central database. These capabilities ensure that infrastructure remains synchronized and consistent across multiple remote environments. - [cloud-hypervisor/cloud-hypervisor](https://awesome-repositories.com/repository/cloud-hypervisor-cloud-hypervisor.md) (5,285 ⭐) - [frappe/erpnext](https://awesome-repositories.com/repository/frappe-erpnext.md) (35,726 ⭐) — ERPNext is a comprehensive enterprise resource planning suite designed to integrate core organizational functions, including accounting, inventory, human resources, and project management, into a single unified platform. It operates as a metadata-driven business application, where data structures and application logic are defined through configuration rather than hard-coded programming to facilitate rapid customization. The system distinguishes itself through a robust security and governance framework that enforces granular, role-based access control across all document operations. It features a dedicated data privacy layer that performs field-level masking, intercepting and transforming sensitive information at the application level based on user authorization. This ensures that private data remains protected while maintaining full operational functionality for authorized staff. The platform manages business processes through an event-driven workflow engine that triggers automated tasks and notifications based on document status changes. Its document-oriented persistence layer handles relationships and validation logic centrally, while server-side hooks allow for the injection of custom logic into the document lifecycle. The system is documented and distributed as a configurable framework for managing complex organizational data. - [payloadcms/payload](https://awesome-repositories.com/repository/payloadcms-payload.md) (43,053 ⭐) — Payload is a headless content management system and application framework that uses a code-first approach to define data schemas and administrative interfaces. By utilizing a centralized, type-safe configuration object, it automatically generates database schemas, API endpoints, and a fully customizable admin panel. The system is built on a database-agnostic architecture, allowing it to interface with various storage engines while providing a unified, type-safe API for server-side operations, REST, and GraphQL. What distinguishes Payload is its deep extensibility and developer-centric design. It allows for the injection of custom React components, views, and widgets directly into the administrative interface, enabling tailored content-authoring workflows. The platform features a robust hook-based lifecycle system for executing custom logic, a comprehensive access control framework for granular field-level security, and a plugin-based architecture that supports complex features like ecommerce, multi-tenancy, and background job processing. The system provides a broad capability surface, including built-in support for versioned document state management, internationalization, and automated database migrations. It also includes a rich text editor framework that supports custom blocks and markdown conversion, alongside tools for live content previews and media management with various cloud storage adapters. Payload is designed for TypeScript-native development, automatically generating interfaces from the database schema to ensure type safety across the entire project. The system is configured through a single, fully-typed JavaScript object, and it supports deployment in production environments with features like database-less builds and security hardening. - [51j0/android-storage-extractor](https://awesome-repositories.com/repository/51j0-android-storage-extractor.md) (21 ⭐) — A tool to extract local data storage of an Android application in one click. - [567-labs/instructor](https://awesome-repositories.com/repository/567-labs-instructor.md) (13,176 ⭐) — Instructor is a framework designed for structured data extraction, validation, and language model integration. It functions as a library that transforms unstructured text into validated, type-safe objects by leveraging schema definitions and model-specific tool-calling capabilities. By acting as a validation middleware, the project ensures that language model outputs strictly conform to defined data structures. The library distinguishes itself through a robust validation-based retry loop that automatically re-submits failed responses with error feedback to iteratively correct schema compliance. It provides a provider-agnostic client abstraction that normalizes diverse model interfaces into a unified execution layer, while its schema-driven prompt synthesis automatically generates model instructions by introspecting class definitions and field annotations. Additionally, the framework supports polymorphic schema mapping for complex data structures and enables incremental stream processing to yield validated objects in real-time as they are generated. Beyond its core extraction capabilities, the project offers a comprehensive suite of tools for managing the full lifecycle of model interactions. This includes support for asynchronous execution, multimodal data processing, and extensive observability features such as token usage tracking and event-driven lifecycle hooks. Developers can also utilize built-in mechanisms for caching, safety management, and automated error recovery to maintain reliable production workflows. The library is distributed as a Python package and provides a unified interface that extends existing client objects without requiring modifications to their original source code. - [astral-sh/uv](https://awesome-repositories.com/repository/astral-sh-uv.md) (86,451 ⭐) — uv is a high-performance Python package manager and project build tool designed to handle dependency resolution, virtual environment orchestration, and Python interpreter management. It functions as a comprehensive workspace orchestrator, enabling developers to manage complex, multi-package repositories and ensure reproducible builds across different platforms. The tool distinguishes itself through its use of a global, content-addressable cache and hard-link-based environment provisioning, which allow for near-instant environment creation and minimal disk usage. It employs a high-performance solver to satisfy complex dependency graphs and supports ephemeral script execution, allowing users to run standalone Python scripts with ad-hoc dependencies without manual setup. Beyond core package management, the project provides a unified command-line interface that integrates with CI/CD pipelines and supports common workflows like building distributions and managing private package indexes. It maintains compatibility with standard tools, offering a drop-in replacement for common environment and package management commands. Comprehensive documentation is available on the project website, covering installation guides, command references, and configuration settings for various development and production environments. - [rust-embedded-community/embedded-storage](https://awesome-repositories.com/repository/rust-embedded-community-embedded-storage.md) (95 ⭐) — An Embedded Storage Abstraction Layer - [chocobozzz/peertube](https://awesome-repositories.com/repository/chocobozzz-peertube.md) (14,520 ⭐) — PeerTube is a decentralized, open-source video hosting platform that enables users to operate independent, interoperable servers. By utilizing the ActivityPub protocol, it connects these servers into a global, federated network where users can follow channels, discover content, and interact across different instances. The platform is designed to function as a self-hosted video content management system, providing a community-driven alternative to centralized media services. What distinguishes PeerTube is its hybrid approach to content delivery and infrastructure management. It integrates peer-to-peer distribution via WebTorrent to reduce server bandwidth consumption, while simultaneously supporting remote object storage to decouple media assets from local disk capacity. To maintain performance under high load, the platform delegates resource-intensive tasks like video transcoding and transcription to external worker instances, ensuring the primary server remains responsive. The platform offers a comprehensive suite of tools for content management, including live streaming, automated moderation, and granular access controls. Its extensibility is supported by a hook-based plugin architecture, allowing administrators to inject custom logic, modify interface elements, or integrate third-party services. Additionally, the system provides a robust command-line interface and a standardized REST API, enabling programmatic control over administrative tasks, bulk content processing, and platform maintenance. The software is packaged for containerized deployment, simplifying infrastructure management and ensuring consistent execution across various hosting environments.