Awesome GitHub RepositoriesData Backup Solutions

Copyparty is a self-hosted file server that provides a browser-based interface for managing, browsing, uploading, and downloading files. It utilizes a virtual file system abstraction to map diverse storage backends and network-attached devices into a unified directory structure, allowing for consistent file access across various storage environments. The platform functions as a cloud synchronization gateway, enabling automated data backups and transfers between local storage and remote cloud providers through integration with standard command-line tools. It also serves as a distributed storag

Actual is a local-first personal finance manager designed to help users track income, manage expenses, and maintain a balanced budget. It functions as a data-centric application that prioritizes offline access and local file storage, ensuring that financial records remain available and performant regardless of network connectivity. The platform distinguishes itself through a robust architectural foundation that emphasizes data integrity and auditability. Every financial action is recorded as an immutable sequence of events, and all currency values are processed using an integer-based arithmet

This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha

VictoriaMetrics is a high-performance, scalable time series database and observability platform designed for long-term storage and analysis of metric, log, and trace data. It functions as a unified backend for monitoring ecosystems, offering full compatibility with industry-standard protocols and query languages. The system is built to handle massive data volumes through a distributed architecture that supports horizontal scaling and efficient data lifecycle management. The platform distinguishes itself through a storage engine that utilizes consistent hashing for data sharding and log-struct

Monolith is a single-file HTML web archiver and asset bundler. It functions as a command-line interface and programmatic library designed to save complete web pages and their associated assets into a single HTML file for offline viewing. The tool crawls URLs to discover and fetch linked stylesheets, scripts, and images, which are then embedded into the document as data URLs. It includes capabilities for session injection via external cookie files and authentication handling to backup protected or member-only content. The project covers broader functional areas including automated web scrapin

Duplicati is a self-hosted backup server designed to perform encrypted, incremental, and compressed backups to a wide range of local, network, and cloud-based storage providers. It functions as a background service that automates recurring data protection tasks, ensuring that only changed data blocks are stored to maximize efficiency and minimize bandwidth usage. The project distinguishes itself through a centralized management console that allows for the orchestration of multiple distributed backup agents from a single web-based dashboard. It supports multi-tenant management, enabling the or

This project is a comprehensive educational resource and curriculum focused on site reliability engineering, distributed systems, and infrastructure operations. It provides technical guides, a systems engineering course, and instructional manuals designed to teach the principles of managing large-scale computing environments. The curriculum covers high-level architectural design for scalability and resilience, including fault-tolerant infrastructure, high-availability patterns, and microservices decomposition. It emphasizes the practical application of site reliability engineering through the

bup is a deduplicating backup manager and incremental backup system. It uses a Git packfile-based storage format to eliminate redundant data across files and versions, treating every incremental save as a full backup. The system provides secure remote transport interfaces for transferring and managing backup data on remote servers via SSH. It also includes a backup repository browser available as both a web interface and a filesystem mount for exploring and retrieving files from snapshots. The project covers broad capability areas including disaster recovery, repository administration, and s

Perkeep is a personal content storage system designed for storing, syncing, and backing up digital assets. It functions as a distributed data synchronization engine and an S3 compatible backup tool, allowing users to persist data objects to cloud services for long-term preservation. The system utilizes a key-value content indexer to track data blobs for efficient retrieval and enumeration. It supports custom data modeling to define structures and relationships between stored information, moving beyond simple file storage. The platform includes capabilities for self-hosted content storage, pr

tdl is a command-line tool for Telegram account automation, media management, and data archiving. It provides a programmatic interface for downloading and uploading files, forwarding messages, and exporting chat history, member lists, and media into structured JSON files. The project distinguishes itself through a session management system that isolates multiple account identities using unique namespaces. It features expression-based routing for messages and uploads, allowing users to direct content to specific destination chats using custom logic and dynamic caption generation. The tool cov

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

InvenTree is an open-source inventory management platform built on Django, designed for tracking parts, stock levels, and supply chain operations through a web interface and REST API. The system uses barcodes—including QR codes, 1D barcodes, and Data Matrix codes—as primary identifiers for scanning, linking, and triggering inventory actions, and extends core functionality through a Python plugin framework supporting custom actions, UI panels, barcode handlers, and scheduled tasks. The platform distinguishes itself through a comprehensive plugin-based extensibility system that allows custom in

This is a Laravel package that creates and manages automated backups of application files and databases. It orchestrates backup, cleanup, and notification steps as a configurable pipeline, compressing selected directories and database dumps into zip archives that can be stored on any Laravel filesystem disk. The package provides a configurable retention policy engine that prunes old backups based on age, count, or size thresholds, and includes a health-check monitoring system that verifies backup recency and storage capacity. It fires success, failure, and health-check events that route notif

Weblate is an open-source web-based translation management system that provides a collaborative platform for teams to review, suggest, and approve translations in real time. It functions as a continuous localization platform, automatically synchronizing translations with source code changes in version control repositories, and can be deployed either as a self-hosted server or through a managed cloud hosting service. The system integrates directly with Git hosting platforms like GitHub, GitLab, and Bitbucket, storing all translations in version control with individual translator attribution re

Bili23-Downloader 是一个跨平台工具，旨在从 Bilibili 平台下载高质量视频、音频流和字幕。它作为一个媒体下载器和元数据提取器，支持将在线内容备份和归档到本地存储。 该项目包括一个媒体文件整理器，使用自定义命名模板将内容分类到结构化目录系统中。它还提供导出字幕和弹幕、将封面图嵌入视频文件以及选择特定分辨率和音频格式的工具。 为了提高检索速度，该工具利用多线程下载通过并行连接获取大型视频文件。它通过将独立的音频和视频流合并为标准容器格式来处理媒体，并为媒体中心软件生成描述性元数据文件。 用户身份通过二维码扫描或短信验证，以授予对受限内容的访问权限。

itpol 是一个用于加密密钥管理、数字签名策略和安全加固的框架。它提供了一个 IT 策略模板库和基础设施访问框架，以建立组织安全准则和治理。 该项目专注于通过使用 PGP 和 SSH 密钥进行加密身份管理，以及针对工作站的安全加固指南。它定义了软件供应链安全标准，特别是关于代码提交和软件发布签名的标准，以确保来源可追溯。 该系统涵盖了广泛的安全功能，包括实施多因素身份验证、磁盘加密和引导加载程序安全。它还解决了用于加密消息和电子邮件的安全通信工作流程，以及硬件安全模块 (HSM) 的管理和零知识备份策略。

BiliTools is a modular download tool for Bilibili, supporting authentication, media extraction, metadata management, and user content backup. It provides a configurable download pipeline with QR-based session authentication, automatic captcha and device verification, and stream muxing that merges separate audio and video segments into a single file. A plugin-based media extractor handles multiple content types and streaming endpoints, while a metadata scraping and tagging pipeline writes structured tags into files for media organizers. Subtitle and caption synchronization converts comment o

wal-g 是一个数据库云备份工具和预写式日志（WAL）归档器，专为灾难恢复和时间点恢复而设计。它将数据库状态和事务日志归档到云存储提供商，以确保数据的长期持久性。 该项目提供了一个管理器，用于压缩、加密和清理存储在云对象存储中的数据库备份。它特别支持通过获取基础备份并重放事务日志，将数据库恢复到特定时间点。 该工具的功能涵盖多引擎备份和恢复，包括生成全量和增量备份。它通过库存跟踪和自动清理策略管理备份生命周期，并包含用于验证日志归档和表文件完整性的实用程序。 提供了一个本地代理来模拟云存储 API，用于测试备份和恢复操作。

这是一个 .NET Core 内容管理系统 (CMS) 和多站点管理平台，旨在通过统一界面组织并发布跨独立网站的结构化数字内容。它既可作为无头 CMS (Headless CMS)，也可作为静态网站生成器，将动态模板渲染为 HTML 文件以提高加载速度和可扩展性。 该系统集成了检索增强生成 (RAG) 技术，可将网站文档和内容转化为可搜索的 AI 知识库。它包含一个可视化 AI 工作流编排器，用于定义用户查询与大语言模型输出之间的逻辑。 该平台涵盖了广泛的功能领域，包括模式灵活的数据建模、数字资产组织和基于角色的访问控制。它支持多终端发布、用于自定义模块的插件式扩展架构，以及包含 SM4 数据加密和 Web 漏洞防御的全面安全套件。 该软件专为自托管 Web 基础设施设计，可通过 Docker 容器部署在 Windows、Linux 和 macOS 上。