awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索Open-source alternativesSelf-hosted software博客网站地图
项目关于How we rank媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

46 个仓库

Awesome GitHub RepositoriesData Migration

Automated systems and scripts designed to move, transform, and validate data during transitions between storage environments.

Explore 46 awesome GitHub repositories matching data & databases · Data Migration. Refine with filters or upvote what's useful.

Awesome Data Migration GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • garrytan/gstackgarrytan 的头像

    garrytan/gstack

    110,596在 GitHub 上查看↗

    gstack is an AI agent framework and development workflow system designed to automate the software development lifecycle. It coordinates specialized AI personas to manage tasks across product design, engineering management, and quality assurance, transforming product intent into technical specifications and final releases. The project is distinguished by its deep integration of headless browser automation and semantic code memory. It utilizes a persistent Chromium daemon for web scraping and visual auditing, and implements a searchable knowledge base that logs architectural decisions and repos

    Enables the migration of stored pages and embeddings between local and cloud database providers without data loss.

    TypeScript
    在 GitHub 上查看↗110,596
  • laravel/laravellaravel 的头像

    laravel/laravel

    84,489在 GitHub 上查看↗

    Laravel is a comprehensive full-stack web framework designed for building scalable server-side applications. It provides an integrated development environment that centers on an object-relational mapper for database abstraction, a robust routing system, and a sophisticated service container for dependency injection. The framework is built to handle complex application requirements through a modular architecture that emphasizes convention over configuration. What distinguishes Laravel is its deep integration of background processing and event-driven communication. It features a task queue orch

    Provides a fluent, programmatic interface for defining and modifying database schemas without writing raw SQL.

    Bladeframeworklaravelphp
    在 GitHub 上查看↗84,489
  • rclone/rclonerclone 的头像

    rclone/rclone

    57,877在 GitHub 上查看↗

    This project is a command-line storage manager that provides a unified interface for performing file operations across local filesystems and diverse cloud storage providers. It functions as a cross-platform storage abstraction, utilizing a modular backend architecture to map heterogeneous cloud storage APIs into a standard set of file system operations. This allows for consistent data management and movement regardless of the underlying storage service. The tool serves as a network data transfer engine designed for automated data migration and cloud storage synchronization. It distinguishes i

    Automates the migration of large data volumes between disparate storage systems while preserving file metadata.

    Goazure-blobazure-blob-storageazure-files
    在 GitHub 上查看↗57,877
  • appwrite/appwriteappwrite 的头像

    appwrite/appwrite

    56,318在 GitHub 上查看↗

    Appwrite is a backend-as-a-service platform that provides a unified development environment for building full-stack applications. It integrates essential infrastructure components—including authentication, databases, storage, and serverless functions—into a single, centralized interface to simplify application development and resource management. The platform distinguishes itself through a container-based microservices architecture that ensures consistent execution across diverse infrastructure. It features a versatile connectivity layer that links frontend applications with third-party servi

    Transfers users, databases, and files between external platforms and new project instances.

    TypeScriptandroidappwritebackend
    在 GitHub 上查看↗56,318
  • deepfakes/faceswapdeepfakes 的头像

    deepfakes/faceswap

    55,289在 GitHub 上查看↗

    Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process

    Updates legacy alignment data structures to current standards by modifying formats and inserting required metadata keys.

    Pythondeep-face-swapdeep-learningdeep-neural-networks
    在 GitHub 上查看↗55,289
  • nrwl/nxnrwl 的头像

    nrwl/nx

    28,939在 GitHub 上查看↗

    This project is a build orchestration engine and development toolkit designed for managing large-scale monorepos. It provides a unified workspace environment that maps project relationships and dependencies, enabling the system to perform intelligent impact analysis and execute only the tasks affected by specific code changes. The system distinguishes itself through a persistent daemon that monitors file changes for near-instant feedback and a content-addressable caching mechanism that stores task outputs to prevent redundant computation across local and remote environments. It further suppor

    Provides interactive control to selectively apply, reorder, or skip migration tasks during workspace updates.

    TypeScriptangularbuildbuild-system
    在 GitHub 上查看↗28,939
  • mongodb/mongomongodb 的头像

    mongodb/mongo

    28,158在 GitHub 上查看↗

    This project is a distributed, document-oriented database system designed to store information in flexible, hierarchical structures. It supports horizontal scaling through automated sharding and maintains high availability across global clusters using a multi-node replication protocol. By executing multi-document operations as atomic units, the system ensures data integrity and consistency across distributed environments. The platform distinguishes itself by integrating advanced vector-based indexing, which enables semantic similarity searches alongside traditional geospatial and lexical quer

    Automates the movement and synchronization of data between different storage environments and clusters.

    C++c-plus-plusdatabasemongodb
    在 GitHub 上查看↗28,158
  • karakeep-app/karakeepkarakeep-app 的头像

    karakeep-app/karakeep

    26,248在 GitHub 上查看↗

    Karakeep is a self-hosted, open-source platform designed for personal knowledge management and web content archiving. It functions as a centralized repository where users can capture, organize, and preserve bookmarks, notes, and media files, ensuring long-term access to digital information even if original sources are removed or modified. The system distinguishes itself through its automated content processing and security-focused architecture. It utilizes headless browser crawling and optical character recognition to ingest and index web content, while a modular artificial intelligence pipel

    Facilitates the movement of large bookmark datasets between local storage and external files for backups.

    TypeScriptbookmark-managerbookmarksbookmarks-manager
    在 GitHub 上查看↗26,248
  • redis/go-redisredis 的头像

    redis/go-redis

    22,159在 GitHub 上查看↗

    This project is a feature-rich Go client library designed for interacting with Redis. It serves as a comprehensive interface for managing remote data stores, enabling developers to execute standard database commands, handle complex data structures, and perform asynchronous operations within Go applications. The library distinguishes itself through its support for advanced Redis capabilities, including connection pooling, pipelining, and transactional integrity. It provides specialized primitives for managing distributed clusters, including automated topology updates and request routing to sha

    Provides automated systems and scripts designed to move and validate data during transitions.

    Gogogolangredis
    在 GitHub 上查看↗22,159
  • gofr-dev/gofrgofr-dev 的头像

    gofr-dev/gofr

    21,321在 GitHub 上查看↗

    Gofr is a comprehensive framework for building production-ready microservices in Go. It provides a unified toolkit for developing RESTful APIs and gRPC services, offering built-in support for observability, database management, and distributed system communication. The framework distinguishes itself through its focus on developer productivity and system resilience. It automates common backend tasks such as CRUD handler generation, schema-driven code creation, and database migration orchestration, while preventing race conditions in clustered environments. To maintain stability, it includes in

    Prevents race conditions in clustered environments by coordinating distributed database migration execution.

    Goframeworkgogo-framework
    在 GitHub 上查看↗21,321
  • wekan/wekanwekan 的头像

    wekan/wekan

    20,971在 GitHub 上查看↗

    Wekan 是一个开源、自托管的看板项目管理工具,用于通过看板、列表和卡片组织工作流。它是一个实时 Web 应用程序,允许团队在私有基础设施上管理任务。 该平台的特色在于其广泛的数据迁移工具,特别是用于从 Trello 导入看板和卡片。它支持通过 LDAP、OpenID Connect 和 OAuth2 进行企业级身份集成,并提供灵活的存储选项,包括作为主要关系后端的 PostgreSQL 和用于附件的可插拔云存储。 该系统涵盖了广泛的任务管理功能,包括甘特图可视化、时间跟踪和跨看板任务聚合。它包括用于基于角色的访问控制、自动化备份调度以及通过 REST API 和事件驱动 Webhook 进行编程扩展的管理工具。 该应用程序可通过 Docker 部署,并支持多租户配置。

    Implements extensive data migration tools specifically for importing boards and cards from Trello.

    JavaScript
    在 GitHub 上查看↗20,971
  • apache/shardingsphereapache 的头像

    apache/shardingsphere

    20,737在 GitHub 上查看↗

    ShardingSphere is a distributed SQL database middleware that provides sharding, read-write splitting, and distributed transaction management for relational databases. It functions as a layer that intercepts SQL queries to distribute data across multiple physical database instances for horizontal scaling. The project is distinguished by its ability to operate as either a standalone transparent database proxy or via direct integration as a JDBC driver. It features a SQL dialect translator that parses queries into abstract syntax trees to convert syntax between different database engines, enabli

    Moves data between different database instances using change data capture and automated migration pipelines.

    Java
    在 GitHub 上查看↗20,737
  • vitessio/vitessvitessio 的头像

    vitessio/vitess

    20,788在 GitHub 上查看↗

    Vitess is a database clustering system for horizontal scaling of MySQL. It functions as a middleware layer that abstracts complex sharding and physical topology, allowing applications to interact with a distributed database environment through a unified interface. By intercepting and routing SQL queries across multiple shards, it enables large-scale data management while maintaining the appearance of a single database instance. The platform distinguishes itself through its ability to perform online schema migrations and distributed transaction coordination without requiring application downti

    Moves tables or data subsets between database instances online to facilitate infrastructure transitions without requiring application downtime.

    Gocncfdatabase-clusterkubernetes
    在 GitHub 上查看↗20,788
  • wagtail/wagtailwagtail 的头像

    wagtail/wagtail

    20,366在 GitHub 上查看↗

    Wagtail is an open-source content management system built on the Django web framework. It provides a structured, tree-based approach to content modeling, allowing developers to define custom page types and reusable content components that are managed through a highly customizable administrative interface. The platform distinguishes itself through its flexible, block-based content composition system, which enables editors to assemble complex page layouts dynamically. It also offers robust support for multi-site and multi-lingual environments, allowing organizations to manage distinct websites

    Automates the restructuring of complex content schemas during database updates.

    Pythoncmsdjangohacktoberfest
    在 GitHub 上查看↗20,366
  • avaiga/taipyAvaiga 的头像

    Avaiga/taipy

    19,247在 GitHub 上查看↗

    Taipy is a Python data application framework designed for building production-ready web interfaces that integrate AI algorithms and data pipelines. It provides a comprehensive suite for developing AI dashboards and data application interfaces. The framework includes a data pipeline orchestrator for managing complex workflows and dependencies, alongside a job scheduler for executing background tasks on recurring timetables. It also features a scenario analysis tool for performing what-if simulations by comparing different data input versions to evaluate their impact on algorithm outcomes. Add

    Handles the transition of data between application versions to maintain consistency during system updates.

    Python
    在 GitHub 上查看↗19,247
  • uvdesk/community-skeletonuvdesk 的头像

    uvdesk/community-skeleton

    19,025在 GitHub 上查看↗

    This project is an open-source, self-hosted helpdesk system designed to centralize customer support operations. It functions as an omnichannel platform that aggregates inquiries from email, social media, and messaging services into a unified dashboard, while providing a dedicated portal for customers to track requests and access self-service documentation. The system distinguishes itself through deep integration with e-commerce platforms, allowing agents to view customer order history and profile data directly within the ticketing interface. It features a modular architecture that supports cu

    Supports the migration of users, mailboxes, and ticket history from external platforms into the system.

    CSSagent-privilegebackbonejscustomer-support
    在 GitHub 上查看↗19,025
  • wasp-lang/waspwasp-lang 的头像

    wasp-lang/wasp

    18,146在 GitHub 上查看↗

    Wasp is a declarative full-stack web framework that enables developers to build and deploy applications by defining their architecture in a centralized configuration. By using a high-level specification, the framework automates the orchestration of frontend, backend, and database components, ensuring that infrastructure concerns like routing, authentication, and data modeling are handled consistently across the entire stack. The framework distinguishes itself through its compiler-driven approach, which translates declarative configurations into cohesive, production-ready codebases. It provide

    Applies complex schema changes using incremental strategies to prevent data loss during breaking updates.

    TypeScripthaskelljavascriptnode
    在 GitHub 上查看↗18,146
  • golang-migrate/migrategolang-migrate 的头像

    golang-migrate/migrate

    18,118在 GitHub 上查看↗

    This project is a command-line utility designed to manage database schema versioning and automate incremental schema updates. It functions as a version control system for database structures, ensuring consistency across environments by tracking applied migrations in a dedicated metadata table and executing scripts in a sequential, reliable manner. The tool distinguishes itself through a driver-based abstraction layer that supports a wide range of database engines, including various SQL and distributed cloud databases. It provides robust concurrency control through advisory locking, which prev

    Splits migration scripts into individual statements using delimiters to support complex schema modifications.

    Goaws-s3cassandradatabase
    在 GitHub 上查看↗18,118
  • ent/entent 的头像

    ent/ent

    17,110在 GitHub 上查看↗

    Ent is a statically typed entity framework for Go that models database structures as a graph of nodes and edges. It functions as a code generation engine that transforms schema definitions into type-safe database clients, query builders, and migration scripts. By representing data as interconnected entities, the framework enables intuitive traversal of complex relationships and ensures that database interactions remain consistent with the application model at compile time. The framework distinguishes itself through its graph-based approach to data modeling and its reliance on compile-time cod

    Supports delegation of schema management to external migration engines for complex database operations.

    Goententity-frameworkorm
    在 GitHub 上查看↗17,110
  • hmjz100/linkswifthmjz100 的头像

    hmjz100/LinkSwift

    17,091在 GitHub 上查看↗

    LinkSwift is a cloud storage link extractor and file transfer utility designed to retrieve direct download addresses from various cloud storage providers. By generating raw download links, the tool enables users to bypass web interface restrictions and simplify the process of moving files between cloud platforms, local systems, or remote servers. The project functions as a direct download URL generator that automates file acquisition by programmatically parsing cloud storage pages. It employs a combination of headless browser automation and HTTP request interception to navigate dynamic web pa

    Facilitates moving files between cloud storage providers by obtaining direct access links.

    JavaScript123pan123yunpanaliyun-drive
    在 GitHub 上查看↗17,091
上一个123下一个
  1. Home
  2. Data & Databases
  3. Data Integration & Synchronization
  4. Data Migration

探索子标签

  • Alignment File MigratorsTools that update legacy facial alignment data structures to meet current schema requirements.
  • AutomatedInfrastructure platforms that automate the transfer and migration of data between disparate storage systems or application instances.
  • Data ReformattersTransformation of incompatible data formats, such as converting zero-dates to NULL, during the loading process. **Distinct from Data Migration:** Distinct from Data Migration: focuses on on-the-fly data reformatting rather than the overall migration process.
  • Database IndexesManagement of schema indexes and constraints.
  • Fluent Migration Systems1 个子标签Migration tools using a fluent, programmatic API for schema definitions.
  • Metric Block MigrationTools for importing historical metric blocks from object storage. **Distinct from Data Migration:** Distinct from Data Migration: focuses on specific metric block formats from object storage.
  • Migration Execution Engines4 个子标签Tools for applying, rolling back, and managing the state of database schema migrations.
  • Migration GeneratorsCLI utilities that scaffold new migration files with customizable templates.
  • Trello MigrationsSpecialized utilities for importing data from Trello into other task management systems. **Distinct from Data Migration:** Specific to Trello data imports, whereas Data Migration is a general process for moving data between any storage environments.