awesome-repositories.com
Blog
awesome-repositories.com

Descubre los mejores repositorios open-source con nuestra búsqueda potenciada por IA.

ExplorarBúsquedas curadasAlternativas open-sourceSoftware autohospedableBlogMapa del sitio
ProyectoAcerca deCómo clasificamosPrensaServidor MCP
Aviso legalPrivacidadTérminos
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

4 repositorios

Awesome GitHub RepositoriesJob Sharding

Techniques for splitting a single logical task into parallel shards for distributed execution.

Distinct from Distributed Sharding Architectures: Focuses on sharding the execution of a job rather than sharding data storage (databases) or model parameters (AI).

Explore 4 awesome GitHub repositories matching data & databases · Job Sharding. Refine with filters or upvote what's useful.

Awesome Job Sharding GitHub Repositories

Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
  • xuxueli/xxl-jobAvatar de xuxueli

    xuxueli/xxl-job

    30,282Ver en GitHub↗

    xxl-job is a distributed task scheduling platform and job orchestrator designed to manage and trigger timed jobs across a cluster of remote executor nodes. It provides a centralized system for scheduling tasks, linking dependent jobs, and managing complex execution lifecycles through a relational database that persists configurations and logs. The platform distinguishes itself through a web-based interface for cron job management, allowing users to create and update scheduled tasks without modifying source code. It supports cross-language task execution by triggering logic on third-party exec

    Implements techniques for splitting a single logical task into parallel shards for distributed execution across a cluster.

    Javacrondistributedglue
    Ver en GitHub↗30,282
  • apache/shardingsphere-elasticjobAvatar de apache

    apache/shardingsphere-elasticjob

    8,203Ver en GitHub↗

    ShardSphere-ElasticJob is a Java-based distributed scheduling framework designed to manage workloads across multiple nodes. It provides a system for splitting scheduled tasks into shards and distributing them across a cluster to achieve high-throughput execution. The framework includes a distributed task failover system that detects node failures and automatically reassigns missed job executions to healthy cluster instances. It also features a cluster resource manager to dynamically allocate execution resources based on system load and capacity. The system covers high-availability task execu

    Splits single logical jobs into multiple parallel shards distributed across available worker instances for high-throughput execution.

    Javacrondatabaseelasticjob
    Ver en GitHub↗8,203
  • akkadotnet/akka.netAvatar de akkadotnet

    akkadotnet/akka.net

    5,023Ver en GitHub↗

    Akka.NET is an actor model framework used for building concurrent and distributed applications. It functions as a distributed computing platform and state manager that enables isolated actors to communicate via asynchronous message passing, ensuring thread-safe state management without manual locks. The project is distinguished by its decentralized coordination capabilities, including a distributed state manager that uses sharding and dynamic rebalancing to maintain high availability. It incorporates an event sourcing engine that persists state as a sequence of events in an append-only log an

    Assigns unique persistence identifiers to sharded actors to ensure state recovery after they move or are recreated.

    C#actoractor-modelakka
    Ver en GitHub↗5,023
  • moonrepo/moonAvatar de moonrepo

    moonrepo/moon

    3,687Ver en GitHub↗

    Moon is a monorepo build system and task runner designed to orchestrate complex projects with multiple packages. It functions as a dependency graph orchestrator that executes build targets in topological order and utilizes input hashing to cache results and skip redundant work. The project features a polyglot toolchain manager that automates the installation and versioning of language runtimes and CLI tools to ensure environment consistency. It also includes a plugin framework based on WebAssembly, allowing developers to extend build logic and toolchain behavior using any supported language.

    Splits a logical set of affected targets into parallel shards for distributed execution across workers.

    Rustbuild-systembuild-toolbun
    Ver en GitHub↗3,687
  1. Home
  2. Data & Databases
  3. Distributed Sharding Architectures
  4. Job Sharding

Explorar subetiquetas

  • Sharded Actor PersistenceIntegration of sharding logic with persistence identifiers to ensure state recovery for distributed entities. **Distinct from Job Sharding:** Specifically links entity sharding to persistence IDs for recovery, unlike general job sharding.