baidu/uid-generator
Uid Generator
Este proyecto es un generador de ID único distribuido diseñado para producir identificadores únicos y ordenables globalmente de 64 bits a través de múltiples nodos. Implementa un algoritmo compatible con Snowflake que evita colisiones combinando marcas de tiempo, identificadores de trabajador y números de secuencia en un solo entero.
El sistema incluye un orquestador de ID de trabajador para asignar y mantener identidades de máquina únicas durante el inicio y la migración de instancias utilizando estrategias respaldadas por bases de datos. Para aumentar el rendimiento de las solicitudes y reducir la latencia, utiliza una capa de caché de búfer circular que pre-genera identificadores y emplea un mecanismo de recarga basado en umbrales.
El software proporciona capacidades para gestionar claves de bases de datos distribuidas, coordinar nodos del sistema y configurar la distribución de bits para equilibrar las necesidades de concurrencia frente a la vida útil del sistema. También incluye utilidades para analizar los identificadores generados de vuelta a sus componentes originales.
Features
- Unique Identifier Generators - Provides a system for generating globally unique, sortable identifiers to prevent collisions across distributed server nodes.
- Distributed Identifier Generators - Generates unique primary keys across distributed nodes without requiring a central coordination round-trip for every ID.
- Distributed Primary Key Generation - Generates time-ordered unique identifiers specifically designed for use as primary keys in distributed databases.
- Snowflake ID Generators - Produces 64-bit unique identifiers using the Snowflake algorithm to ensure global uniqueness in distributed environments.
- ZooKeeper Worker Assignments - Allocates unique worker identities during startup to ensure that each node generates a unique set of Snowflake IDs.
- Concurrent Ring Buffering - Utilizes concurrent ring buffers to decouple the production of unique IDs from their consumption by requests.
- Distributed Coordination Systems - Coordinates unique worker identities across a cluster to ensure distinct node identities in a distributed system.
- Worker Identity Assignments - Provides a mechanism to assign unique worker identities during startup via a database to prevent ID collisions.
- Identifier Bit-Packing - Implements bit-packing of timestamps, worker IDs, and sequences to construct a unique 64-bit identifier.
- Batch ID Caches - Utilizes a batch ID cache to store pre-produced identifiers, significantly reducing concurrency bottlenecks.
- Segment Caching Refills - Implements a threshold-based refill mechanism to replenish the ID cache from the database before it is depleted.
- High-Throughput ID Generators - Achieves high throughput by pre-generating and caching identifiers in a ring buffer to reduce request latency.
- Cache-Line Padding - Employs cache-line padding between buffer elements to eliminate false sharing and increase hardware throughput.
