9 repositorios
Techniques for distributing database operations across different nodes based on the operation type.
Distinguishing note: The candidates provided relate to text writing or blockchain monitoring, not database load distribution.
Explore 9 awesome GitHub repositories matching data & databases · Read and Write Splitting. Refine with filters or upvote what's useful.
FoundationDB is an ACID-compliant distributed transactional key-value store. It functions as a scalable database engine that ensures strict serializability and data consistency across a cluster of servers using a shared-nothing architecture. The system is distinguished by its multi-region replication capabilities, allowing data to be synchronized across different datacenters for high availability and disaster recovery. It utilizes optimistic concurrency control to manage distributed transactions and employs a majority-based coordination system to maintain cluster state. The platform provides
Performs multiple data lookups in parallel within a single transaction to reduce latency and conflict probability.
ioredis is a performance-focused Redis client for Node.js designed to execute commands and manage data connections. It provides a specialized interface for interacting with standalone servers, sharded clusters, and high-availability setups. The library distinguishes itself with native support for Redis Cluster, featuring automatic slot discovery and network address mapping, and Redis Sentinel for master node discovery and automatic failover. It also includes a dedicated Lua scripting interface that utilizes server-side caching to ensure atomic operations. The project covers a broad set of ca
Routes write queries to master nodes and distributes read queries across available nodes to scale performance.
Mycat-Server is a MySQL database middleware system that functions as a sharding proxy, distributed database coordinator, and high availability manager. It acts as a proxy layer that routes SQL traffic between applications and multiple backend MySQL database instances to enable horizontal scaling. The system coordinates distributed transactions, generates global unique sequences to prevent primary key collisions, and executes distributed join queries across multiple database shards. It includes a load balancer that performs read-write splitting by directing traffic between primary and slave no
Directs write operations to primary nodes and read operations to slave nodes to optimize resource utilization.
RediSearch is a Redis module that adds secondary indexing, full-text search, aggregation, and vector similarity search directly into the in-memory data store. It operates as an in-process search engine, extending the core key-value store with capabilities for indexing hash and JSON documents, enabling fast field-level lookups beyond primary key access. The module provides a full-text search engine built on inverted indexes, supporting stemming, fuzzy matching, and relevance scoring via tf-idf. It also includes a vector similarity search engine using a Hierarchical Navigable Small World graph
Sets, retrieves, and modifies the raw bytes of a string value using direct memory access.
GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without
Deploys distinct frontend groups to isolate read and write traffic for resource management.
Concurrent-map is a lock-striped hash map and sharded concurrent cache for Go, designed as a high-performance key-value store that enables thread-safe parallel reads and writes with minimal blocking. It replaces a single global mutex with per-shard locking, using hash-based key distribution to assign entries to independent segments, allowing multiple goroutines to operate simultaneously without race conditions. The library achieves its performance through fine-grained locking and a lock-free read path, where each shard operates independently with its own lock, enabling parallel reads and writ
Enables simultaneous reads and writes across different map shards to avoid global lock contention.
xlwings - Make Excel fly with Python!
Reads and writes values to and from Excel ranges including expanding ranges and complex data types.
MNE-Python is an open-source Python library for processing, visualizing, and analyzing human neurophysiological data, including MEG, EEG, sEEG, ECoG, and NIRS recordings. It provides a comprehensive framework for loading data from over 30 proprietary file formats into a common hierarchical FIF data structure, and represents all time-series data as NumPy arrays for seamless integration with the scientific Python ecosystem. The library is built around object-oriented data containers that encapsulate raw, epoched, evoked, and source data with built-in preprocessing and visualization methods. The
Loads and saves epochs, evoked responses, forward solutions, source estimates, and other analysis objects from disk.
This project is a Java-based object-relational mapping framework that utilizes the active record pattern to simplify database interactions. It provides a comprehensive data access layer that binds database tables directly to application objects, enabling developers to perform CRUD operations, manage complex entity relationships, and execute queries through a fluent, type-safe interface. Designed for integration with Spring Boot, the framework abstracts database complexities while maintaining support for native compilation and asynchronous execution. The framework distinguishes itself through
Distributes database traffic across primary and replica nodes based on query intent to optimize performance.