rqlite/rqlite
Rqlite
rqlite is a distributed relational database that replicates SQLite data across a cluster using the Raft consensus algorithm. It functions as a fault-tolerant storage system that provides high availability and a web API for executing SQL queries and managing relational data without requiring native database drivers.
The system distinguishes itself by using an HTTP SQL interface to expose database operations and cluster management. It features a real-time change data capture stream that pushes database mutations to external HTTP endpoints via webhooks and supports the scaling of read throughput through non-voting read replicas.
The project covers a broad range of distributed capabilities, including automated cluster discovery via DNS or Consul, TLS-encrypted transport for inter-node communication, and atomic request execution. It also includes tools for point-in-time snapshot backups, node health monitoring, and cluster leadership transfer.
Features
- Distributed Relational Databases - Functions as a replicated relational database system designed for horizontal scaling and high availability.
- Raft Consensus Implementations - Uses the Raft consensus algorithm to synchronize writes and maintain consistent state across the cluster.
- Change Data Capture Streams - Tracks database mutations and pushes real-time updates to external webhooks via a dedicated streaming mechanism.
- Database APIs - Exposes a web API for executing SQL queries and managing relational data without requiring native drivers.
- Data Replication - Distributes data across a cluster to ensure continuous service and availability during individual node outages.
- Distributed Implementations - Replicates SQLite data across a cluster using a consensus algorithm for fault-tolerant relational storage.
- Distributed Consensus Stores - Persists data changes using a consensus algorithm to maintain consistency across all nodes in a cluster.
- Fault Tolerant Storage - Maintains a consistent data store by combining local storage with a consensus algorithm for high availability.
- High Availability Configurations - Ensures continuous service availability through a replicated data store that survives individual node failures.
- HTTP-to-SQL Mappers - Translates HTTP requests and RESTful operations directly into SQL queries for remote database interaction.
- SQL Execution Interfaces - Provides a web API for executing read and write SQL statements without requiring native database drivers.
- Relational Data Storage - Retrieves relational data with configurable consistency levels to balance read speed against data freshness.
- Remote Database APIs - Allows remote clients to retrieve or update stored information via a web API.
- Storage Engines - Provides full SQL support including JSON and full-text search via a replicated storage engine.
- Database Management Interfaces - Exposes database operations and cluster management through a RESTful API for remote client interaction.
- Backup & Recovery - Schedules and saves database snapshots to local files or cloud storage systems for disaster recovery.
- Database Atomic Batches - Ensures multiple database statements within a single call succeed or fail as a single unit.
- Change Data Capture - Streams database modifications in real time to external systems via webhooks for immediate data synchronization.
- Write Throughput Optimizations - Improves write performance using queued writes and maintains storage efficiency through automatic vacuuming.
- Consistency Tuning - Allows adjusting consistency levels for read requests to balance data freshness with system response speed.
- Point-In-Time Snapshots - Creates consistent database images for recovery by capturing the current state of the storage engine.
- Embedded Storage Engines - Uses an embedded SQLite engine to manage local data persistence on each cluster node.
- Cluster Node Management - Manages the lifecycle of the cluster by handling the addition and removal of nodes and discovery.
- Automated Node Discovery - Automates cluster formation by resolving peer addresses through DNS, Consul, or etcd during boot.
- Non-Voting Read Replicas - Scales read throughput by deploying non-voting nodes that replicate data without participating in consensus.
- Cluster Discovery Mechanisms - Automates the setup of distributed environments by identifying peer nodes using DNS, Consul, or etcd.
- Database Access Controls - Controls database access using authentication, hashed passwords, and granular user-level permissions.
- Traffic Encryption - Secures data in transit using TLS and supports mutual TLS with automatic certificate reloading.
- Transport Layer Security - Secures inter-node communication and client requests using TLS with support for mutual authentication.
- Distributed Coordination Systems - Automates the discovery and formation of database clusters using tools like Kubernetes, Consul, or DNS.
- Database Engines - Lightweight, distributed relational database built on SQLite.
- Database Systems - Listed in the “Database Systems” section of the Awesome Go awesome list.
- Database Tools - Lightweight distributed relational database.
- Datenbanken - Distributed relational database built on SQLite.
- Relational Databases - Replicated SQLite using the Raft consensus protocol.
- SQLite-based Distributed Database - Listed in the “SQLite-based Distributed Database” section of the Awesome Sqlite awesome list.
