pingcap/tidb
Tidb
TiDB is a horizontally scalable, distributed SQL database designed to provide consistent transactional storage and high-performance analytical processing within a single unified architecture. It utilizes a decoupled compute-storage design and a distributed key-value storage layer to ensure horizontal scalability and efficient range-based queries. By employing a consensus-based replication algorithm, the system maintains high availability and automatic failover across multiple nodes and geographical regions.
The platform distinguishes itself through its hybrid transactional and analytical processing capabilities, which allow complex SQL queries to run against replicated columnar data without disrupting primary transactional workloads. It also integrates high-dimensional vector search functionality, enabling semantic similarity queries directly alongside traditional relational data. To support diverse operational needs, the system provides native tools for real-time data streaming, seamless migration from external database systems, and multi-region disaster recovery.
The database is built for cloud-native environments, offering comprehensive lifecycle management through Kubernetes operators that automate deployment, scaling, and rolling upgrades. It maintains compatibility with standard SQL interfaces, allowing applications to connect using common drivers while managing complex concurrency through pessimistic transaction handling. Detailed documentation and command-line utilities are available to assist with cluster orchestration, performance troubleshooting, and the configuration of production-grade topologies.
Features
- Analytical Query Engines - TiDB enables complex SQL queries against replicated columnar data to perform high-speed aggregations and reporting tasks without impacting the performance of primary transactional workloads.
- Data Manipulation Interfaces - TiDB inserts, updates, deletes, or retrieves rows using standard data manipulation language statements and common table expressions to manage information within tables.
- Database Orchestration - Managing the full lifecycle of large-scale database clusters across cloud or container environments with automated scaling and recovery.
- Distributed Databases - Contribute Copy as Markdown View as Markdown Download PDF Compared with the traditional standalone databases, TiDB has the following advantages: - Has a distributed architecture with flexible and elasti
- Distributed Key-Value Stores - Organizes data into sorted key-value pairs across a cluster to provide efficient range-based queries and horizontal scalability.
- Distributed SQL Databases - A horizontally scalable database engine that provides consistent transactional storage and high-performance analytical processing within a single unified architecture.
- Transaction Management - TiDB manages transaction lifecycles by starting, committing, or rolling back changes, and setting isolation levels or savepoints to ensure consistent data states.
- Database Lifecycle Management - TiDB oversees the full lifecycle of database clusters on physical or virtual machines, including deployment, scaling, and parameter configuration using a command-line package manager.
- Consensus Replication Protocols - Uses a distributed consensus algorithm to maintain consistent data replicas across multiple storage nodes for high availability.
- Distributed Consensus Stores - A resilient data layer that uses distributed consensus algorithms to ensure high availability and automatic failover across multiple geographical regions.
- High Availability Architectures - TiDB distributes a single cluster across multiple regions with replicas in different zones to achieve zero data loss and automatic failover during regional outages.
- HTAP Databases - TiDB is an open-source distributed SQL database that supports Hybrid Transactional and Analytical Processing (HTAP) workloads. Find the guide, samples, and references you need to use TiDB.
- Schema Management Tools - TiDB defines and modifies database structures including tables, indexes, and sequences using standard data definition language statements to organize data effectively.
- Database Operators - A management layer that automates the deployment, scaling, and lifecycle maintenance of distributed database clusters within containerized orchestration environments.
- Columnar Storage Engines - TiDB synchronizes transactional data into a columnar storage engine using standard commands to enable real-time analytical processing alongside traditional row-based storage operations.
- Data Ingestion Tools - TiDB loads data from local files or cloud storage providers in common formats like SQL, CSV, and Parquet to populate database tables efficiently.
- Data Replication - TiDB implements disaster recovery by synchronizing data between a primary and a secondary cluster using change data capture to ensure business continuity.
- Database Replication - Contribute Copy as Markdown View as Markdown TiDB uses the Raft consensus algorithm to ensure that data is highly available and safely replicated throughout storage in Raft Groups. Data is redundantly copied
- Database Replication Tools - TiDB transfers full datasets and replicates incremental changes from external database systems into the cluster to support seamless data integration and synchronization.
- Disaster Recovery Solutions - Ensuring business continuity by replicating data across geographically distributed clusters to maintain high availability during regional outages.
- Hybrid Transactional Analytical Platforms - A data processing environment that executes complex analytical queries directly against live transactional data without requiring separate extract and load pipelines.
- Hybrid Transactional Analytical Processing Systems - Running complex analytical queries on live transactional data without needing to maintain separate databases for reporting and operations.
- Transaction Control Systems - TiDB reviews behavioral differences in locking and transaction handling compared to traditional storage engines to ensure correct concurrency control in distributed environments.
- Cluster Scaling Orchestrators - TiDB adds capacity to a running cluster by defining new node configurations in a file and executing scale-out commands without interrupting online services.
- Kubernetes Operators - TiDB applies configuration manifests to a container cluster to automate the deployment and orchestration of database components and their associated monitoring services.
- Backup and Recovery - Performs logical, parallel backups with CSV output support.
- Data Storage and Search - Distributed HTAP database compatible with the MySQL protocol.
- Database Drivers and ORMs - Distributed SQL database compatible with MySQL protocols.
- Database Engines - Distributed SQL database inspired by Google F1.
- Database Systems - Distributed NewSQL database compatible with MySQL.
- Database Tools - Distributed relational database.
- 数据库 - Distributed SQL database inspired by Google F1.
- Databases and Analytics - Distributed scalable HTAP database.
- Databases and Storage - A distributed relational database compatible with the MySQL protocol.
- NewSQL Databases - Distributed SQL database inspired by Google F1 architecture.
- Relational Databases - Distributed SQL database inspired by Google F1 architecture.
- Storage Systems - Distributed SQL database compatible with MySQL.
- Server and Infrastructure - Provides a distributed HTAP database compatible with the protocol.
- Go Projects - Listed in the “Go Projects” section of the Awesome For Beginners awesome list.
- Backup and Recovery - TiDB performs regular data and log backups to a remote location to enable cluster restoration as a final recovery measure during site failures.
- Database Migration Tools - TiDB transfers data from external or self-managed databases to the cloud using native migration tools and data merging techniques to ensure a smooth transition.
- Sharding Architectures - Partitions data into multiple independent consensus groups to enable parallel processing and granular load balancing across nodes.
- Custom Resource Definitions - TiDB deploys operator software and custom resource definitions into a container cluster to manage database resources using standard command-line tools.
- Distributed Architectures - Separates the SQL processing layer from the underlying storage nodes to allow independent scaling of resources.
- Bulk Data Loading - TiDB loads high volumes of data into database clusters from various file formats to support rapid data ingestion and large-scale migration projects.
- Change Data Capture - TiDB transmits data from a database cluster to external services like message queues or cloud storage by configuring and managing automated replication tasks.
- Change Data Capture Tools - Monitors and extracts real-time data modifications from the storage layer to propagate updates to external downstream systems.
- Disaster Recovery Strategies - TiDB integrates multi-region cluster deployments with cross-cluster data replication to provide high-level error tolerance across geographical regions for critical systems.
- Resource Governance - TiDB allocates cluster resources by creating and managing resource groups to estimate capacity requirements and control query execution performance.
- Vector Database Extensions - Storing and querying high-dimensional embeddings directly within a relational database to enable semantic search capabilities alongside structured data.
- Vector Databases - A storage engine that integrates high-dimensional vector embeddings to perform semantic similarity searches alongside traditional relational data queries.
- Database Connectivity Drivers - TiDB establishes secure communication between applications and the database using standard drivers to ensure reliable data exchange across various programming languages and environments.
- Database Export Utilities - TiDB extracts full database contents into SQL or CSV files from active clusters to facilitate archival, backup, or migration workflows.
- Migration Analysis Tools - TiDB detects incompatible database features, such as specific stored procedures or triggers, to ensure application compatibility when moving to a distributed database environment.
- Local Development Clusters - TiDB creates a local test cluster on a single machine using command-line tools to learn about database architecture and component operations for development purposes.
- Rolling Update Orchestrators - TiDB executes a rolling upgrade of a database cluster by patching the resource specification to trigger the sequential update and restart of all components.
