datacharmer/test_db
Test Db
test_db is a collection of tools for validating database integrity, benchmarking system throughput, and generating synthetic schemas and datasets. It includes a sample corporate employee database for MySQL, a SQL dataset generator for creating representative records, and an integrity validator that uses checksums and record counts to verify data consistency across different database engines.
The project provides a database performance benchmark consisting of complex queries and stored procedures designed to measure system response times and throughput. These tools simulate real-world workloads through multi-table joins and aggregations.
The toolset covers broad capability areas including database schema simulation, synthetic data generation, and data load testing. It specifically measures data load duration by calculating the elapsed time from the initial table creation to the final update.
Features
- Database Integrity Verification - Provides a tool that uses checksums and record counts to verify data consistency across different database engines.
- General Synthetic Data Generators - Populates database tables with representative records to simulate real-world workloads for software testing.
- Sample Datasets - Provides scripts and pre-defined datasets for populating database tables for performance benchmarking.
- Environment Simulation Schemas - Creates tables, views, and stored procedures to simulate corporate database environments for testing.
- Database Population Tools - Provides tools for populating database tables with large, pre-configured datasets from external dumps.
- Dataset Generation Scripts - Provides a series of scripts that populate database tables with representative records to simulate real-world workloads.
- Join Performance Benchmarking - Evaluates system throughput by executing complex aggregation queries that force heavy resource usage across multiple tables.
- Environment Simulation - Creates tables, views, and stored procedures to build consistent environments for testing application logic.
- Data Integrity Verification - Uses checksums and record counts to ensure datasets remain consistent across different database engines.
- Data Integrity Checksums - Implements checksum-based verification to ensure data consistency across different database engines.
- Query Performance Benchmarks - Measures system response times and throughput using complex queries and aggregations on standardized datasets.
- Load Testing - Evaluates the efficiency of data ingestion by measuring the time required to create schemas and populate tables.
- Logic Deployment - Enables the deployment of stored procedures and functions to simulate complex server-side business logic.
- Sample Databases - Ships a sample corporate employee database for MySQL used for testing and benchmarking.
- SQL Script Execution - Executes predefined SQL scripts from external files to provision database tables and views.
- Stored Procedures - Deploys complex functions and stored procedures to simulate server-side business logic.
- Data Load Duration Measurement - Calculates the total elapsed time from initial table creation to final update to evaluate load efficiency.
- Data Load Durations - Calculates the total elapsed time from initial table creation to the final update to evaluate data ingestion efficiency.
