sharkdp/hyperfine
Hyperfine
Hyperfine is a command-line benchmarking tool used to measure the execution time of shell commands through multiple runs and statistical analysis. It functions as a comparative benchmarking utility and a shell performance analyzer, allowing for the evaluation of multiple commands against a reference baseline to determine relative speed.
The tool distinguishes itself by isolating actual command performance through shell overhead correction and the ability to bypass the shell entirely using system calls. It supports parameterized execution, enabling benchmarks to run across a range of varying input parameters to analyze how specific changes impact execution speed.
The system manages the full benchmark lifecycle, including environment preparation through warmup runs and the execution of setup and cleanup hooks. It provides statistical outlier filtering, measurement precision tuning from microseconds to seconds, and the ability to export timing data into structured file formats for external reporting and visualization.
Command output can be managed through piping, inheritance, or redirection to control the data stream of executed programs.
Features
- Command Line Benchmarking - Measures the execution time of shell commands across multiple runs to produce a statistical analysis of performance.
- Command Parameter Scanning - Runs benchmarks across a range of varying input parameters to analyze how specific changes impact execution speed.
- Command Line Tools - Provides a tool for measuring the execution time of shell commands through multiple runs and statistical analysis.
- Execution Profiling - Isolates actual command performance by removing shell startup overhead and controlling the execution environment.
- Shell Overhead Correction - Isolates actual command performance by subtracting the constant startup overhead of the intermediate shell.
- Shell Performance Analysis - Isolates command execution speed by removing shell startup overhead and managing warmup runs.
- Shell-Bypass Execution - Starts child processes directly using system calls to eliminate shell startup overhead from timing measurements.
- Comparative Benchmarking Utilities - Evaluates multiple shell commands against each other using a reference baseline to determine relative speed.
- Comparative Performance Benchmarking - Provides the ability to compare multiple commands against a single reference process to determine relative speed differences.
- Overhead Correction - Measures a null shell operation to subtract the constant overhead of the shell from the total command time.
- Performance Testing and Analysis - Evaluates multiple commands against each other using a reference baseline to determine relative speed differences.
- Software Performance Comparison - Evaluates multiple commands or versions of a program against each other to determine relative speed differences.
- Statistical Sampling Benchmarks - Executes commands repeatedly in a loop to gather a statistical distribution of execution times.
- Command Templates - Replaces placeholders in command strings with a set of values to generate and run multiple benchmark variations.
- Lifecycle Hooks - Runs specific setup and cleanup commands around the core timing loop to ensure a consistent environment.
- Performance Benchmarking - Executes warmup runs or clears caches before timing to ensure consistent and reproducible performance measurements.
- Shell Command Execution - Allows specifying the shell used to run commands or bypassing the shell entirely to reduce startup overhead.
- Lifecycle Management - Provides setup and cleanup hooks to ensure a consistent environment for every benchmark run.
- Test Parameterization - Runs benchmarks across a range of input values to analyze how specific parameter changes impact execution speed.
- Outlier Filtering - Processes collected timing data to identify and remove noise or anomalies from the final performance average.
- Parameterized Execution Timing - Runs commands across a range of varying input parameters to analyze performance impacts.
- Performance Measurement - Supports high-resolution timing from microseconds to seconds and minimizes noise by bypassing intermediate shells.
- Command Line Utilities - Benchmarks command-line performance.
- Performance Analysis Tools - Command-line benchmarking tool with statistical analysis.
- Profiling and Benchmarking - Command-line tool for benchmarking arbitrary shell commands.
- Profiling Tools - Command-line benchmarking tool.
- System Monitoring and Benchmarking - Command-line tool for benchmarking execution time.
- time - Listed in the “time” section of the Awesome Alternatives In Rust awesome list.
