httprunner/httprunner

Features

• API Testing - Provides a comprehensive framework for validating the functionality, performance, and integration of API interfaces.
• Automated API Testing - Automates functional and regression tests for HTTP interfaces using structured data and scripted validation.
• Multi-Protocol Network Testers - The project validates diverse network communication patterns using HTTP, WebSocket, TCP, and RPC.
• API Testing Frameworks - A framework for automating functional and regression tests of HTTP interfaces using structured data and scripting.
• Custom Test Logic Integrators - Supports integrating external scripts in multiple languages to handle complex business logic during tests.
• API Test Case Generators - Transforms HAR files, Postman collections, Swagger definitions, and curl commands into executable test scripts.
• Multi-Language Plugin Frameworks - Implements a plugin architecture supporting extensions written in Go, Python, and Java.
• Network Protocol Testing - Executes functional and performance tests for network protocols to validate consistent and reliable system behavior.
• Multi-Protocol Functional Tests - Runs functional tests across multiple communication protocols to ensure network data transfers correctly between systems.
• Multi-Protocol Transport Abstraction - Provides a unified internal interface to abstract interactions across HTTP, WebSocket, TCP, and RPC protocols.
• Plugin-Based Logic Extensions - Allows loading external scripts and binaries to execute custom logic during the request lifecycle.
• Framework Extension Points - Provides customizable hooks and plugin functions to extend the core framework logic.
• Load Simulation Testing - The project executes high-concurrency stress tests using a high-performance engine to simulate thousands of virtual users.
• API Regression Testing - Runs automated interface tests across business lines to verify functional requirements and improve regression efficiency.
• Automated Performance Testing - The project runs stability and speed evaluations through a command line interface using diverse execution strategies.
• Data-Driven Testing - Executes test cases repeatedly using external datasets from CSV or JSON files to validate diverse input scenarios.
• Distributed Load Generation - Coordinates controller and worker nodes to generate high-concurrency traffic for system stability and performance measurements.
• Distributed Performance Testing Engines - Coordinates worker nodes to simulate concurrent users and distributed load for system stability measurement.
• Scenario Sequence Management - Coordinates data flow between interdependent calls using extractors and variables to build linked test scenarios.
• Concurrency Burst Testing - The project executes high-volume request bursts using a high-speed engine to measure system behavior under stress.
• Performance Testing Frameworks - Provides a framework to measure system stability and response times under high concurrent load.
• Response Parameter Extraction - Parses response data using queries and regular expressions to pass values between subsequent test steps.
• API Scenario Orchestrations - Creates dependent request chains and sophisticated test workflows using variables and data extraction.
• Variable Scope Management - Manages the lifecycle and visibility of test variables across different scopes to maintain flexible configurations.
• Test Execution Reports - The project creates documents that summarize execution metrics and provide detailed logs of requests and responses.
• Sequential Test Executions - Executes network requests in a specific order to simulate user behavior and maintain transaction boundaries.
• User Workflow Modeling - Builds intricate testing workflows and data-driven scenarios using variables and validation hooks to simulate user behavior.
• User Workflow Simulation - Simulates complex real-world user interactions through multi-step test scenarios using variables and validation rules.
• Virtual User Simulation - The project stress tests system capacity by mimicking high volumes of virtual users via a distributed execution engine.
• API Response Validation - Verifies that API response fields and status codes match expected results using extraction and comparison logic.
• Performance Metric Aggregators - The project groups multiple interface requests into a single transaction to measure performance based on real-world scenarios.
• Test Definition Conversions - Transforms test definitions between YAML, JSON, and native formats for cross-tool compatibility.
• Test Suites - Groups multiple test cases into a single collection for batch execution from files or directories.
• CI Pipeline Integrations - Integrates automated test suites into CI pipelines to validate modules and prevent regressions during code commits.
• HTTP/2 Support - The project runs requests using the HTTP/2 protocol to verify the performance and functional behavior of web services.
• HTTP Request Performance Analysis - The project collects detailed timing metrics for DNS resolution, TCP connection, and SSL handshaking during requests.
• Multi-Protocol HTTP Support - The project checks if a server communicates via HTTP/2 or HTTP/1.1 to ensure correct protocol negotiation.
• WebSocket Connection Management - The project establishes connections with custom parameters, handles heartbeats, and closes sessions with specific status codes.
• HAR File Parsers - Converts exported HTTP Archive (HAR) files into automated test cases for rapid reproduction of network traffic.
• WebSocket Data Assertions - The project extracts parameters from responses and performs assertions on returned data to verify communication correctness.
• Environment Variable Sets - Manages sets of fixed variables to ensure consistency across different deployment environments.
• Geographic Probes - The project probes domains and resource requests from specific geographic regions to optimize network latency.
• Latency Metrics - The project captures detailed latency data for DNS resolution, TCP connection, and data transmission.
• Synthetic User Monitoring - The project simulates user behavior using real devices and global networks to identify issues and causes.
• Request Burst Synchronization - The project forces virtual users to wait at a rendezvous point before triggering simultaneous requests to simulate spikes.
• Traffic Weight Configuration - The project defines virtual user weights for specific test cases to simulate realistic traffic distribution during load testing.
• CI Integration Testing - Integrates automated API test suites into CI pipelines to detect regressions during commits.
• CI Test Execution - Automatically executes specific test modules whenever code is committed to a version control system.
• API Request Configurations - Sets shared domains and request headers to be used globally across multiple test modules.
• Setup and Teardown Hooks - Includes hooks to execute setup and teardown functions for resource allocation and cleanup around test steps.
• Interface Latency Profiling - The project measures timing for DNS, TCP, TLS, and server processing to identify the cause of slow API responses.
• Localized Payment Testing - Tests payment flows using regional methods and local networks to identify checkout failure points.
• Schema-Driven Definitions - Transforms structured YAML and JSON data formats into executable sequences of network request steps.
• Request-to-Test Conversions - Turns captured network requests directly into executable test scenarios to accelerate the creation of test suites.
• CLI Test Runners - Provides a command-line interface for executing automated interface and performance test suites.
• Pytest Wrappers - Wraps the core testing engine within a standard pytest runner for improved CLI control and reporting.
• Test Scenario Synchronization - Synchronizes test data and scenarios to enable reuse across both functional and performance testing domains.
• API Test Collections - Groups API tests into hierarchical collections organized by functional module or service for better management.
• User Behavior Simulation - The project inserts fixed or random delays between test steps to mimic real human interaction and browsing behavior.
• WebSocket Interface Testing - The project performs full-duplex communication by opening connections, sending messages, and closing sessions.

Star history