dromara/dynamic-tp
Dynamic Tp
Dynamic Thread Pool is a Java framework for the dynamic management, observability, and orchestration of thread pools. It allows for the real-time adjustment of thread pool parameters via external configuration centers without requiring application restarts.
The project distinguishes itself by providing middleware orchestration, enabling the interception and tuning of thread pools embedded within third-party web servers and RPC frameworks. It further supports distributed tracing by propagating execution contexts and metadata from submitting threads to worker threads to maintain observability across asynchronous boundaries.
The framework includes a comprehensive monitoring and alerting system that gathers performance metrics and triggers notifications via multi-channel dispatch. It features a threshold-based alerting engine with sliding-window suppression to prevent alert storms and a time-wheel mechanism to monitor execution timeouts.
The system integrates with a wide range of middleware and infrastructure, including Tomcat, Jetty, Undertow, Dubbo, gRPC, Hystrix, and message brokers like RabbitMQ and RocketMQ.
Features
- Dynamic Thread Pool Adjusters - Provides tools for modifying thread pool parameters in real-time via external configuration centers.
- Concurrency Observability Tools - Provides a framework for exporting thread pool metrics and propagating tracing context across asynchronous execution boundaries.
- Thread Pool Context Propagators - Provides mechanisms for propagating thread-local context and tracing identifiers from submitting threads to worker threads.
- Dynamic Configuration Updates - Integrates with external configuration stores to enable real-time parameter updates without restarting the application.
- Custom Thread Pool Configurations - Enables the creation and definition of thread pool instances via code or configuration centers.
- Dynamic Thread Pool Proxies - Implements interceptors to apply runtime parameter changes and collect metrics from third-party thread pools.
- Dynamic Thread Pool Managers - Provides centralized management and runtime adjustment of thread pool parameters without application restarts.
- Middleware Pool Orchestration - Applies dynamic tuning and monitoring to thread pools embedded within third-party web servers and RPC frameworks.
- Configuration Store Integrations - Syncs runtime parameters with external stores like Nacos, Apollo, or Zookeeper to manage concurrent task execution.
- Runtime Parameter Injection - Allows real-time adjustment of thread pool core size and queue capacity via external configuration centers.
- Alert Thresholds - Monitors performance metrics against predefined numerical limits to trigger system notifications.
- Distributed Tracing Contexts - Propagates trace IDs and metadata across asynchronous boundaries to maintain distributed observability.
- Java Runtime Monitors - Collects real-time JVM performance metrics and triggers alerts on queue capacities and execution timeouts.
- Execution Timeout Monitoring - Tracks task queueing and processing duration using a time-wheel mechanism to detect execution timeouts.
- Execution Timeout Management - Tracks queueing and execution duration using a time-wheel mechanism to trigger alerts or interrupt threads.
- Dynamic Capacity Adjustment - Enables modifying the blocking queue size at runtime to handle fluctuating workloads.
- Thread Pool Anomaly Alerters - Triggers notifications when thread pool queue capacity or execution timeouts exceed configured thresholds.
- Duplicate Alert Suppression - Prevents alert storms by suppressing redundant notifications using a time-based sliding window.
- Thread Pool Metrics Collection - Gathers performance indicators via logging, JMX, or HTTP endpoints to track pool health and behavior.
