1 repo
Tools for scraping and reporting performance metrics from service endpoints.
Distinguishing note: Focuses on inference-specific performance monitoring.
Explore 1 awesome GitHub repository matching system administration & monitoring · Telemetry and Monitoring Agents. Refine with filters or upvote what's useful.
Modular is a unified machine learning development platform designed for building, compiling, and deploying high-performance neural network models. It provides a comprehensive execution engine that supports both local and production-grade inference, enabling developers to manage the entire model lifecycle from initial architecture definition to scalable, containerized service deployment. The platform distinguishes itself through a hardware-agnostic runtime that abstracts diverse silicon architectures, allowing models to execute efficiently across varied compute environments. It includes a spec
Monitors inference performance and usage statistics by scraping formatted metrics from a dedicated endpoint.