10 个仓库
Utilities for tracking GPU memory and throughput during model inference.
Explore 10 awesome GitHub repositories matching testing & quality assurance · GPU Performance Profilers. Refine with filters or upvote what's useful.
Faceswap is a comprehensive framework for automated media manipulation and neural face synthesis. It provides a modular pipeline that manages the entire lifecycle of facial feature extraction, deep learning model training, and image conversion. By coordinating complex computer vision workflows, the system enables users to map facial identities between source and destination datasets while maintaining structural alignment and lighting consistency across video frames. The project distinguishes itself through a highly extensible plugin-based architecture that handles hardware-accelerated process
Benchmarks graphics hardware by tracking memory usage and throughput across varying batch sizes to refine pipeline performance.
nvtop 是一个基于终端的仪表板,用于监控多个图形处理器和硬件加速器的性能、内存使用率和温度。它作为一个集中式管理工具,用于跟踪单个系统上多个设备的健康状况和计算负载。 该工具通过将系统进程 ID 与硬件资源消耗相关联而脱颖而出,允许用户识别消耗 GPU 资源的特定应用程序。它采用与供应商无关的抽象层,在单个界面中支持来自不同制造商的硬件。 该软件使用基于文本的界面提供实时性能指标和按进程的资源归属。用户可以管理界面布局并通过本地配置文件保存显示偏好,以在会话间保持设置。
Analyzes individual process resource consumption on GPUs to identify bottlenecks and memory leaks.
jetson-inference is a set of libraries and tools for executing optimized deep learning models on embedded GPU hardware. Its primary purpose is to enable real-time computer vision and AI inference at the edge with low latency and high throughput. The project distinguishes itself through high-performance streaming analytics and the ability to execute concurrent AI pipelines on auto-grade silicon. It provides specialized support for multi-sensor stream processing, utilizing zero-copy data transport to load camera frames directly into GPU memory. The codebase covers a broad surface of capabiliti
Analyzes and debugs GPU-accelerated workloads to optimize AI, graphics, and compute performance.
This project is a comprehensive collection of educational examples and reference implementations for building vision and language models using PyTorch. It serves as a deep learning tutorial covering the end-to-end process of developing neural networks, from initial architecture definition to final production deployment. The repository provides detailed guides on implementing a wide range of domain-specific models, including convolutional neural networks for object detection and segmentation, as well as transformer and recurrent architectures for natural language processing. It emphasizes gene
Tracks CPU and GPU utilization and data throughput to identify system-level application bottlenecks.
Lists running GPU processes with PID, user, and memory, and allows termination from the interface.
Measures GPU throughput, utilization, cache hit rates, and memory throughput to identify optimization opportunities.
capa is a binary capability scanner that identifies high-level behaviors and actions an executable can perform, such as network communication or file manipulation. It functions as a malware behavior analysis tool and a MITRE ATT&CK mapping framework, scanning PE, ELF, .NET, and shellcode files through both static analysis and dynamic sandbox report processing. The tool distinguishes itself through a YAML-based detection rule engine that defines detection logic in human-readable files, with conditions expressed as feature combinations and logical operators. It integrates with IDA Pro, Ghidra,
Limits analysis to specific processes by PID when processing dynamic sandbox reports.
btrace 是一个 JVM 动态追踪工具和性能分析器,用于将安全的检测脚本注入正在运行的 Java 虚拟机中,而无需重启进程。它作为一个 Java 代理框架和模型上下文协议(MCP)服务器,将 JVM 诊断操作和追踪工具暴露给大语言模型和 AI 助手。 该项目的独特之处在于通过安全二进制协议实现实时代码注入和字节码级检测。它通过静态安全分析引擎确保生产环境的稳定性,该引擎在脚本编译阶段会拦截不稳定的代码模式(如循环和内存分配)。 该系统涵盖了广泛的可观测性功能,包括方法执行追踪、对象分配跟踪和字段访问监控。它通过延迟指标和执行数据采样提供性能分析,并能发出自定义的 Java Flight Recorder 事件以进行原生分析。 该代理支持灵活的部署策略,包括在启动时引导或使用 fat JAR 包在容器化环境中附加到实时进程。
Includes utilities for tracking GPU memory and throughput during deep learning model inference.
Perfetto is a platform for system-level performance tracing and analysis on Linux and Android. It combines a high-throughput trace recorder, a SQL-based query engine, and a browser-based visualizer into a single toolchain. The platform covers CPU scheduling and call-stack profiling, native and Java heap memory allocation tracking, GPU and graphics events, and system-wide counters such as CPU frequency and power consumption. The architecture decouples trace recording from offline analysis, using a compact protobuf format for event encoding and columnar storage for efficient SQL queries. The we
Organizes GPU traces into timelines by device and process, displaying per-kernel metric tables and details.
regl is a declarative WebGL library that manages graphics state and GPU resources through functional commands instead of manual binding and state tracking. It provides a command-based drawing abstraction where shaders, attributes, and render state are encapsulated into reusable, compiled functions that can be executed efficiently. What sets regl apart is its scoped state inheritance system, which allows nested drawing commands to inherit and override render state from parent scopes for organized rendering. The library automatically recovers from GPU context loss by restoring buffer and textur
Regl collects CPU and GPU timing data and draw call counts per command for rendering performance diagnostics.