1 repo
Support for offloading machine learning model inference to AMD graphics hardware via the ROCm stack.
Distinguishing note: Specifically targets AMD hardware acceleration, distinct from general-purpose GPU or NPU support.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · AMD Hardware Acceleration. Refine with filters or upvote what's useful.
Whisper.cpp is a high-performance, local-first speech recognition engine designed to run large-scale machine learning models on consumer hardware. It functions as a portable library that converts audio into text, supporting both static file transcription and real-time stream processing. By utilizing a lightweight inference engine and weight quantization, the project minimizes memory and compute overhead, allowing for efficient execution without reliance on external cloud APIs or internet connectivity. The project distinguishes itself through a hardware-agnostic compute abstraction that offloa
The project utilizes AMD graphics hardware for high-performance model inference by offloading compute-intensive operations to the vendor-specific software stack.