1 repo
Awesome GitHub RepositoriesInference Abstractions
Software layers that decouple machine learning detection logic from specific hardware backends.
Distinguishing note: Focuses on hardware-agnostic inference engines rather than model training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Inference Abstractions. Refine with filters or upvote what's useful.
Awesome Inference Abstractions GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- blakeblackshear/frigate
blakeblackshear/frigate
30,344View on GitHubFrigate is a self-hosted network video recorder that functions as a private, local AI-powered vision engine. It manages video streams by performing real-time object detection, tracking, and classification directly on local hardware, ensuring that security monitoring and activity recording remain independent of cloud services. The system distinguishes itself through a modular, hardware-accelerated video pipeline that offloads intensive decoding and machine learning inference to dedicated GPUs, NPUs, or specialized accelerators like Coral TPUs and Hailo modules. It utilizes state-based object t
Decouples detection logic from specific hardware backends to support diverse accelerators like TPUs and integrated graphics processors.
TypeScriptaicameragoogle-coral
