Awesome GitHub RepositoriesEmbedded AI Deployment

OpenCat-Quadruped-Robot 是一个用于构建四足机器人的开发框架和运动控制 API。它提供了一个全面的四足机器人开发环境，具有步态设计、逆运动学，以及将高级智能与低级运动分离的分层控制架构。 该项目作为一种嵌入式 AI 部署工具脱颖而出，允许用户训练、量化机器学习模型并将其部署到视觉模块，以执行对象检测和视觉目标跟踪等任务。它还通过离线语音命令处理、人体运动模仿以及用于图形逻辑生成的视觉块编程界面，支持复杂的人机交互。 该系统涵盖了广泛的功能面，包括通过 IMU 数据实现的实时平衡稳定、使用 3D 相机的自主导航，以及通过蓝牙和 WiFi 的各种远程控制接口。它还包括用于机器人步态模拟、强化学习策略迁移的工具，以及用于外部软件集成的专用 Python API。 固件管理通过一套部署工具处理，支持主板和微控制器模块的 USB、蓝牙和无线 (OTA) 更新。

ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,

IREE is an MLIR-based compiler toolchain and runtime designed to translate machine learning models from various frameworks into optimized binaries for execution across diverse hardware targets. It provides a unified pipeline to ingest models from PyTorch, TensorFlow, JAX, and ONNX, lowering them into a common intermediate representation for deployment on CPUs, GPUs, and bare-metal embedded systems. The project distinguishes itself through a bytecode virtual machine and a hardware abstraction layer that decouple high-level model logic from specific hardware instruction sets. It supports sophis