3 个仓库
Utilities for transforming model weights into optimized formats for specific inference runtimes.
Distinct from Model Inference Optimizations: Distinct from Model Inference Optimizations: focuses on the transformation pipeline rather than the optimization techniques themselves.
Explore 3 awesome GitHub repositories matching artificial intelligence & ml · Model Conversion Tools. Refine with filters or upvote what's useful.
ChatGLM3 is a comprehensive framework for deploying, fine-tuning, and serving large language models. It functions as a high-performance inference engine designed to support conversational AI, enabling developers to build interactive agents capable of multi-turn dialogue, autonomous code execution, and structured tool invocation. The project distinguishes itself through its focus on hardware-agnostic deployment and resource optimization. It supports distributed model parallelism across multiple graphics cards, paged key-value caching for concurrent request processing, and weight quantization t
Transforms standard language models into optimized intermediate representations to improve execution speed and reduce memory usage.
OpenChatKit is a training and inference toolkit for large language models. It provides a comprehensive set of tools for managing the model lifecycle, including a fine-tuning pipeline, a model weight converter, and a command-line interface for interacting with conversational agents. The toolkit features a framework for retrieval augmented generation, allowing models to incorporate relevant context from external vector indices. It also includes utilities for converting trained model checkpoints into formats compatible with standard inference libraries. The project covers conversational AI trai
Includes utilities for transforming trained model checkpoints into formats compatible with standard inference libraries.
该项目是 RetinaNet 架构的深度学习实现,用于图像中的对象检测和分类。它构建为 Keras 对象检测框架和 TensorFlow 计算机视觉工具,提供了基于 RetinaNet 论文的完整神经网络实现。 该框架包含特征金字塔网络(Feature Pyramid Network)和用于处理对象检测的焦点损失函数(focal loss function)等专用组件。它具有可配置的主干架构和基于锚点(anchor-based)的边界框,可预测不同尺度和长宽比下的对象位置。 该工具集涵盖了计算机视觉的端到端工作流,包括训练例程、性能评估和模型推理部署。它提供数据管理实用程序,用于从 CSV 和 Pascal VOC 格式导入和调试图像标注,以及将训练好的模型转换为不同格式以进行部署的工具。
Transforms trained regression and classification networks into optimized formats suitable for object detection inference.