Awesome GitHub RepositoriesCommand-Line

ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using a unified interface for datasets and agents. It functions as a PyTorch-based training platform and a dialogue data collection system, providing a centralized model zoo for the distribution of versioned pretrained agents. The project distinguishes itself through a knowledge-grounded retrieval system that combines dense and sparse indexing to ground responses in external information. It also provides a comprehensive infrastructure for gathering human-AI interaction data via inte

OpenChatKit is a training and inference toolkit for large language models. It provides a comprehensive set of tools for managing the model lifecycle, including a fine-tuning pipeline, a model weight converter, and a command-line interface for interacting with conversational agents. The toolkit features a framework for retrieval augmented generation, allowing models to incorporate relevant context from external vector indices. It also includes utilities for converting trained model checkpoints into formats compatible with standard inference libraries. The project covers conversational AI trai

llama-rs 是一个用 Rust 实现的本地大语言模型推理引擎。它支持在本地硬件上执行模型计算，以根据用户提示生成文本响应。 该项目利用基于 Rust 的张量运算和直接内存模型映射来处理高性能线性代数和高效的权重加载。它结合了权重量化，通过将高精度权重转换为较小格式来减小模型的内存占用。 该系统包括用于交互式聊天会话和一次性提示的命令行界面，以及用于保存和恢复对话历史的文件备份会话持久化。它还提供用于从远程中心检索分词器配置的实用程序，以及用于计算困惑度分数以评估模型性能的工具。