Awesome GitHub RepositoriesProgrammatic Model Invocation

ChatGLM-6B is a generative AI inference engine designed for local execution of transformer-based language models. It provides a comprehensive runtime environment that allows users to load and run pre-trained neural network weights directly on their own hardware, ensuring data privacy and independence from external cloud services. The project distinguishes itself through a hardware-agnostic execution backend that supports deployment across diverse environments, including standard processors, Apple Silicon, and multi-GPU configurations. It incorporates advanced optimization techniques such as w

Aigcpanel is a visual workflow automation tool and model lifecycle manager designed for generative AI media pipelines. It provides a unified interface to install, launch, and configure both local and remote AI model endpoints, acting as an orchestration platform for large language models and AI tools. The system features a drag-and-drop node editor for chaining AI models and scripts into automated processing pipelines. It distinguishes itself with a breakpoint-aware execution model that allows users to pause and resume long media tasks from specific points in the workflow. Additionally, it in

ollama-js 是一个 JavaScript 客户端库和 API 封装器，提供了一个用于交互和管理大语言模型的编程接口。它支持在本地和云端环境中执行模型，促进了对话文本的生成和模型生命周期的管理。 该项目通过提供专门的模型管理工具脱颖而出，包括下载、创建和删除模型的能力，以及定义自定义模型蓝图和提示词模板的能力。它还提供了一个向量嵌入客户端，用于生成数值文本表示，以支持语义搜索和检索流水线。 该库涵盖了广泛的功能，包括用于处理图像的多模态分析、内部推理轨迹的捕获以及用于数据提取的结构化 JSON 模式的强制执行。它进一步通过工具调用和通过异步生成器流式传输响应，支持高级模型交互。 该库使用 TypeScript 编写。