Awesome GitHub RepositoriesAI Integration Tools

Flow is an orchestration framework for designing and executing complex workflows using autonomous agents powered by large language models. It serves as a toolkit for constructing agentic pipelines and a runtime for managing agent lifecycles, session states, and tool execution. The project is distinguished by its support for hierarchical swarm management, where director agents decompose large projects into smaller tasks for specialized worker agents. It enables multiple coordination patterns, including sequential linear pipelines and concurrent execution where agents analyze tasks from differe

This is a full-featured chatbot framework and Next.js web application designed for integrating various large language model providers into a web interface. It serves as a template for building AI chatbots that can generate text and structured data through a unified interface. The project functions as an authenticated AI application, incorporating built-in user identity verification and session management. It includes a suite for AI tool integration, allowing language models to execute tool calls and generate structured objects by connecting to external data and functions. The framework provi

Agentic is a tool marketplace and management platform designed for the Model Context Protocol. It provides a gateway and proxy that enables the discovery, publishing, and distribution of vetted tools for agentic AI frameworks. The platform specializes in Model Context Protocol monetization, allowing developers to transform services into paid products through integrated authentication, usage-based billing, and subscription management. It also includes a converter that transforms OpenAPI specifications into compatible protocol servers for use in AI workflows. The system covers a broad range of

This project is an on-device AI SDK providing a framework for running large language models, vision models, and speech models locally. It serves as an orchestration layer for local LLM execution, ensuring data privacy and offline availability by utilizing hardware acceleration on the device. The SDK is distinguished by its comprehensive voice and multimodal capabilities, including a coordinated voice pipeline for activity detection, speech-to-text, and text-to-speech synthesis. It also provides a dedicated implementation kit for local retrieval-augmented generation and tools for processing co

Cactus 是一个端侧 AI 推理引擎，专为在移动和可穿戴硬件上执行大语言模型、视觉模型和语音转文字系统而设计。它提供了一个用于定义矩阵运算和激活函数序列的可编程张量计算图，以及一个利用本地文本文件为模型响应提供依据的本地检索增强生成（RAG）框架。 该项目具有一个多平台 SDK，包含用于将 AI 功能集成到移动应用程序中的语言绑定，以及一个将外部模型格式转换为优化本地执行的模型转换系统。它利用混合路由系统，根据硬件容量在端侧执行和云端提供商之间重定向工作负载。 该引擎涵盖了广泛的功能面，包括用于语音活动检测和转录的端侧音频处理、用于相似性搜索的向量嵌入生成，以及用于将模型输出解析为外部函数调用的工具集成。这些过程由针对移动硬件低延迟性能优化的原生内核提供支持。

This project is a Llama Stack agentic framework and orchestrator used to build autonomous AI applications. It coordinates model inference and tool execution to decompose complex goals into multi-step reasoning chains and continuous inference loops. The framework incorporates a dedicated safety guardrail system that filters model inputs and outputs through safety models to enforce system-level content restrictions. It also includes a tool integration layer that maps model-generated function requests to external runtime definitions to execute actions beyond text generation. The system provides