30 open-source projects similar to aallam/openai-kotlin, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
This is an asynchronous Swift client library for calling OpenAI’s API across Apple platforms. It provides native access to chat completions, image generation and editing, speech synthesis and transcription, text embeddings, and content moderation through a single interface built on Swift’s async-await concurrency model. The client supports structured output generation by constraining model responses to a provided JSON schema, and enables real-time consumption of generated text through streaming responses delivered as an AsyncSequence. It includes a thread-based conversation model for managing
This project is a PHP API client and SDK for integrating OpenAI services into PHP applications. It serves as an integration library and wrapper for interacting with large language models to generate text, images, and audio via REST API calls. The library provides specialized orchestration for AI assistants, managing conversation threads and vector stores. It also includes tools for custom model fine-tuning, semantic search implementation through text embeddings, and audio processing for transcription and synthesis. The capability surface covers content moderation, file management, and the ha
openai-go is an LLM SDK for Go and a client for interacting with OpenAI services. It provides type-safe bindings to generate text, images, and audio via REST endpoints, enabling the integration of large language models and AI assistant orchestration into Go applications. The library serves as an agent orchestration tool for managing stateful conversation threads and autonomous agents with integrated tool calling and file search. It also functions as an asynchronous batch processing client for monitoring large-scale request groups and fine-tuning jobs, alongside a management SDK for controllin
This project is a Go library that provides a programmatic interface for interacting with generative AI services. It serves as a comprehensive software development kit for integrating large language models into applications, enabling developers to perform tasks such as text and chat completion, image generation, and audio transcription. The library distinguishes itself through a unified infrastructure designed for robust network communication and service management. It features structured request mapping and error normalization to ensure type-safe interactions and simplified debugging. Further
This project provides a unified server environment and gateway for hosting and executing open-source large language models on private infrastructure. It functions as a standardized interface that exposes locally deployed models through widely-adopted API protocols, allowing existing applications to interact with them without requiring code modifications. The platform distinguishes itself by acting as a compatibility layer that translates standard REST requests into model-specific execution calls. It supports advanced interaction patterns including real-time token streaming, function calling f
OpenGPTs is a platform for building, deploying, and managing customizable AI assistants. It serves as an orchestrator that allows for the configuration of large language models with specific personas, cognitive architectures, and tool integrations. The system provides a complete lifecycle manager for AI agents, enabling the drafting of configurations, testing within sandboxes, and publishing assistants for public or internal distribution. It integrates a knowledge base interface using retrieval-augmented generation to attach documents to bots for context-aware responses. The platform covers
openai-java is a Java client library and software development kit designed to integrate OpenAI services into Java applications. It functions as a programmatic wrapper for large language model endpoints, enabling the implementation of generative AI capabilities such as chat completions, text embeddings, and the orchestration of AI agents. The library supports a wide range of multimodal tasks, including the generation and editing of images, as well as audio transcription and translation. It provides specialized tools for model training and fine-tuning, allowing users to upload datasets to impro
Cactus is an on-device AI inference engine designed for executing large language models, vision models, and speech-to-text systems on mobile and wearable hardware. It provides a programmable tensor computation graph for defining sequences of matrix operations and activation functions, alongside a local retrieval augmented generation framework that grounds model responses using local text files. The project features a multiplatform SDK with language bindings for integrating AI capabilities into mobile applications and a model conversion system that transforms external model formats for optimiz
This project is an Android application that integrates OpenAI language models to provide real-time conversational AI experiences. It functions as a native mobile client, enabling users to send queries to remote language services and view the resulting text responses within an interactive chat interface. The application utilizes a declarative user interface framework to build dynamic messaging layouts and manage conversation states. It employs a component-based architecture that separates UI logic from network communication, ensuring that messaging components remain modular and decoupled from
Deepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai
LangChain.js is a framework for building, executing, and monitoring stateful agentic applications. It provides an orchestration engine that models workflows as directed graphs, allowing developers to connect language models, data sources, and external tools into modular, multi-step processes. The platform distinguishes itself through its focus on stateful execution and human-in-the-loop control. It manages agent lifecycles by persisting execution state across threads, enabling fault tolerance and the ability to pause workflows at designated breakpoints for manual review or modification. This
LangChain is an orchestration framework designed for building, managing, and deploying applications powered by large language models. It provides a unified integration layer that normalizes disparate model provider APIs into a consistent set of primitives, enabling developers to build complex, multi-step AI workflows that manage state, memory, and tool execution. The project distinguishes itself through a durable execution runtime that maintains persistent state across long-running processes by checkpointing progress to external storage. It models agent workflows as directed graphs, allowing
This is an OpenAI API Laravel client and LLM integration library designed to connect PHP applications to large language models. It enables the integration of AI capabilities for text generation, image processing, and data automation within a Laravel environment. The package includes an API mocking framework that allows developers to simulate network responses and verify application behavior without making live requests to OpenAI services. The integration is managed through service providers and configuration files, offering a facade-based static proxy and dependency injection for the API cli
Notion-style WYSIWYG editor with AI-powered autocompletion.
This project is a WhatsApp chatbot that integrates large language models and image generation into the WhatsApp messaging platform. It acts as a bridge connecting WhatsApp messages to OpenAI services to provide automated text and visual responses. The bot features the ability to convert spoken audio messages into written text using automated speech recognition, facilitating conversational interactions via voice. It also functions as a generative image bot, creating custom visual assets from text descriptions. The system is designed for containerized deployment, using Docker to package the ap
Kimi-K2 is a conversational AI engine and reasoning framework designed for text generation, advanced problem solving, and coding tasks. It functions as a tool-augmented language model capable of producing human-like chat responses through a compatible model interface. The system utilizes a reasoning-optimized architecture that separates standard conversational flow from deep logical processing. This allows the model to execute autonomous tasks by invoking external functions and calling APIs to retrieve real-time data. The project supports structured JSON output parsing for function-call inte
This project is a web-based user interface for interacting with large language models via API keys. It functions as an OpenAI API client and a general LLM web chat interface, allowing users to send prompts and receive responses through a private web portal. The application features a security layer with password-based access control to restrict public usage. It supports custom request routing and proxy configurations to bypass network restrictions, and it is available as a progressive web app for native-like installation on mobile devices. The interface includes rich text rendering for Markd
This project is a serverless application that integrates OpenAI models with the LINE messaging platform. It functions as a bridge to enable real-time conversations, text generation, image creation, and speech-to-text transcription within the messaging interface. The system is designed for cloud-native deployment on Vercel, utilizing serverless functions and webhooks to handle API traffic. It features environment-driven configuration to manage bot personalities, API secrets, and access controls such as user or group limits. Beyond basic chat, the assistant includes conversational orchestratio
TaskWeaver is an LLM agent framework that interprets natural language requests and executes them as Python code, SQL queries, or shell commands. It functions as a conversational code interpreter that maintains stateful data structures across turns, generating executable code from user prompts within a session-based environment. The system is designed as a self-hosted AI agent platform that can be deployed in Docker, managing sessions and providing a web UI for data analytics and automation tasks. The framework distinguishes itself through a role-based multi-agent architecture that divides the
This project is an AI model API gateway and proxy server designed to provide a unified interface for interacting with diverse artificial intelligence service providers. It functions as a centralized middleware platform that routes, load balances, and translates API requests across multiple models, enabling developers to access text, image, audio, and video generation capabilities through a single, standardized integration. The gateway distinguishes itself through comprehensive administrative and financial controls, including event-driven usage accounting, real-time token consumption tracking,
Sglang is a high-performance inference engine and serving system designed for large language and multimodal models. It provides a programmable interface for orchestrating complex generation workflows, enabling developers to coordinate multi-turn dialogues, tool invocations, and reasoning chains through a domain-specific language. The platform is built to support production-scale deployments, offering an OpenAI-compatible API that allows for integration with existing application ecosystems. The system distinguishes itself through a disaggregated architecture that separates compute-intensive pr
Langroid is a multi-agent orchestration framework and tool integration suite designed for building complex AI applications. It serves as a multi-modal integration layer that connects diverse local and remote language models with an agentic retrieval-augmented generation system. The project distinguishes itself through a collaborative message-exchange paradigm, allowing specialized agents to delegate tasks hierarchically and coordinate via structured communication. It features an advanced state management system for conversational AI, including the ability to rewind and prune conversation hist
Eino is an AI agent development kit and LLM application framework designed for building autonomous agents and orchestrating complex language model workflows. It serves as a multi-agent orchestration engine and workflow orchestrator, providing a graph-based execution model to route data between models, tools, and retrievers. The framework distinguishes itself through a robust set of multi-agent coordination patterns, including supervisor-led management, sequential flows, and autonomous reasoning loops like ReAct. It features advanced agent execution controls such as active turn preemption, che
llama-cpp-python provides a Python interface for the llama.cpp library, enabling the execution of large language models with hardware acceleration. It functions as a GGUF model loader and a structured text generator capable of running inference servers and multimodal runtimes for processing both text and image inputs. The project distinguishes itself through a local inference server that exposes model capabilities via an OpenAI-compatible web API. It supports advanced execution techniques including speculative decoding, weight quantization, and layer-based GPU offloading to manage memory acro
gpt4free-ts is a TypeScript-based LLM API proxy and gateway that provides a unified interface for accessing large language models without paid subscriptions or official API keys. It functions as a containerized AI bridge that routes requests to various free third-party providers to retrieve chat completions. The project acts as an OpenAI API wrapper, translating requests and responses into the standard OpenAI chat completions format to ensure compatibility with existing AI tools. It utilizes a provider-based routing system to distribute request loads across available endpoints. The gateway s
mistral.rs is an inference engine for large language models that runs locally and exposes models behind OpenAI and Anthropic-compatible APIs. It serves as a multi-model serving platform, capable of loading several models in a single server process with per-request routing and on-demand loading and unloading. The engine supports multimodal inference, processing text alongside images, video, audio, and speech inputs, and includes a quantized model deployment runtime that reduces memory use and speeds up inference on consumer hardware. The project distinguishes itself through an agentic tool exe
ollama-python is a Python client for interacting with large language models. It provides an interface for sending prompts to receive text and chat completions, as well as a dedicated client for generating numerical vector embeddings from text. The project includes a wrapper that emulates the OpenAI API, allowing applications built for that standard to interact with local models. It also provides a non-blocking asynchronous client for executing concurrent requests. The library covers the full model lifecycle, including the ability to pull, create, list, and delete models within a local enviro
This project is a framework for managing generative AI services through a unified provider interface and adapter layer. It provides a standardized API for calling multiple cloud-based and locally hosted models, translating provider-specific parameters and responses into a uniform format. The system includes an agent orchestrator designed for long-running tasks, featuring state persistence for resuming runs and execution tracing to monitor decision-making processes. It integrates the Model Context Protocol to connect models to external servers and filesystems and employs a policy-based executi