Projects sharing features with Oracle

This is a Python SDK for interacting with large language models via API. It serves as a client library to generate text, process messages, and manage conversational states, while providing a specialized interface for connecting to models hosted across different cloud infrastructure providers. The SDK includes a tool-calling framework that maps Python functions to JSON schemas, allowing models to execute external tools. It also features a built-in token counting utility to estimate input size before transmission and a server-sent events client for receiving model tokens in real time. The libr

This project is an autonomous agent framework designed to integrate large language models with popular messaging platforms. It functions as a middleware platform that enables automated, multimodal interactions by decomposing complex user goals into sequential plans, executing them through external tools, and maintaining persistent context across sessions. The framework distinguishes itself through a modular skill architecture and a hybrid memory system. Users can extend system capabilities by installing custom logic modules from community hubs or generating them through natural language. The

This project is a Model Context Protocol server that connects large language models to the Xiaohongshu social media platform. It acts as a connector and API wrapper, enabling language models to programmatically search, read, and publish media and text. The system provides automation for content discovery and publishing, allowing for the creation of image and video posts with associated titles and descriptions. It also facilitates social engagement by managing the posting of comments and tracking engagement metrics for specific entries. The tool covers data retrieval for user profiles, post d

This project is an AI-focused API gateway and proxy system designed to intercept, standardize, and route requests across heterogeneous language model providers. It functions as a middleware layer that normalizes incoming traffic and manages authentication, ensuring consistent integration across diverse service interfaces. The system features a programmable routing engine that executes user-defined scripts to evaluate request content in real-time. This allows for dynamic traffic management, where requests are inspected, transformed, and redirected to specific model endpoints based on custom lo

This project is a technical curriculum and development guide focused on large language model prompt engineering, fine-tuning, and the creation of retrieval augmented generation applications. It serves as a comprehensive resource for developers to master crafting precise instructions and textual patterns to improve the quality and predictability of model outputs. The material covers the end-to-end workflow of adapting open-source models to specific datasets and integrating language models with vector databases to generate responses based on private information. It also provides a systematic ap

This project is an artificial intelligence API gateway that centralizes connections to multiple model providers into a single, standardized interface. By acting as a proxy, it translates diverse provider protocols into a format compatible with existing clients, allowing developers to integrate various language models without managing provider-specific software development kits. The gateway distinguishes itself through a robust traffic management layer that includes intelligent request routing, weighted load balancing, and automated failover mechanisms to ensure service availability. It incorp

This project is an LLM API proxy gateway and compatibility layer designed to route, translate, and proxy requests between model clients and various large language model providers. It functions as a multi-provider router that maps model requests to alternative backends based on configurable tiers and capabilities. The gateway acts as a translation layer that converts API request and response formats between different providers, such as OpenAI or Gemini, to ensure compatibility. It includes a tool-use proxy to handle the execution and processing of model tool definitions and function calls, and

TensorZero is an inference gateway and experimentation framework designed to manage the lifecycle of large language models in production environments. It functions as a central proxy that routes requests across multiple artificial intelligence providers while providing the infrastructure necessary to monitor performance, track costs, and ensure service reliability. The platform distinguishes itself by integrating a comprehensive evaluation engine and an observability pipeline directly into the request flow. It enables developers to conduct controlled experiments and A/B tests to compare diffe

Flow is an orchestration framework for designing and executing complex workflows using autonomous agents powered by large language models. It serves as a toolkit for constructing agentic pipelines and a runtime for managing agent lifecycles, session states, and tool execution. The project is distinguished by its support for hierarchical swarm management, where director agents decompose large projects into smaller tasks for specialized worker agents. It enables multiple coordination patterns, including sequential linear pipelines and concurrent execution where agents analyze tasks from differe

This project is a framework for developing multimodal AI agents that function as programmable participants in real-time communication rooms. It enables the construction of agents that can see, hear, and speak by integrating speech-to-text, large language models, and text-to-speech pipelines to facilitate low-latency, natural conversations. The system is distinguished by its advanced orchestration of real-time media and conversational flow, including support for full-duplex speech, preemptive response generation, and sophisticated interruption management. It further differentiates itself throu

Odysseus is a self-hosted AI workspace and autonomous agent framework designed for deploying and managing large language models. It serves as a centralized platform for orchestrating agentic tasks, utilizing a model context protocol server to connect AI models to external system utilities, browser automation, and local hardware. The system distinguishes itself through a combination of retrieval-augmented generation and a RAG knowledge base, using vector stores and local embeddings to provide persistent semantic memory. It further integrates AI-driven communication management to triage email i

OmniRoute is a unified LLM API gateway that connects multiple AI providers to a single endpoint. Its primary purpose is to simplify the integration of various AI models into tools and agents by translating different provider formats into a standardized API. The project distinguishes itself through a multi-strategy request routing system that optimizes for cost, speed, and availability, including automatic model fallbacks and a circuit-breaker resilience model to isolate provider failures. It employs a local-first security posture, using AES-256-GCM encryption to store API keys and conversatio

RouteLLM is a routing framework and traffic manager designed to direct prompts between high-capability and low-cost large language models. It functions as an API gateway that mimics the OpenAI specification to route requests across different model providers. The system optimizes operational costs by splitting traffic between model tiers based on predicted win rates and prompt complexity. It includes a calibration tool to analyze sample queries and determine the optimal cost-quality tradeoff for traffic distribution. The framework provides a tool for measuring the accuracy and cost efficiency

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg

AIClient-2-API is an AI gateway and proxy server that translates diverse large language model interfaces into a single standardized API format. It functions as an OpenAI API compatible proxy and multi-provider orchestrator, allowing a single client to interact with multiple different model backends through a unified interface. The project distinguishes itself by acting as a load balancer that distributes requests across multiple provider accounts using health checks and polling to bypass quota limits. It includes a TLS fingerprint emulator to simulate browser characteristics and prevent API a

This repository is a collection of guides, notebooks, and recipes for implementing advanced prompting techniques and workflow patterns with large language models. It serves as a prompt engineering guide, an evaluation suite for scoring prompt quality, and a framework for orchestrating agents and integrating external tools. The project provides implementation patterns for building applications with Claude, specifically focusing on coordinating multiple models to split complex tasks between high-reasoning and high-efficiency agents. It includes technical demonstrations for multimodal data proce

Context-Engineering is a prompt engineering framework and cognitive architecture for large language models. It provides a set of patterns and methodologies for designing structured prompts and modular reasoning flows that decompose complex tasks into specialized, step-by-step problem solving templates. The project distinguishes itself through stateful prompt management and context window optimization. It maintains persistent memory across multiple interaction turns by compressing conversation history into compact internal state cells and employs techniques to maximize information density per

Wenda is a self-hosted infrastructure and gateway platform for deploying language models within internal networks to ensure data privacy and security. It functions as a centralized hub and API gateway that unifies communication between various offline model runners and online service providers through a single interface. The platform includes a workflow orchestrator that uses custom scripts and API calls to automate complex conversation flows and model settings. It also incorporates a retrieval system that augments model responses with external knowledge retrieved from vector databases and se

Antigravity-Manager is an artificial intelligence model orchestration platform that functions as a unified gateway for interacting with multiple external service providers. It standardizes heterogeneous vendor data structures into a consistent internal schema, allowing third-party tools to interface with various models through a single, normalized API. The system distinguishes itself through automated infrastructure management, including the lifecycle tracking of service accounts and the secure rotation of authentication credentials. By acting as a middleware layer, it intercepts traffic to p

Axonhub is an AI gateway and multi-model API proxy that provides a unified interface for routing requests to multiple large language model providers. It functions as a load balancer and translation layer, converting a standardized API format into provider-specific payloads to enable communication with various AI models without provider-specific code. The system manages traffic through rule-based routing and automatic failover to maintain high availability. It differentiates its operations by providing a provider-agnostic interface that decouples client requests from specific model backends us

Kirara-ai is an orchestration framework designed to integrate artificial intelligence models with multiple messaging platforms. It functions as a centralized gateway that links language models to various communication channels, enabling automated interactions through a unified interface. The platform distinguishes itself through a provider-agnostic architecture that abstracts diverse language model APIs, allowing for flexible switching between service providers. It supports stateful conversation management to maintain context and personality traits across interactions, while a modular plugin

This project serves as a comprehensive framework and registry for managing extensions within autonomous assistant environments. It provides the infrastructure necessary to integrate third-party tools, configure diverse language model backends, and deploy persistent agent instances across local or cloud-hosted platforms. The ecosystem distinguishes itself through a modular architecture that prioritizes security and interoperability. It features a centralized system for managing sensitive credentials and scoped permissions, ensuring that external integrations operate within defined access bound

One API is a centralized gateway and orchestration platform designed to consolidate multiple artificial intelligence model providers into a single, standardized interface. It functions as a reverse proxy that intercepts incoming API requests and routes them to various third-party services, abstracting the underlying provider credentials through a unified token management system. The platform provides comprehensive administrative tools for managing API keys, rotating credentials, and enforcing security policies across diverse service integrations. It includes a persistent database-backed syste

This project is a comprehensive educational resource and technical guide focused on the development, optimization, and application of large language models. It provides a structured curriculum for mastering prompt engineering, ranging from foundational principles of instruction design to advanced techniques for improving model reasoning, accuracy, and reliability. The guide distinguishes itself by offering deep technical insights into agentic workflows and autonomous system design. It covers the implementation of multi-step reasoning chains, tool integration through function calling, and stat

This project serves as a comprehensive, curated directory of resources, tools, and platforms dedicated to the generative artificial intelligence ecosystem. It functions as a central hub for developers and researchers to discover the frameworks, models, and services necessary for building, deploying, and managing intelligent software applications. The directory distinguishes itself by providing a structured index of specialized tooling across several technical domains. It covers the full lifecycle of generative AI, including the development of autonomous agent systems, the implementation of re

Prompt Optimizer is a framework designed for the iterative refinement and testing of text-based instructions for large language models. It functions as an automated evaluation pipeline that systematically adjusts prompt structure, constraints, and clarity to improve the accuracy and consistency of model outputs. The system distinguishes itself through a model-agnostic interface that standardizes communication across different artificial intelligence providers. It incorporates a versioned asset management system to track prompt history, enabling developers to maintain consistency and perform r

CL4R1T4S is a framework designed to orchestrate generative AI workflows and optimize language model outputs. It functions as a centralized utility for managing, versioning, and deploying structured system prompts and behavioral parameters to ensure consistent performance across complex tasks. The project distinguishes itself by implementing a structured pipeline that wraps model interactions to enforce behavioral constraints and sanitize inputs. This orchestration layer incorporates heuristic-based validation and stateful context management to maintain coherence and quality throughout multi-s