Projects sharing features with Instructor

Instructor is a schema enforcement and validation library designed to transform language model outputs into structured, type-safe data formats. It functions as a validation layer that uses Pydantic to ensure model responses conform to specific data models, acting as a tool for forcing large language models to return data in predefined schemas. The project differentiates itself through a recursive error-feedback loop that automatically retries requests when structural errors occur, passing validation failure messages back to the model to guide corrections. It also includes a streaming parser c

BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg

Typia is a compile-time code generator that transforms TypeScript type annotations into runtime validation, serialization, and schema functions without requiring decorators or separate schema files. It generates optimized validation and serialization code during TypeScript compilation, producing dedicated functions for each type that eliminate runtime schema objects for faster execution. The project extends this core capability into several integrated areas. It generates fully typed client SDKs from NestJS controller source code, keeping server and client types synchronized automatically. It

ruby_llm is an LLM integration framework and AI agent orchestrator designed to connect applications to multiple large language model providers through a unified interface. It serves as a toolkit for building autonomous assistants with custom personas, managing structured output via JSON schemas, and implementing vector embedding engines for semantic search. The project distinguishes itself as an observability suite and multimodal toolkit. It provides specialized capabilities for tracking token usage, calculating model costs, and tracing workflows via OpenTelemetry, while supporting the proces

This project is a comprehensive framework for building AI-powered applications, providing a unified toolkit for orchestrating language models, autonomous agents, and interactive user interfaces. It serves as a central library for managing the entire lifecycle of AI interactions, from initial prompt generation and model provider abstraction to complex, multi-step reasoning and tool execution. The framework distinguishes itself through its deep integration with frontend development, specifically by enabling generative user interfaces that render dynamic components directly from model outputs. I

Langroid is a multi-agent orchestration framework and tool integration suite designed for building complex AI applications. It serves as a multi-modal integration layer that connects diverse local and remote language models with an agentic retrieval-augmented generation system. The project distinguishes itself through a collaborative message-exchange paradigm, allowing specialized agents to delegate tasks hierarchically and coordinate via structured communication. It features an advanced state management system for conversational AI, including the ability to rewind and prune conversation hist

AdalFlow is an autonomous AI agent framework and LLM application library designed for building modular workflows. It serves as a model-agnostic interface and RAG pipeline orchestrator, allowing users to develop ReAct agents that utilize iterative reasoning and external tool execution to solve complex tasks. The project distinguishes itself through a prompt optimization system that uses textual gradient descent to automatically refine prompt templates and few-shot examples. It treats model feedback as a differentiable signal, enabling a form of LLM backpropagation to iteratively improve output

LangChain4j is a framework and library for building applications powered by large language models on the JVM. It provides a unified API for developing AI agents, implementing retrieval augmented generation, and integrating generative AI capabilities into professional software built with frameworks like Spring Boot or Quarkus. The project enables the creation of autonomous agents that can reason through tasks, manage memory, and execute external tools to achieve specific goals. It differentiates itself through a unified model interface that allows developers to switch between multiple model pr

This project is a framework for developing multimodal AI agents that function as programmable participants in real-time communication rooms. It enables the construction of agents that can see, hear, and speak by integrating speech-to-text, large language models, and text-to-speech pipelines to facilitate low-latency, natural conversations. The system is distinguished by its advanced orchestration of real-time media and conversational flow, including support for full-duplex speech, preemptive response generation, and sophisticated interruption management. It further differentiates itself throu

Llama-stack is a standardized orchestration stack and generative AI API gateway. It provides a unified communication layer and a consistent interface for deploying, managing, and interacting with various large language model providers and deployments. The system functions as an agent framework that manages tool execution and versioned skill bundles to automate complex tasks. It includes a batch processing system for handling large volumes of asynchronous requests through offline processing and a vector database interface for storing and searching documents to enable retrieval augmented genera

Koog is an LLM agent framework used to build autonomous entities that execute tool-based workflows. It utilizes a graph-based workflow engine to define agent behaviors and decision paths as a directed graph of nodes and edges. The framework distinguishes itself through a model provider orchestrator that enables dynamic switching, load balancing, and automatic fallbacks between different AI backends. It implements the Model Context Protocol to connect agents to remote tool servers and features a RAG memory system using vector embeddings to maintain long-term conversation context. The project

OpenUI is a generative UI development framework that converts natural language descriptions into structured, interactive user interface components using large language models. It enables the real-time transformation of text into functional prototypes such as charts, tables, forms, and cards. The project distinguishes itself through a schema-driven orchestration system that uses typed UI primitives and JSON schemas to constrain model output, ensuring generated interfaces adhere to specific component libraries. It features a streaming parser that allows for progressive component rendering, disp

Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level

This project is a conversational assistant and retrieval-augmented generation system designed to provide technical answers from official documentation and support knowledge bases. It implements a retrieval architecture that routes queries through specialized tools and utilizes a model abstraction layer to switch between different chat and embedding providers without modifying core integration code. The system employs a graph-based state machine for durable agent execution, enabling state persistence and human-in-the-loop interactions. It features an agentic middleware framework that allows fo

Miroflow is an agent orchestration framework designed to coordinate multiple large language models and autonomous agents to perform complex research and reasoning tasks. It functions as a hierarchical workflow manager that distributes workloads across specialized agents using intent recognition and structured planning to gather deep information and solve challenging queries. The system distinguishes itself through a multi-model integration gateway and a provider-agnostic interface, allowing it to unify various language model providers. It extends these models via a tool-augmented framework th

This project serves as an educational resource and guide for prompt engineering, providing a structured methodology for interacting with large language models. It focuses on teaching core strategies to improve the reliability, accuracy, and consistency of model outputs across a variety of natural language processing tasks. The framework emphasizes the use of standardized templates and logical decomposition to manage complex instructions. By implementing techniques such as few-shot context injection, iterative refinement, and delimiter-based segmentation, the project demonstrates how to guide

Atmosphere is a Java-based framework for building and coordinating AI agents. It provides a real-time transport layer for streaming data via WebSockets, SSE, gRPC, and WebTransport, alongside a multi-agent orchestration framework for managing agent fleets through sequential, parallel, and graph-based execution workflows. The project features a durable workflow engine that persists agent state as snapshots, allowing long-running tasks to survive system restarts and incorporate human-in-the-loop approvals. It also implements Model Context Protocol servers to expose tools, resources, and prompt

CyberScraper-2077 is an AI-powered web scraping tool that uses large language models to extract and structure data from websites into organized formats. It functions as an LLM web scraper and AI content parser, transforming unstructured raw web text into specific data schemas. The project distinguishes itself through a suite of anonymity and evasion tools, including proxy rotation, SOCKS-based identity masking, and the ability to route traffic through the Tor network to access hidden onion services. It further includes a bot detection bypass system that employs stealth parameters and custom n

Harmony is an AI SDK designed for tokenizing conversations, formatting reasoning layouts, parsing raw outputs, and defining tool call schemas. It provides a system for converting structured dialogue and tool calls into the token sequences required for large language model inference and training. The project includes an output formatter that structures reasoning chains and multi-channel outputs into consistent layouts to prevent token loss. It also features a response parser that transforms raw completion tokens and live streams back into structured message objects and roles. The SDK manages

Instructor is a framework designed for structured data extraction, validation, and language model integration. It functions as a library that transforms unstructured text into validated, type-safe objects by leveraging schema definitions and model-specific tool-calling capabilities. By acting as a validation middleware, the project ensures that language model outputs strictly conform to defined data structures. The library distinguishes itself through a robust validation-based retry loop that automatically re-submits failed responses with error feedback to iteratively correct schema complianc

Kreuzberg is a document extraction engine that converts PDFs, Office files, images, and over 90 other formats into clean, structured text and metadata. It is built around a compiled Rust core that can be used as a native library, a command-line tool, a REST API server, or a WebAssembly module for browser-based processing. The system is designed to run entirely on self-hosted infrastructure, with no data leaving the user's environment. What distinguishes Kreuzberg is its breadth of integration surfaces and its pipeline architecture. It exposes extraction capabilities through native bindings fo

This project is a Model Context Protocol server that bridges artificial intelligence agents with cloud-based web scraping and automation resources. It functions as a remote task orchestrator, allowing agents to discover, configure, and execute complex browser automation jobs as callable functions within their native environments. The server distinguishes itself by providing a unified framework for managing distributed workflows, including the ability to handle asynchronous task polling, structured data serialization, and real-time status tracking. It supports advanced agentic capabilities suc

Star-vector is a suite of vision-language systems designed to generate scalable vector graphics from text or image inputs. It utilizes a vision-language foundation model to treat the creation of visual elements as a structured code generation task. The system employs a multimodal architecture that maps visual patterns and shapes to corresponding structural elements in a vector code sequence. It incorporates a render-loop feedback mechanism and reinforcement learning to iteratively refine the fidelity of the generated graphics by comparing rendered outputs against target images. The project c

Kit is a desktop automation framework and scriptable UI toolkit designed for building personalized productivity tools. It serves as a cross-platform CLI wrapper and macOS system automator, providing an environment to execute scripts that manage operating system tasks, file management, and application workflows. The project distinguishes itself with a dedicated LLM integration layer for structured data extraction and text generation, alongside a specialized UI framework for creating interactive input forms, HTML windows, and floating widgets. It features deep macOS integration through AppleScr

gpt-migrate is an automated code migration tool that uses large language models to translate source code and project structures between different programming languages. It functions as an automated code translator that converts codebases across frameworks while mapping compatible third-party dependencies. The system includes a containerized code validator to ensure functional parity by executing unit tests within isolated environments. It also operates as an automated debugging agent that analyzes execution logs and edits source files to resolve bugs in the translated code. The tool covers c

Claude-engineer is an autonomous software engineering agent and command-line interface for interacting with the Claude 3.5 Sonnet model. It functions as an AI code editor that writes code, manages local files, and executes terminal commands to automate technical workflows. The system features a self-evolving tool framework that allows the agent to design and implement its own functional scripts to expand its capabilities during a session. It utilizes a sandboxed Python executor to run scripts for data analysis and complex computations in a secure remote environment. The project covers a broa

OpenEvolve is an evolutionary algorithm framework that uses large language models to autonomously discover and optimize programming algorithms. It functions as an algorithm discovery engine and code search tool, evolving populations of candidate programs to find efficient implementations and hardware-specific speedups. The system treats both code and system instructions as evolvable entities, utilizing an automated prompt optimizer to iteratively refine model performance. It maintains search stability through niche-based population management to preserve diversity and employs a closed-loop fe