17 open-source projects similar to google-deepmind/opro, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.
TextGrad is a differentiable text optimization library and framework designed for simulated language model backpropagation. It functions as a textual gradient engine that treats language model feedback as gradients to iteratively refine prompts and unstructured text variables. The system utilizes a computation graph to trace errors from a defined loss function back to input text, allowing it to determine specific improvements. It differentiates itself by implementing natural-language backpropagation and gradient aggregation, which merges multiple pieces of textual critique into consolidated i
DSPy is a declarative programming framework designed for building complex language model applications. It treats model interactions as modular, composable programs, allowing developers to define task logic through typed class schemas rather than relying on manually written prompts. By organizing workflows into hierarchical, reusable Python objects, the framework enables the construction of sophisticated AI systems that manage state and execution flow independently. The framework distinguishes itself through an automated optimization engine that iteratively refines prompt instructions and few-
This project is a comprehensive guide and framework for designing, optimizing, and securing inputs to improve the accuracy and reasoning of large language model outputs. It provides core methodologies for implementing logical reasoning steps, example-based learning, and reusable template systems. The framework distinguishes itself through a focus on security guardrails and ethical auditing, implementing primitives to prevent adversarial prompt injection attacks and identify biases. It also emphasizes structured generation, using persona assignment and negative constraints to control the tone,
This project is an automated prompt engineering and optimization tool designed to iteratively create, test, and refine prompts using a language model to improve output quality. It functions as a framework for generating candidate prompts and ranking their performance through correctness matching and ELO-based ratings. The system includes capabilities for model distillation, generating high-quality example pairs from frontier models to create training data for smaller models. It also provides tools to condense prompts for smaller models and transform instruction-tuned prompts into completion-b
auto-dev is an AI-native software engineering tool and multi-agent development platform designed to automate the entire software development lifecycle. It functions as an autonomous orchestrator that manages AI-driven coding, testing, and infrastructure configuration through declarative agent chains. The project is built on a Kotlin Multiplatform AI framework, allowing agent logic to run across diverse environments and device interfaces. The platform implements the Model Context Protocol to exchange tools and project information with external AI services. It distinguishes itself through the u
This repository is a comprehensive set of tutorials and examples for building software powered by large language models. It serves as an application development guide and a prompt engineering framework, providing instructional content for integrating model logic with user interfaces and external data sources. The project provides technical walkthroughs for specialized workflows, including the implementation of retrieval augmented generation using vector databases and semantic search. It includes guidance on adapting pre-trained model weights through fine-tuning with private datasets and the o
LMOps is a research-driven operations framework for optimizing the deployment, fine-tuning, and performance of large language models. It provides a specialized toolkit for foundation model adaptation, inference acceleration, prompt optimization, and context orchestration. The framework distinguishes itself through an inference accelerator that reduces token generation latency by verifying and copying overlapping text spans from reference documents. It also features a prompt engineering optimizer that employs reinforcement learning, beam search, and non-natural language markers to automaticall
#license-gh-package: https://lbesson.mit-license.org/ #arxiv-paper-package: https://arxiv.org/abs/2412.03092/ #pypi-package: https://pypi.org/project/revolve/
Authors: Archiki Prasad, Peter Hase, Xiang Zhou, and Mohit Bansal (UNC Chapel Hill) Paper Note: This is preliminary version of our code. The complete code to run all experiments in the paper will be added shortly.
Toolkits for discrete, black-box prompt learning based on metaheuristic algorithms.
This repo provides the source code & data of our paper: Unleashing the Potential of Large Language Models as Prompt Optimizers: An Analogical Analysis with Gradient-based Model Optimizers.
This is the implementation of the paper GPS: Genetic Prompt Search for Efficient Few-shot Learning. GPS is an automatic prompt search method based on genetic algorithm for better few-shot learning.
| 📄ICLR Spotlight | 🤗HF Paper | 📊Datasets | 🤖Models | 📧 Contact Us
This is the official repo for "PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization". PromptAgent is a novel automatic prompt optimization method that autonomously crafts prompts equivalent in quality to those handcrafted by experts, i.e., expert-level prompts.
This is the official implementation of the paper Prompt Optimization with Human Feedback.
This is the official implementation of the paper Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers, accepted by ICLR'2024.