1 Repo
Testing execution flows and candidate strings using mock models to avoid API costs.
Distinct from API Debugging and Mocking: Distinct from general API Mocking: specifically targets the validation of LLM generation logic and prompt flows.
Explore 1 awesome GitHub repository matching part of an awesome list · Generation Logic Simulation. Refine with filters or upvote what's useful.
Guidance is a control framework and generation orchestrator for large language models. It provides a programming layer to steer model outputs through structured templates, schema enforcement, and logical flow management. The framework distinguishes itself by interleaving model generation with local code execution, enabling the use of loops and conditional branching within a single session. It employs grammar-based token constraints and regular expressions to force models to sample only from tokens that satisfy a specific structural format, ensuring strict adherence to predefined data models.
Provides a utility to validate candidate strings and test execution flows locally using a mock model.