1 repo
Awesome GitHub RepositoriesPrediction Comparison Utilities
Normalization and comparison tools for verifying model outputs against expected results.
Distinguishing note: Focuses on text normalization for evaluation rather than general string manipulation.
Explore 1 awesome GitHub repository matching testing & quality assurance · Prediction Comparison Utilities. Refine with filters or upvote what's useful.
Awesome Prediction Comparison Utilities GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- stanfordnlp/dspy
stanfordnlp/dspy
32,291View on GitHubDSPy is a declarative programming framework designed for building complex language model applications. It treats model interactions as modular, composable programs, allowing developers to define task logic through typed class schemas rather than relying on manually written prompts. By organizing workflows into hierarchical, reusable Python objects, the framework enables the construction of sophisticated AI systems that manage state and execution flow independently. The framework distinguishes itself through an automated optimization engine that iteratively refines prompt instructions and few-
Normalizes text outputs to ensure accurate comparisons against expected results during evaluation.
Python
