2 Repos
Evaluates different versions of a workflow on the same benchmark to surface performance differences.
Distinct from Workflow Versioning: Distinct from Workflow Versioning: focuses on comparing performance of different workflow versions on benchmarks, not maintaining execution consistency across versions.
Explore 2 awesome GitHub repositories matching software engineering & architecture · Workflow Version Comparators. Refine with filters or upvote what's useful.
Evaluates different versions of a workflow on the same benchmark to surface performance differences.
Agenta is a Prompt Ops lifecycle manager and prompt management platform that decouples prompt engineering from application code. It serves as a centralized system for developing, versioning, and deploying prompt templates and model configurations across different environments. The platform functions as an AI agent orchestrator with a visual interface for building agent workflows and connecting models to external tools. It further acts as an evaluation framework and observability tool, utilizing OpenTelemetry to capture execution traces, monitor latency, and track token costs. The system cove
Analyzes and compares the behavior of different production versions to identify the best performing iteration.