1 个仓库
Awesome GitHub RepositoriesLLM Workflow Optimization
Analyzing model-specific metrics and usage data to refine the logic of generative AI pipelines.
Distinct from Application Performance Optimization: Specializes application performance optimization for the specific logic and bottlenecks of LLM workflows.
Explore 1 awesome GitHub repository matching software engineering & architecture · LLM Workflow Optimization. Refine with filters or upvote what's useful.
Awesome LLM Workflow Optimization GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- explodinggradients/ragas
explodinggradients/ragas
14,400在 GitHub 上查看Ragas is an evaluation framework and performance benchmark designed to quantify the quality of retrieval augmented generation pipelines. It functions as an application optimizer to identify bottlenecks in language model workflows using automated metrics and model-based scoring. The framework includes a system for generating synthetic datasets that mimic production scenarios and edge cases to create realistic test cases. It enables reference-free assessment, allowing the evaluation of response quality by analyzing grounding in the provided context without requiring gold-standard labels. The s
Analyzes live application data and output scores to identify bottlenecks in language model workflows.
Python
