1 Repo
Awesome GitHub RepositoriesWarehouse-Native Model Benchmarking
Tools for benchmarking LLM configurations against business metrics stored in data warehouses.
Distinct from Prompt Optimizers: Distinct from Prompt Optimizers: focuses on measuring outcomes via warehouse metrics rather than just refining prompt text.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Warehouse-Native Model Benchmarking. Refine with filters or upvote what's useful.
Awesome Warehouse-Native Model Benchmarking GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- growthbook/growthbook
growthbook/growthbook
7,351Auf GitHub ansehenGrowthBook is a feature flagging and experimentation platform that utilizes a warehouse-native approach to data analysis. It serves as a system for managing feature rollouts and conducting A/B tests by executing SQL queries directly against existing data warehouses to calculate experiment results. The platform is distinguished by its integration of a Model Context Protocol server, which allows AI coding assistants and IDEs to manage flags and query analytics using natural language. It also provides specialized capabilities for AI model optimization, enabling the testing of prompts and models
Enables testing of LLM prompts and models against warehouse metrics for cost, latency, and satisfaction.
TypeScriptab-testingabtestabtesting
