2 dépôts
Awesome GitHub RepositoriesAnnotation Queues
Queues for organizing human-led data labeling and scoring based on defined rubrics.
Distinct from Task Queue Management: Focuses on human annotation and scoring queues rather than technical background task processing
Explore 2 awesome GitHub repositories matching devops & infrastructure · Annotation Queues. Refine with filters or upvote what's useful.
Awesome Annotation Queues GitHub Repositories
Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
- langchain-ai/deepagents
langchain-ai/deepagents
25,006Voir sur GitHubDeepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai
Provides a mechanism to build review queues using feedback schemas and scoring rubrics for human annotators.
Pythonagentsdeepagentslangchain - agenta-ai/agenta
Agenta-AI/agenta
3,860Voir sur GitHubAgenta is a Prompt Ops lifecycle manager and prompt management platform that decouples prompt engineering from application code. It serves as a centralized system for developing, versioning, and deploying prompt templates and model configurations across different environments. The platform functions as an AI agent orchestrator with a visual interface for building agent workflows and connecting models to external tools. It further acts as an evaluation framework and observability tool, utilizing OpenTelemetry to capture execution traces, monitor latency, and track token costs. The system cove
Routes execution traces to human reviewers and exports labeled results as test sets.
TypeScriptagentsevaluationllm-as-a-judge
