Awesome GitHub RepositoriesIsolated Evaluation Environments

Letta is a framework for building, deploying, and managing autonomous AI agents that maintain persistent state across long-term interactions. It provides a comprehensive suite of primitives for defining agents with configurable personas, modular memory blocks, and tool-use capabilities, enabling them to retain user preferences and conversation history over extended sessions. The platform distinguishes itself through its advanced memory management and orchestration capabilities. It allows agents to autonomously update their own memory, perform retrieval-augmented generation, and coordinate com

Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level

rllm is an asynchronous reinforcement learning framework for training language agents. It provides a unified pipeline that runs the same agent code for both evaluation and training, automatically capturing traces for gradient computation. The framework supports distributed reinforcement learning across multiple GPUs and nodes using pluggable backends, and executes agents in isolated sandboxes—either locally or in the cloud—for safe and scalable rollout collection. It trains agents built with LangGraph, SmolAgents, OpenAI Agents SDK, or custom frameworks without requiring core logic changes. T

Klavis is a platform for managing Model Context Protocol (MCP) servers and providing sandboxed environments where AI agents can safely interact with external tools and services. It functions as an integration framework that orchestrates MCP server instances, exposes tools and resources for AI agents, and isolates agent interactions from production data through horizontally scalable sandbox environments. The platform distinguishes itself through its ability to generate long-horizon agentic tasks that simulate realistic tool-use workflows with live SaaS applications and production MCP servers.

gptme est une plateforme d'orchestration multi-agents conçue pour l'ingénierie logicielle autonome, l'intégration de l'IA dans le terminal et la navigation de code améliorée par RAG. Elle permet le déploiement d'agents persistants et de sous-agents spécialisés pour décomposer des tâches complexes et exécuter des flux de travail techniques parallèles. Le système se distingue par une combinaison d'automatisation d'interface graphique basée sur la vision pour contrôler les applications de bureau et de mécanismes de patch chirurgical pour des modifications ciblées du code source. Il utilise une gestion de mémoire basée sur git pour maintenir un historique versionné des identités des agents, des leçons apprises et des états de l'espace de travail. Ses capacités plus larges couvrent le routage de modèles agnostique aux fournisseurs à travers des backends d'IA locaux et cloud, la récupération sémantique pour le contexte local et l'intégration du Model Context Protocol pour charger dynamiquement des outils externes. Le projet inclut également une suite complète d'ingénierie logicielle pour le débogage automatisé, le refactoring et la gestion de dépôts GitHub. La plateforme peut être déployée en tant que serveur auto-hébergé via des conteneurs Docker, avec une interface de chat basée sur le web et un rendu de bureau conteneurisé.

Octelium is a zero-trust network access platform and identity-aware proxy designed to secure private HTTP, SSH, and SQL resources. It functions as a secure gateway that validates human and workload identities using OIDC, SAML, and FIDO2 passkeys before granting access to internal applications and SaaS APIs. The system is distinguished by its secretless access broker, which injects credentials—such as API keys, passwords, and AWS Sigv4 signatures—at the gateway level so users can access databases and cloud resources without managing secrets. It further specializes in AI gateway administration,

OSWorld is an evaluation framework and multimodal agent benchmark designed to test the ability of large language models to complete complex tasks within virtualized operating system environments. It provides a virtualized desktop sandbox and a virtual machine orchestrator to deploy, snapshot, and reset cloud-based desktops, ensuring reproducible test states for AI agent interactions. The system distinguishes itself by providing an OS-level action space that translates model decisions into mouse clicks, keyboard inputs, and system commands. It employs a standardized interface to integrate vari