Awesome GitHub RepositoriesIsolated Evaluation Environments

Letta is a framework for building, deploying, and managing autonomous AI agents that maintain persistent state across long-term interactions. It provides a comprehensive suite of primitives for defining agents with configurable personas, modular memory blocks, and tool-use capabilities, enabling them to retain user preferences and conversation history over extended sessions. The platform distinguishes itself through its advanced memory management and orchestration capabilities. It allows agents to autonomously update their own memory, perform retrieval-augmented generation, and coordinate com

Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level

rllm is an asynchronous reinforcement learning framework for training language agents. It provides a unified pipeline that runs the same agent code for both evaluation and training, automatically capturing traces for gradient computation. The framework supports distributed reinforcement learning across multiple GPUs and nodes using pluggable backends, and executes agents in isolated sandboxes—either locally or in the cloud—for safe and scalable rollout collection. It trains agents built with LangGraph, SmolAgents, OpenAI Agents SDK, or custom frameworks without requiring core logic changes. T

Klavis is a platform for managing Model Context Protocol (MCP) servers and providing sandboxed environments where AI agents can safely interact with external tools and services. It functions as an integration framework that orchestrates MCP server instances, exposes tools and resources for AI agents, and isolates agent interactions from production data through horizontally scalable sandbox environments. The platform distinguishes itself through its ability to generate long-horizon agentic tasks that simulate realistic tool-use workflows with live SaaS applications and production MCP servers.

gptme este o platformă de orchestrare multi-agent concepută pentru inginerie software autonomă, integrare AI bazată pe terminal și navigare în cod îmbunătățită prin RAG. Permite implementarea agenților persistenți și a subagenților specializați pentru a descompune sarcini complexe și a executa fluxuri de lucru tehnice paralele. Sistemul se distinge printr-o combinație de automatizare GUI bazată pe viziune pentru controlul aplicațiilor desktop și mecanisme de patching chirurgical pentru modificări țintite ale codului sursă. Utilizează gestionarea memoriei bazată pe git pentru a menține un istoric versionat al identităților agenților, lecțiilor învățate și stărilor spațiului de lucru. Capabilitățile sale mai largi acoperă rutarea modelelor agnostice față de furnizor pe backend-uri AI locale și cloud, regăsirea semantică pentru context local și integrarea Model Context Protocol pentru a încărca dinamic instrumente externe. Proiectul include, de asemenea, o suită cuprinzătoare de inginerie software pentru debugging automat, refactoring și gestionarea repository-urilor GitHub. Platforma poate fi implementată ca un server self-hosted prin containere Docker, având o interfață de chat bazată pe web și randare desktop containerizată.

Octelium is a zero-trust network access platform and identity-aware proxy designed to secure private HTTP, SSH, and SQL resources. It functions as a secure gateway that validates human and workload identities using OIDC, SAML, and FIDO2 passkeys before granting access to internal applications and SaaS APIs. The system is distinguished by its secretless access broker, which injects credentials—such as API keys, passwords, and AWS Sigv4 signatures—at the gateway level so users can access databases and cloud resources without managing secrets. It further specializes in AI gateway administration,

OSWorld is an evaluation framework and multimodal agent benchmark designed to test the ability of large language models to complete complex tasks within virtualized operating system environments. It provides a virtualized desktop sandbox and a virtual machine orchestrator to deploy, snapshot, and reset cloud-based desktops, ensuring reproducible test states for AI agent interactions. The system distinguishes itself by providing an OS-level action space that translates model decisions into mouse clicks, keyboard inputs, and system commands. It employs a standardized interface to integrate vari