awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
microsoft avatar

microsoft/SmartPlayArchived

0
View on GitHub↗

SmartPlay

SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.

Features

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
  • Agent Benchmarks - Methodology and benchmark for evaluating intelligent agent capabilities.
  • 145 stars·14 forks·Python·CC-BY-4.0·11 views

    Star history

    Star history chart for microsoft/smartplayStar history chart for microsoft/smartplay

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Frequently asked questions

    What does microsoft/smartplay do?

    SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.

    What are the main features of microsoft/smartplay?

    The main features of microsoft/smartplay are: Agent Benchmarks.

    Which projects share features with microsoft/smartplay?

    Projects with overlapping indexed features include: microsoft/fara — FARA is a visual computer-use agent model that controls a browser by predicting screen coordinates for clicking,… snap-stanford/mlagentbench — MLAgentBench is a suite of end-to-end Machine Learning (ML) experimentation tasks for benchmarking AI agents, where… thudm/agentbench — A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24). xlang-ai/osworld — OSWorld is an evaluation framework and multimodal agent benchmark designed to test the ability of large language…

    Projects sharing features with SmartPlay

    These projects share indexed features with SmartPlay. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • microsoft/faramicrosoft avatar

      microsoft/fara

      6,248View on GitHub↗

      FARA is a visual computer-use agent model that controls a browser by predicting screen coordinates for clicking, typing, and scrolling, without relying on DOM or accessibility trees. It is designed to automate multi-step web tasks such as searching, form filling, booking, and shopping by reasoning over visual state and decomposing tasks into sequential actions. The model uses a compact 7-billion-parameter decoder-only transformer that can run on consumer GPUs for low-latency on-device inference, or be deployed as a managed endpoint on Azure Foundry for cloud-based inference without local infr

      Pythonagentbrowser-usecomputer-use
      View on GitHub↗6,248
    • snap-stanford/mlagentbenchsnap-stanford avatar

      snap-stanford/MLAgentBench

      342View on GitHub↗

      MLAgentBench is a suite of end-to-end Machine Learning (ML) experimentation tasks for benchmarking AI agents, where the agent aims to take a given dataset and a machine learning task description and autonomously develop or improve an ML model. Paper: https://arxiv.org/abs/2310.03302

      Python
      View on GitHub↗342
    • thudm/agentbenchTHUDM avatar

      THUDM/AgentBench

      3,817View on GitHub↗

      A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

      Python
      View on GitHub↗3,817
    • xlang-ai/osworldxlang-ai avatar

      xlang-ai/OSWorld

      2,584View on GitHub↗

      OSWorld is an evaluation framework and multimodal agent benchmark designed to test the ability of large language models to complete complex tasks within virtualized operating system environments. It provides a virtualized desktop sandbox and a virtual machine orchestrator to deploy, snapshot, and reset cloud-based desktops, ensuring reproducible test states for AI agent interactions. The system distinguishes itself by providing an OS-level action space that translates model decisions into mouse clicks, keyboard inputs, and system commands. It employs a standardized interface to integrate vari

      Pythonagentartificial-intelligencebenchmark
      View on GitHub↗2,584