awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
google-gemini avatar

google-gemini/computer-use-preview

0
View on GitHub↗

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Computer Use Preview

This project is a browser automation system that connects Google's Gemini API to a web browser, enabling an AI agent to perform tasks on a user's behalf by interpreting natural language instructions. At its core, it operates through a continuous screenshot-based action loop, where the agent captures the browser's current state, sends the image to the Gemini model, and executes the model's returned commands to click, type, and navigate.

The system distinguishes itself through a dual browser backend abstraction, supporting both local Playwright-controlled browsers and remote Browserbase cloud instances, with the ability to switch between them at runtime. It also offers a Vertex AI routing switch, allowing model inference requests to be directed to either the public Gemini API or Vertex AI endpoints. A mouse cursor overlay injection feature visually marks the cursor position on screenshots sent to the model, aiding in debugging and tracking agent actions.

The project provides distinct agent implementations for each backend, including a Playwright browser agent, a Browserbase cloud browser agent, and a Vertex AI browser agent, all driven by the same natural language interface. Configuration is managed through environment variables and a .env file, with runtime settings for browser backend selection, headless mode, cloud region, model version, and startup URL. The system also includes a workaround for handling operating-system-rendered dropdown menus that Playwright cannot natively capture.

Features

  • Natural Language Browser Control Platforms - Controls a web browser by translating plain-English instructions into clicks, typing, and navigation.
  • AI Powered Web Automation - Executes multi-step web workflows like form filling and data extraction via an AI agent.
  • Browser Automation Agents - Executes natural language instructions by controlling a web browser to perform specified tasks.
  • Gemini-Powered Agents - Uses the Gemini API to control a web browser through natural language instructions.
2,815 stars·362 forks·Python·apache-2.0·42 views
  • Gemini Integrations - Connects to the Gemini API to power an agent that perceives and interacts with GUIs.
  • Natural Language Command Translation - Translates plain-English commands into browser actions like clicking, typing, and navigating.
  • AI-Driven Action Loops - Operates through a continuous screenshot-based action loop where the agent captures browser state and executes model commands.
  • Local and Remote Backend Switching - Ships a dual browser backend abstraction that switches between local Playwright and remote Browserbase instances at runtime.
  • Debugging Overlays - Provides debugging tools like mouse cursor overlays and headless mode toggling for agent actions.
  • API and Vertex AI Routing - Routes model inference requests to either the public Gemini API or Vertex AI endpoints based on a runtime toggle.
  • CLI-Driven Browser Agents - Executes a natural-language instruction by launching a browser, navigating web pages, and performing actions via the Gemini API from the CLI.
  • Cloud Browser Agent Execution - Launches a Browserbase cloud browser, connects it to a Gemini-powered agent, and executes a natural-language task loop.
  • Playwright Agent Execution - Launches a Playwright-controlled browser, connects it to a Gemini-powered agent, and executes a natural-language task loop.
  • Browser Automation Agents - Routes browser automation requests through Vertex AI for model inference and task execution.
  • Browser - Selects between a local Playwright-controlled browser or a remote Browserbase instance to run the agent.
  • API-Driven Executions - Leverages Playwright to launch and control a browser, executing tasks via the Gemini API.
  • Cloud Browser Provisioners - Configures remote Browserbase cloud browser instances for AI-driven automation.
  • Cloud Browser Integrations - Connects a Gemini-powered agent to a remote Browserbase cloud browser for task loops.

    • Star history

    Star history chart for google-gemini/computer-use-previewStar history chart for google-gemini/computer-use-preview

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Frequently asked questions

    What does google-gemini/computer-use-preview do?

    This project is a browser automation system that connects Google's Gemini API to a web browser, enabling an AI agent to perform tasks on a user's behalf by interpreting natural language instructions. At its core, it operates through a continuous screenshot-based action loop, where the agent captures the browser's current state, sends the image to the Gemini model, and executes the model's returned commands to click, type, and navigate.

    What are the main features of google-gemini/computer-use-preview?

    The main features of google-gemini/computer-use-preview are: Natural Language Browser Control Platforms, AI Powered Web Automation, Browser Automation Agents, Gemini-Powered Agents, Gemini Integrations, Natural Language Command Translation, AI-Driven Action Loops, Local and Remote Backend Switching.

    Which projects share features with google-gemini/computer-use-preview?

    Projects with overlapping indexed features include: steel-dev/steel-browser — Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome… vercel-labs/agent-browser — This project is an agentic framework designed to enable autonomous web navigation and browser automation. It functions… browserbase/mcp-server-browserbase — This project is an MCP browser automation server that connects large language models to headless cloud browsers. It… alibaba/page-agent — Page-agent is an LLM browser automation agent and JavaScript in-page GUI controller. It translates natural language… lavague-ai/lavague — LaVague is an LLM web agent framework and large action model designed to translate natural language instructions into… browser-use/browser-harness — This project is an automation framework that connects large language models to web browsers via the Chrome DevTools…

    Projects sharing features with Computer Use Preview

    These projects share indexed features with Computer Use Preview. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • steel-dev/steel-browsersteel-dev avatar

      steel-dev/steel-browser

      6,450View on GitHub↗

      Steel is a cloud browser automation platform that provides a REST API for launching and controlling remote Chrome browser sessions. It enables programmatic browsing and web scraping using standard automation tools like Puppeteer, Playwright, and Selenium, connecting to cloud-hosted browser instances via WebSocket and the Chrome DevTools Protocol. The platform supports both headless and headful browser sessions, with language-specific SDKs for TypeScript and Python. The service distinguishes itself through comprehensive anti-detection capabilities, including residential proxy rotation, CAPTCHA

      TypeScriptaiai-agentsai-tools
      View on GitHub↗6,450
    • vercel-labs/agent-browservercel-labs avatar

      vercel-labs/agent-browser

      36,203View on GitHub↗

      This project is an agentic framework designed to enable autonomous web navigation and browser automation. It functions as a controller that translates natural language instructions into deterministic browser actions, allowing agents to interact with websites, perform data extraction, and manage complex authentication flows. By leveraging accessibility trees and semantic element resolution, the framework mimics human-like navigation, moving beyond brittle DOM selectors to interact reliably with modern web interfaces. The framework distinguishes itself through its focus on secure, scalable exec

      Rust
      View on GitHub↗36,203
    • alibaba/page-agentalibaba avatar

      alibaba/page-agent

      19,138View on GitHub↗

      Page-agent is an LLM browser automation agent and JavaScript in-page GUI controller. It translates natural language instructions into direct browser interface actions to automate web-based tasks and manipulate web page elements through a programmable interface. The system coordinates complex sequences of actions across multiple browser tabs and different websites. It functions as a remote browser control server, providing an interface that allows external clients to operate a browser and manage page interactions. Its capabilities include natural language intent decoding and action mapping, D

      TypeScriptagentaiai-agents
      View on GitHub↗19,138
    • browserbase/mcp-server-browserbasebrowserbase avatar

      browserbase/mcp-server-browserbase

      3,139View on GitHub↗

      This project is an MCP browser automation server that connects large language models to headless cloud browsers. It functions as an autonomous web workflow engine and an LLM web agent interface, enabling the translation of natural language instructions into browser actions and structured data retrieval. The system distinguishes itself through a managed headless browser cloud API that supports concurrent Chromium sessions with integrated stealth modes, CAPTCHA solving, and proxy traffic routing. It utilizes self-healing element selection to maintain automation resilience when page structures c

      TypeScriptaibrowserchrome
      View on GitHub↗3,139
    Compare all 30 related projects→