1 Repo
Awesome GitHub RepositoriesGUI Element Localizations
Methods for finding specific user interface nodes through traversal or natural language descriptions.
Distinct from GUI Resources: None of the candidates cover the active process of localizing/finding elements in an existing OS GUI; they focus on building GUIs or specific toolkits.
Explore 1 awesome GitHub repository matching operating systems & systems programming · GUI Element Localizations. Refine with filters or upvote what's useful.
Awesome GUI Element Localizations GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- simular-ai/agent-s
simular-ai/Agent-S
11,855Auf GitHub ansehenAgent-S is a multimodal AI agent and LLM desktop automation framework designed to control operating systems through graphical user interface interactions. It functions as a computer use interface, utilizing vision-language grounding to translate natural language goals into precise screen coordinates and system actions. The project differentiates itself by combining structured accessibility tree inspection with vision-based element localization. It manages cross-application workflows by mapping conceptual descriptions to physical pixels and simulating low-level keyboard and mouse events to mov
Deno GUI Automation finds specific interface nodes using direct child traversal or natural-language concept searches.
Pythonagent-computer-interfaceai-agentscomputer-automation
