1 repository
Awesome GitHub RepositoriesGUI Element Localizations
Methods for finding specific user interface nodes through traversal or natural language descriptions.
Distinct from GUI Resources: None of the candidates cover the active process of localizing/finding elements in an existing OS GUI; they focus on building GUIs or specific toolkits.
Explore 1 awesome GitHub repository matching operating systems & systems programming · GUI Element Localizations. Refine with filters or upvote what's useful.
Awesome GUI Element Localizations GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- simular-ai/agent-s
simular-ai/Agent-S
11,855Vezi pe GitHubAgent-S is a multimodal AI agent and LLM desktop automation framework designed to control operating systems through graphical user interface interactions. It functions as a computer use interface, utilizing vision-language grounding to translate natural language goals into precise screen coordinates and system actions. The project differentiates itself by combining structured accessibility tree inspection with vision-based element localization. It manages cross-application workflows by mapping conceptual descriptions to physical pixels and simulating low-level keyboard and mouse events to mov
Deno GUI Automation finds specific interface nodes using direct child traversal or natural-language concept searches.
Pythonagent-computer-interfaceai-agentscomputer-automation
