1 repo
Awesome GitHub RepositoriesVision-Based UI Parsing Libraries
Libraries for transforming interface screenshots into structured data for AI interaction.
Distinguishing note: Focuses on the transformation of static screenshots into machine-readable formats.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Vision-Based UI Parsing Libraries. Refine with filters or upvote what's useful.
Awesome Vision-Based UI Parsing Libraries GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- microsoft/OmniParser
microsoft/OmniParser
24,377View on GitHubOmniParser is a multimodal interaction engine designed to function as a desktop automation agent. It interprets visual screen information to execute complex, multi-step tasks across operating system environments by bridging visual interface perception with language models. Through a continuous cycle of observation and command execution, the system grounds high-level natural language instructions into precise, coordinate-based actions. The project distinguishes itself by utilizing vision-based parsing to interact with software interfaces without requiring access to underlying application progr
Transforms static screenshots of software interfaces into structured data formats for artificial intelligence models.
Jupyter Notebook
