1 repository
Awesome GitHub RepositoriesInterface Data Extraction Tools
Utilities for converting visual interface captures into structured data for automated workflows.
Distinguishing note: Focuses on the extraction of structured data from visual captures for downstream model grounding.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Interface Data Extraction Tools. Refine with filters or upvote what's useful.
Awesome Interface Data Extraction Tools GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- microsoft/omniparser
microsoft/OmniParser
24,377Vezi pe GitHubOmniParser is a multimodal interaction engine designed to function as a desktop automation agent. It interprets visual screen information to execute complex, multi-step tasks across operating system environments by bridging visual interface perception with language models. Through a continuous cycle of observation and command execution, the system grounds high-level natural language instructions into precise, coordinate-based actions. The project distinguishes itself by utilizing vision-based parsing to interact with software interfaces without requiring access to underlying application progr
Converts visual interface captures into structured data elements to help models ground actions accurately.
Jupyter Notebook
