# usagi-org/ai-goofish-monitor **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/usagi-org-ai-goofish-monitor).** 9,002 stars · 1,255 forks · Python · mit ## Links - GitHub: https://github.com/Usagi-org/ai-goofish-monitor - awesome-repositories: https://awesome-repositories.com/repository/usagi-org-ai-goofish-monitor.md ## Topics `ai` `playwright` ## Description ai-goofish-monitor is an AI-driven marketplace monitor and containerized web scraper designed to track online listings. It uses multimodal large language models and natural language prompts to analyze product text and images, determining if items meet specific requirements. The system employs an anti-detection workflow that rotates network proxies and authenticated accounts to bypass rate limits. It captures browser cookies and session states to mimic real user behavior during automated requests. The project includes a task scheduler using cron expressions and an embedded SQLite database for data persistence. It provides filtering by keywords and region, real-time execution log visualization for troubleshooting, and a multi-channel notification system that dispatches alerts via webhooks and messaging bots. The application is delivered via containerized orchestration or a single packaged executable that launches the backend server and web interface. ## Tags ### DevOps & Infrastructure - [Product Listing Evaluation](https://awesome-repositories.com/f/devops-infrastructure/infrastructure/version-control-systems/git-based-repositories/git-based-code-analysis-platforms/llm-based-analysis/product-listing-evaluation.md) — Uses multimodal AI and natural language prompts to automatically evaluate product listings. - [Container Deployment](https://awesome-repositories.com/f/devops-infrastructure/container-deployment.md) — Provides a containerized deployment workflow for consistent installation across environments. - [Containerized Deployments](https://awesome-repositories.com/f/devops-infrastructure/containerized-deployments.md) — Orchestrates the application and its data stores using Docker for consistent deployment. ([source](https://github.com/Usagi-org/ai-goofish-monitor/blob/master/docker-compose.yaml)) ### Web Development - [Web Scrapers](https://awesome-repositories.com/f/web-development/web-automation-scraping/web-scraping-automation/web-scraping/web-scrapers.md) — Implements a containerized system for navigating marketplaces and extracting structured product data. - [Identity File Generators](https://awesome-repositories.com/f/web-development/browser-identity-automation/identity-file-generators.md) — Collects login cookies and browser details to generate local identity files for automation. ([source](https://github.com/Usagi-org/ai-goofish-monitor/blob/master/xianyu-login-state-privacy.html)) - [Browser Session Managers](https://awesome-repositories.com/f/web-development/web-automation-scraping/web-scraping-automation/browser-automation/browser-session-managers.md) — Provides session and cookie management to mimic real user behavior and bypass authentication barriers during scraping. ### Artificial Intelligence & ML - [AI Marketplace Monitors](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-marketplace-monitors.md) — Uses multimodal LLMs to analyze product text and images against natural language prompts for automated monitoring. - [Listing Evaluation](https://awesome-repositories.com/f/artificial-intelligence-ml/artificial-intelligence-tooling/ai-observability-evaluation/listing-evaluation.md) — Evaluates product details against custom prompt files using AI to determine if listings meet specific requirements. ([source](https://github.com/Usagi-org/ai-goofish-monitor/blob/master/spider_v2.py)) - [Multimodal Large Language Models](https://awesome-repositories.com/f/artificial-intelligence-ml/multimodal-large-language-models.md) — Employs multimodal large language models to process both visual and textual product data. ### Business & Productivity Software - [Marketplace Activity Monitors](https://awesome-repositories.com/f/business-productivity-software/marketplace-activity-monitors.md) — Tracks product listings using keyword rules and price ranges to identify desired items in real-time. ([source](https://github.com/Usagi-org/ai-goofish-monitor#readme)) ### Data & Databases - [Product Listing Analysis](https://awesome-repositories.com/f/data-databases/ai-data-analysis-tools/product-listing-analysis.md) — Uses multimodal AI to analyze product listings and images against specific requirements. ([source](https://github.com/Usagi-org/ai-goofish-monitor#readme)) - [Product Stock Monitoring](https://awesome-repositories.com/f/data-databases/consumer-offset-trackers/consumer-lag-monitoring/consumable-stock-monitoring/product-stock-monitoring.md) — Tracks online marketplace listings using keywords and AI to provide instant alerts for desired items. ### Development Tools & Productivity - [Session Capturers](https://awesome-repositories.com/f/development-tools-productivity/session-capturers.md) — Captures cookies and storage snapshots from live sessions to mimic human behavior. ([source](https://github.com/Usagi-org/ai-goofish-monitor/tree/master/chrome-extension)) - [Background Task Schedulers](https://awesome-repositories.com/f/development-tools-productivity/background-task-schedulers.md) — Uses an embedded SQLite database and cron expressions to manage recurring background page scanning jobs. - [Cron Scheduling](https://awesome-repositories.com/f/development-tools-productivity/cron-scheduling.md) — Implements time-based monitoring job execution using standard cron expressions. - [Notification Integrations](https://awesome-repositories.com/f/development-tools-productivity/notification-integrations.md) — Integrates internal monitoring events with external messaging and notification services. - [Task Scheduling](https://awesome-repositories.com/f/development-tools-productivity/task-scheduling.md) — Automates periodic monitoring checks using a fixed timetable for continuous surveillance. ([source](https://github.com/Usagi-org/ai-goofish-monitor/blob/master/CLAUDE.md)) - [Webhook Notifications](https://awesome-repositories.com/f/development-tools-productivity/webhook-notifications.md) — Dispatches real-time alerts via webhooks and messaging bots when criteria are met. ### Networking & Communication - [Proxy and Fingerprint Rotation](https://awesome-repositories.com/f/networking-communication/proxy-rotation-services/proxy-and-fingerprint-rotation.md) — Rotates network proxies and browser fingerprints to bypass rate limits and avoid detection. - [Event Notifications](https://awesome-repositories.com/f/networking-communication/event-notifications.md) — Triggers instant alerts via webhooks and messaging bots when matching items or changes are detected. ([source](https://github.com/Usagi-org/ai-goofish-monitor/blob/master/requirements-runtime.txt)) ### Security & Cryptography - [Anti-Bot Evasion](https://awesome-repositories.com/f/security-cryptography/bot-detection/anti-bot-evasion.md) — Mimics browser fingerprints and rotates proxies to evade bot detection and rate limits. - [Browser State Capturers](https://awesome-repositories.com/f/security-cryptography/session-cookie-handlers/browser-state-capturers.md) — Captures browser cookies and environment snapshots to mimic real user identities. ### System Administration & Monitoring - [Multi-Channel Alerting Engines](https://awesome-repositories.com/f/system-administration-monitoring/multi-channel-alerting-engines.md) — Dispatches real-time alerts via webhooks and messaging bots when marketplace matches are detected.