←BackBuilderIO/gpt-crawler0Copy as MarkdownView on GitHub↗22,248 stars·2,369 forks·TypeScript·ISC·0 viewswww.builder.io/blog/custom-gpt↗Gpt CrawlerFeaturesCustom GPTs - Scrapes web content to create knowledge bases for custom agents.LLM Applications - Tool to crawl websites for generating custom GPT knowledge files.Web Scraping and Crawling - Crawl websites to generate knowledge files for custom GPTs.