32 مستودعات
Specialized retrieval of page structures and content from remote content management systems.
Distinct from Remote Data Fetching: Distinct from general remote data fetching by focusing specifically on CMS page data retrieval for frontend rendering.
Explore 32 awesome GitHub repositories matching data & databases · CMS Content Fetching. Refine with filters or upvote what's useful.
Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level
Downloads web content from URLs and converts it to Markdown for LLM processing.
gpt-oss is an open-weight large language model and reasoning engine designed for complex reasoning and agentic workflows. It functions as an AI agent framework and model serving API, allowing for local deployment and the hosting of standardized interfaces to expose model completions and internal reasoning processes. The project distinguishes itself as a quantized inference engine, utilizing tensor parallelism and weight quantization to run high-parameter models on limited hardware. It features a reasoning model that employs chain-of-thought processing to solve multi-step logical tasks. The s
Fetches and converts web page content into a format optimized for LLM consumption and citation.
NotionNext is a static site generator and blog engine that transforms Notion workspace pages into public websites. It functions as a cloud-deployed content management system using the Next.js framework to render data fetched from the Notion API. The system utilizes a template-based layout system to map page categories to predefined visual themes. This allows for the creation of portfolios and blogs where the visual appearance is separated from the content structure. The platform includes automated search engine optimization through metadata-driven sitemap and HTML tag generation. It supports
Retrieves page data from a remote Notion workspace to populate the website frontend.
Reader is a digital content reader and browser-based document viewer. It functions as a digital library manager and content aggregator that collects articles and documents from various online sources into a single interface. The project utilizes a JSON-driven approach to organize and display hierarchies of digital documents. It incorporates a REST-based aggregation model to fetch reading materials and metadata from remote servers for a unified viewing experience. The application provides client-side rendering for digital texts and manages personal collections through a digital library system
Retrieves structured page data and reading materials from remote servers to populate the local view.
EmDash is an open-source content management system built on Astro that combines a visual admin panel with a plugin-driven architecture and server-side rendering. It provides a complete content management system with structured content modeling, a rich text editor using Portable Text format, and a TypeScript API for type-safe content queries. The system supports authentication through passkeys, OAuth 2.1, and external providers, with role-based access control and fine-grained permission scopes. What distinguishes EmDash is its plugin development framework, which supports both native plugins ru
Retrieves every entry for a given content type with error handling.
Carlo is a Node.js web rendering framework and desktop application bundler. It functions as a server-side browser controller and headless automation bridge that uses a local browser instance as the primary user interface for Node.js applications. The project distinguishes itself by providing a bidirectional bridge for cross-environment JavaScript integration, allowing server-side functions to be exposed to the browser window object and enabling the execution of page-context code from the server. It includes capabilities for packaging applications into standalone desktop executables, complete
Fetches and renders the primary application interface from a specified remote origin.
Deep Searcher is an open-source retrieval-augmented generation engine that indexes private documents into a vector database and uses large language models to answer complex questions with cited reasoning. It functions as both a command-line interface and a web API research tool, enabling users to load data and generate comprehensive reports by combining indexed private information with LLM-powered analysis. The system distinguishes itself through a plugin-based provider architecture that supports multiple embedding models, LLM providers, vector databases, and file loaders as interchangeable c
Fetches and indexes content from specified URLs using configurable web crawlers for inclusion in the knowledge base.
Yao is an LLM agent framework and low-code web app builder designed for orchestrating autonomous AI agents. It provides a platform to design, deploy, and coordinate agents with specialized personas that can plan tasks, utilize external tools, and execute multi-stage pipelines. The project distinguishes itself through a Model Context Protocol server for connecting assistants to external binaries and HTTP services, and a gRPC remote execution engine that allows agents to manage remote servers and devices. It includes a model-agnostic provider bridge that supports dynamic switching between vario
Retrieves data, prices, and pages from external websites using a built-in scraping service optimized for LLM use.
Horizon هو نظام تجميع أخبار مدعوم بالذكاء الاصطناعي مصمم لبناء خطوط أنابيب مخصصة تجلب وتصفي وتثري المعلومات من مصادر ويب متنوعة. يستخدم نماذج لغوية كبيرة لأتمتة تصفية المعلومات، وتسجيل المحتوى لإزالة الضوضاء وتسليط الضوء على القصص عالية القيمة. يدمج النظام بروتوكول سياق النموذج (Model Context Protocol) لكشف مراحل خط الأنابيب كأدوات لمساعدي الذكاء الاصطناعي الخارجيين. يستخدم محولاً موحداً لتوحيد مزودي نماذج الذكاء الاصطناعي المتنوعين لمهام تسجيل المحتوى والتلخيص المتسقة. يجمع خط الأنابيب البيانات من خلاصات RSS، والمنصات الاجتماعية، ومجموعات الأدوات المالية، ومستودعات الكود. يدير المحتوى من خلال إلغاء التكرار، وتصفية الفئات القائمة على الحصص، والإثراء السياقي قبل تقديم إحاطات متعددة اللغات عبر البريد الإلكتروني أو خطافات الويب أو نشر الموقع الساكن. يتم تنسيق سير العمل من خلال أتمتة سحابية متكررة لإدارة الجمع والتقديم المجدول للمعلومات المعالجة.
Builds custom workflows to fetch, deduplicate, and enrich data from diverse web sources before final delivery.
Airweave is a unified AI knowledge base platform that syncs data from external APIs into a searchable layer for retrieval-augmented generation. It provides a pre-built data connector library and a framework for building custom connectors, enabling the extraction, transformation, and synchronization of structured and unstructured data from SaaS applications. The platform includes a hybrid vector retrieval system that combines semantic, neural, and keyword search strategies to deliver grounded context for AI agents. The platform distinguishes itself through an agentic search engine that iterati
Fetches web content from ClinicalTrials.gov pages for downstream LLM consumption.
Rainmeter is a Windows desktop widget engine that renders customizable skins and interactive widgets directly on the desktop, supporting live data feeds and user interaction. It functions as a desktop customization platform and skin authoring framework, allowing users to create widgets by defining data sources and visual elements with full style and layout control. The engine includes a Lua scripting runtime for extending widget functionality with custom logic and data processing, and provides a plugin SDK with a C/C++ API for building native plugins that add new data sources or rendering capa
Fetches and parses web content from URLs and RSS feeds for display in desktop widgets.
Fetches web content and converts it for use by language models in the IDA Pro context.
react-notion-x هو محرك عرض قائم على React وعميل TypeScript مصمم لتحويل بيانات Notion API إلى صفحات ويب ومكونات منسقة. يعمل كمحلل محتوى وعارض يقوم بجلب وتطبيع ومعالجة استجابات Notion API إلى هياكل بيانات متسقة للعرض. يتضمن المشروع أداة لتحويل محتوى صفحة Notion المعقد وهياكل الكتل إلى نص Markdown عادي. للحفاظ على الأداء، يستخدم واجهة تحميل كسول (lazy-loading) تؤجل تحميل العناصر الثقيلة مثل ملفات PDF والمعادلات الرياضية. يدعم العارض مجموعة واسعة من أنواع المحتوى، بما في ذلك كتل الكود مع تمييز الصيغة، ومجموعات البيانات، والمستندات المضمنة. يوفر قدرات للوصول إلى كل من الصفحات العامة والخاصة ويتضمن تقنيات تحسين الصور مثل العناصر النائية منخفضة الجودة.
Provides a typed client to retrieve page structures and content from the Notion API.
node-DeepResearch is an autonomous web research engine that uses large language models to iteratively search, read, and reason over web content to answer complex questions. It provides a chat-based interface that displays real-time reasoning steps and final answers, and can be configured to focus exclusively on academic papers by limiting searches to academic repositories. The research engine operates through an agentic search-read-reason loop that repeatedly searches, reads, and reasons until a stopping condition is satisfied. It enforces a token budget to cap total consumption and failed at
Fetches web pages, extracts clean markdown text, and generates image captions for language model ingestion.
TAICHI-flet is an AI-integrated resource browser and Windows desktop application built with Flet. It serves as a centralized multimedia hub and web content aggregator designed to combine artificial intelligence utilities with tools for searching and accessing movies, music, and software. The application enables the aggregation of resources from multiple sources, including cloud storage drives and external web addresses. It provides specialized tools for streaming and downloading anime and music, reading online novels with text-to-speech playback, and automating operations on the Windows opera
Downloads HTML and binary data from web addresses to retrieve external multimedia resources.
Crawler4j هو زاحف ويب (web crawler) متعدد الخيوط بلغة Java مصمم للزحف إلى الويب واستخراج المحتوى بأحجام كبيرة. يعمل كإطار عمل للزحف المهذب الذي يتيح اكتشاف وفهرسة محتوى HTML والمحتوى الثنائي عبر مواقع ويب متعددة. يتميز المشروع بنموذج زحف مستمر يقوم بتسلسل حالة الجلسة إلى التخزين المحلي، مما يسمح للمحرك باستئناف الفهرسة بعد حدوث عطل أو انقطاع. يتضمن وحدة تحكم في التهذيب لتنظيم تكرار الطلبات والتأخيرات، مما يمنع تحميل الخادم بشكل زائد وحظر عنوان IP. يغطي النظام مجموعة واسعة من قدرات الزحف، بما في ذلك إدارة النطاق المحدود بالعمق، وتصفية الأهداف، واعتراض الطلبات لوكلاء المستخدم المخصصين وتوجيه الوكيل (proxy). تتم إدارة تخزين البيانات عبر نمط المستودع (repository pattern) الذي يفصل منطق الزحف عن استمرارية بيانات تعريف الصفحة في قواعد البيانات العلائقية.
Provides control over whether to follow redirects, include encrypted pages, or process specific content types.
iflow-cli is a command-line interface and suite of AI tools designed for software engineering, workflow orchestration, and multimodal data analysis. It functions as an LLM command line interface that enables users to execute AI workflows, analyze codebase structures, and interact with large language models directly from the terminal. The project features a plugin-based agent architecture that allows for the integration of specialized domain experts and custom instruction sets from an external marketplace. It distinguishes itself through a multimodal AI terminal capable of processing visual da
Extracts raw content from specific URLs to provide text optimized for analysis by language models.
Templater is an Obsidian template engine and JavaScript automation plugin that functions as a dynamic content generator and workflow orchestrator. It enables the automation of document creation and note-taking tasks through the use of dynamic placeholders and embedded logic. The project distinguishes itself by executing custom JavaScript and shell commands to manipulate files and insert data. It allows for interactive note generation via modal prompts for user input and the import of external JavaScript modules to provide reusable logic outside of template files. Its capabilities include pro
Executes HTTP requests to retrieve remote web content for use within documents.
ollama-js is a JavaScript client library and API wrapper that provides a programmatic interface for interacting with and managing large language models. It enables the execution of models in both local and cloud-based environments, facilitating the generation of conversational text and the management of model lifecycles. The project distinguishes itself by offering specialized tools for model administration, including the ability to download, create, and remove models, as well as the capacity to define custom model blueprints and prompt templates. It also provides a vector embedding client fo
Retrieves raw content from specified URLs for use within language model workflows.
OpenSquilla هو إطار عمل لتنسيق وكلاء LLM مصمم لتنسيق سير عمل الذكاء الاصطناعي متعدد الخطوات وتنفيذ الأدوات باستخدام الرسوم البيانية الموجهة غير الدورية (DAGs). يعمل كنظام مركزي لإدارة حزم المهارات المتخصصة وتنفيذ تسلسلات التفكير المعقدة. يتميز المشروع ببوابة توجيه توجه المهام إلى مزودي ذكاء اصطناعي مختلفين بناءً على التعقيد والتكلفة والأداء. يستخدم نظام ذاكرة ذكاء اصطناعي متعدد المستويات ينظم المعرفة العاملة والعرضية والدلالية باستخدام التضمينات المحلية و SQLite، إلى جانب بيئة تنفيذ آمنة تعزل الكود الذي تم إنشاؤه بواسطة الوكيل عبر ملفات تعريف أذونات قائمة على المخاطر. تغطي المنصة مجموعة واسعة من الإمكانيات، بما في ذلك النشر متعدد القنوات على الويب ومنصات المراسلة، وجدولة المهام الآلية عبر cron، وجسر بروتوكول سياق النموذج (Model Context Protocol) للاتصال بالأدوات الخارجية. كما يوفر أدوات مراقبة شاملة لتتبع تكاليف الرموز (Tokens)، وتدقيق قرارات وقت التشغيل، وإدارة كتالوج للمهارات القابلة لإعادة الاستخدام. يتضمن النظام أدوات سطر أوامر لتهيئة مساحة العمل وإدارة دورة حياة المهارات.
Deno AI Agent reads the full content of a specific URL to perform deep inspection of a page.