32 repositorios
Specialized retrieval of page structures and content from remote content management systems.
Distinct from Remote Data Fetching: Distinct from general remote data fetching by focusing specifically on CMS page data retrieval for frontend rendering.
Explore 32 awesome GitHub repositories matching data & databases · CMS Content Fetching. Refine with filters or upvote what's useful.
Claude Code is a command-line interface and multi-agent orchestration framework designed for autonomous software engineering. It enables AI agents to perform codebase modifications, debugging, and Git workflow management while coordinating multiple specialized agents to decompose and execute complex engineering tasks in parallel. The system distinguishes itself through a high degree of isolation and safety, utilizing Git worktrees to create independent working directories for concurrent agents and implementing a tiered permission system that combines user rules, project policies, and OS-level
Downloads web content from URLs and converts it to Markdown for LLM processing.
gpt-oss is an open-weight large language model and reasoning engine designed for complex reasoning and agentic workflows. It functions as an AI agent framework and model serving API, allowing for local deployment and the hosting of standardized interfaces to expose model completions and internal reasoning processes. The project distinguishes itself as a quantized inference engine, utilizing tensor parallelism and weight quantization to run high-parameter models on limited hardware. It features a reasoning model that employs chain-of-thought processing to solve multi-step logical tasks. The s
Fetches and converts web page content into a format optimized for LLM consumption and citation.
NotionNext is a static site generator and blog engine that transforms Notion workspace pages into public websites. It functions as a cloud-deployed content management system using the Next.js framework to render data fetched from the Notion API. The system utilizes a template-based layout system to map page categories to predefined visual themes. This allows for the creation of portfolios and blogs where the visual appearance is separated from the content structure. The platform includes automated search engine optimization through metadata-driven sitemap and HTML tag generation. It supports
Retrieves page data from a remote Notion workspace to populate the website frontend.
Reader is a digital content reader and browser-based document viewer. It functions as a digital library manager and content aggregator that collects articles and documents from various online sources into a single interface. The project utilizes a JSON-driven approach to organize and display hierarchies of digital documents. It incorporates a REST-based aggregation model to fetch reading materials and metadata from remote servers for a unified viewing experience. The application provides client-side rendering for digital texts and manages personal collections through a digital library system
Retrieves structured page data and reading materials from remote servers to populate the local view.
EmDash is an open-source content management system built on Astro that combines a visual admin panel with a plugin-driven architecture and server-side rendering. It provides a complete content management system with structured content modeling, a rich text editor using Portable Text format, and a TypeScript API for type-safe content queries. The system supports authentication through passkeys, OAuth 2.1, and external providers, with role-based access control and fine-grained permission scopes. What distinguishes EmDash is its plugin development framework, which supports both native plugins ru
Retrieves every entry for a given content type with error handling.
Carlo is a Node.js web rendering framework and desktop application bundler. It functions as a server-side browser controller and headless automation bridge that uses a local browser instance as the primary user interface for Node.js applications. The project distinguishes itself by providing a bidirectional bridge for cross-environment JavaScript integration, allowing server-side functions to be exposed to the browser window object and enabling the execution of page-context code from the server. It includes capabilities for packaging applications into standalone desktop executables, complete
Fetches and renders the primary application interface from a specified remote origin.
Deep Searcher is an open-source retrieval-augmented generation engine that indexes private documents into a vector database and uses large language models to answer complex questions with cited reasoning. It functions as both a command-line interface and a web API research tool, enabling users to load data and generate comprehensive reports by combining indexed private information with LLM-powered analysis. The system distinguishes itself through a plugin-based provider architecture that supports multiple embedding models, LLM providers, vector databases, and file loaders as interchangeable c
Fetches and indexes content from specified URLs using configurable web crawlers for inclusion in the knowledge base.
Yao is an LLM agent framework and low-code web app builder designed for orchestrating autonomous AI agents. It provides a platform to design, deploy, and coordinate agents with specialized personas that can plan tasks, utilize external tools, and execute multi-stage pipelines. The project distinguishes itself through a Model Context Protocol server for connecting assistants to external binaries and HTTP services, and a gRPC remote execution engine that allows agents to manage remote servers and devices. It includes a model-agnostic provider bridge that supports dynamic switching between vario
Retrieves data, prices, and pages from external websites using a built-in scraping service optimized for LLM use.
Horizon es un sistema de agregación de noticias impulsado por IA diseñado para construir tuberías personalizadas que obtienen, filtran y enriquecen información de diversas fuentes web. Utiliza modelos de lenguaje de gran tamaño para automatizar el filtrado de información, puntuando el contenido para eliminar el ruido y resaltar historias de alto valor. El sistema integra el Protocolo de Contexto de Modelo (Model Context Protocol) para exponer las etapas de la tubería como herramientas para asistentes de IA externos. Emplea un adaptador unificado para estandarizar diversos proveedores de modelos de IA para tareas consistentes de puntuación y resumen de contenido. La tubería agrega datos de feeds RSS, plataformas sociales, kits de herramientas financieras y repositorios de código. Gestiona el contenido mediante deduplicación, filtrado de categorías basado en cuotas y enriquecimiento contextual antes de entregar resúmenes multilingües por correo electrónico, webhooks o despliegue de sitio estático. Los flujos de trabajo se orquestan a través de automatización en la nube recurrente para gestionar la recolección y entrega programada de información procesada.
Builds custom workflows to fetch, deduplicate, and enrich data from diverse web sources before final delivery.
Airweave is a unified AI knowledge base platform that syncs data from external APIs into a searchable layer for retrieval-augmented generation. It provides a pre-built data connector library and a framework for building custom connectors, enabling the extraction, transformation, and synchronization of structured and unstructured data from SaaS applications. The platform includes a hybrid vector retrieval system that combines semantic, neural, and keyword search strategies to deliver grounded context for AI agents. The platform distinguishes itself through an agentic search engine that iterati
Fetches web content from ClinicalTrials.gov pages for downstream LLM consumption.
Rainmeter is a Windows desktop widget engine that renders customizable skins and interactive widgets directly on the desktop, supporting live data feeds and user interaction. It functions as a desktop customization platform and skin authoring framework, allowing users to create widgets by defining data sources and visual elements with full style and layout control. The engine includes a Lua scripting runtime for extending widget functionality with custom logic and data processing, and provides a plugin SDK with a C/C++ API for building native plugins that add new data sources or rendering capa
Fetches and parses web content from URLs and RSS feeds for display in desktop widgets.
Fetches web content and converts it for use by language models in the IDA Pro context.
react-notion-x es un motor de renderizado basado en React y cliente TypeScript diseñado para transformar datos de la API de Notion en páginas web y componentes formateados. Funciona como un analizador y renderizador de contenido que obtiene, normaliza y procesa respuestas de la API de Notion en estructuras de datos consistentes para su visualización. El proyecto incluye una utilidad para transformar contenido complejo de páginas de Notion y estructuras de bloques en markdown de texto plano. Para mantener el rendimiento, utiliza una interfaz de carga diferida (lazy-loading) que difiere la carga de elementos pesados como PDFs y ecuaciones matemáticas. El renderizador admite una amplia gama de tipos de contenido, incluyendo bloques de código con resaltado de sintaxis, colecciones de datos y documentos incrustados. Proporciona capacidades para acceder tanto a páginas públicas como privadas e incluye técnicas de optimización de imágenes como marcadores de posición de baja calidad.
Provides a typed client to retrieve page structures and content from the Notion API.
node-DeepResearch is an autonomous web research engine that uses large language models to iteratively search, read, and reason over web content to answer complex questions. It provides a chat-based interface that displays real-time reasoning steps and final answers, and can be configured to focus exclusively on academic papers by limiting searches to academic repositories. The research engine operates through an agentic search-read-reason loop that repeatedly searches, reads, and reasons until a stopping condition is satisfied. It enforces a token budget to cap total consumption and failed at
Fetches web pages, extracts clean markdown text, and generates image captions for language model ingestion.
TAICHI-flet es un navegador de recursos integrado con IA y una aplicación de escritorio para Windows construida con Flet. Sirve como un centro multimedia centralizado y agregador de contenido web diseñado para combinar utilidades de inteligencia artificial con herramientas para buscar y acceder a películas, música y software. La aplicación permite la agregación de recursos de múltiples fuentes, incluyendo unidades de almacenamiento en la nube y direcciones web externas. Proporciona herramientas especializadas para transmitir y descargar anime y música, leer novelas en línea con reproducción de texto a voz y automatizar operaciones en el sistema operativo Windows utilizando inteligencia artificial. La interfaz incluye un sistema de navegación basado en pestañas para cambiar entre categorías de contenido y un sistema de gestión de temas para personalizar la estética del escritorio y los fondos de pantalla. Las capacidades técnicas incluyen el uso de servidores proxy para saltar restricciones de seguridad de origen cruzado para imágenes remotas y procesamiento mediante hilos demonio para mantener la capacidad de respuesta de la interfaz durante tareas de larga duración.
Downloads HTML and binary data from web addresses to retrieve external multimedia resources.
Crawler4j is a multi-threaded Java web crawler and spider designed for high-volume web traversal and content extraction. It functions as a polite crawling framework that enables the discovery and indexing of HTML and binary content across multiple websites. The project distinguishes itself through a persistent crawling model that serializes session state to local storage, allowing the engine to resume indexing after a crash or interruption. It includes a politeness controller to regulate request frequency and delays, preventing server overloading and IP blocking. The system covers a broad ra
Provides control over whether to follow redirects, include encrypted pages, or process specific content types.
iflow-cli is a command-line interface and suite of AI tools designed for software engineering, workflow orchestration, and multimodal data analysis. It functions as an LLM command line interface that enables users to execute AI workflows, analyze codebase structures, and interact with large language models directly from the terminal. The project features a plugin-based agent architecture that allows for the integration of specialized domain experts and custom instruction sets from an external marketplace. It distinguishes itself through a multimodal AI terminal capable of processing visual da
Extracts raw content from specific URLs to provide text optimized for analysis by language models.
Templater is an Obsidian template engine and JavaScript automation plugin that functions as a dynamic content generator and workflow orchestrator. It enables the automation of document creation and note-taking tasks through the use of dynamic placeholders and embedded logic. The project distinguishes itself by executing custom JavaScript and shell commands to manipulate files and insert data. It allows for interactive note generation via modal prompts for user input and the import of external JavaScript modules to provide reusable logic outside of template files. Its capabilities include pro
Executes HTTP requests to retrieve remote web content for use within documents.
ollama-js es una librería cliente de JavaScript y wrapper de API que proporciona una interfaz programática para interactuar y gestionar modelos de lenguaje grandes. Permite la ejecución de modelos tanto en entornos locales como basados en la nube, facilitando la generación de texto conversacional y la gestión de los ciclos de vida de los modelos. El proyecto se distingue por ofrecer herramientas especializadas para la administración de modelos, incluida la capacidad de descargar, crear y eliminar modelos, así como la capacidad de definir blueprints de modelos personalizados y plantillas de prompts. También proporciona un cliente de incrustación vectorial (vector embedding) para generar representaciones de texto numéricas para admitir pipelines de búsqueda y recuperación semántica. La librería cubre una amplia gama de capacidades, incluyendo análisis multimodal para procesar imágenes, la captura de trazas de razonamiento interno y la aplicación de esquemas JSON estructurados para la extracción de datos. Además, admite la interacción avanzada con modelos a través de la invocación de herramientas y el streaming de respuestas a través de generadores asíncronos. La librería está escrita en TypeScript.
Retrieves raw content from specified URLs for use within language model workflows.
OpenSquilla es un framework de orquestación de agentes LLM diseñado para coordinar flujos de trabajo de IA de varios pasos y la ejecución de herramientas mediante grafos acíclicos dirigidos. Funciona como un sistema centralizado para gestionar paquetes de habilidades especializadas y ejecutar secuencias de razonamiento complejas. El proyecto se distingue por una pasarela de enrutamiento que dirige las tareas a diferentes proveedores de IA según la complejidad, el coste y el rendimiento. Utiliza un sistema de memoria de IA de varios niveles que organiza el conocimiento de trabajo, episódico y semántico mediante embeddings locales y SQLite, junto con un sandbox de ejecución seguro que aísla el código generado por el agente mediante perfiles de permisos basados en riesgos. La plataforma cubre una amplia gama de capacidades, incluyendo despliegue multicanal en web y plataformas de mensajería, programación automatizada de tareas mediante cron y un puente de Model Context Protocol para conectar con herramientas externas. También proporciona herramientas integrales de monitoreo y observabilidad para rastrear costes de tokens, auditar decisiones en tiempo de ejecución y gestionar un catálogo de habilidades reutilizables. El sistema incluye utilidades de línea de comandos para la inicialización del espacio de trabajo y la gestión del ciclo de vida de las habilidades.
Deno AI Agent reads the full content of a specific URL to perform deep inspection of a page.