7 repositorios
Infrastructure for the network-based fetching, asynchronous loading, and ingestion of document content into systems.
Explore 7 awesome GitHub repositories matching content management & publishing · Document Lifecycle and Retrieval. Refine with filters or upvote what's useful.
This project is a privacy-first backend service designed to facilitate retrieval-augmented generation by processing local documents into searchable vector representations. It provides a modular architecture that allows users to ingest diverse file formats, manage document metadata, and perform semantic searches to provide context-aware responses for chat and completion requests. The system distinguishes itself through a database-agnostic abstraction layer that supports various storage backends, ranging from local disk storage to enterprise-grade vector databases. It offers flexible deployment
Processes raw text into searchable document representations to support retrieval-augmented generation workflows.
This project is a portable document rendering engine designed to parse and display complex document layouts directly within standard web browser environments. It functions as a web-native viewer that enables the presentation of documents without requiring external software or browser plugins. The engine utilizes a canvas-based rendering layer to map document page data onto standard web drawing surfaces, ensuring high-fidelity visual output. To maintain interface responsiveness, it offloads heavy parsing and object extraction tasks to background threads. The system also employs asynchronous by
Streams specific document segments on demand to allow immediate viewing without waiting for full file downloads.
Langchain-Chatchat is a system for building retrieval-augmented generation applications and autonomous AI agents. It integrates a knowledge base management system and an agent framework to enable language models to interact with private documents and execute multi-step tasks through external tools. The platform supports local deployment of language models on private infrastructure to operate without an internet connection. It includes a multimodal AI platform that combines vision models for image analysis with text-to-image generation capabilities. The system provides a web-based conversatio
Provides infrastructure for loading, updating, and organizing local documents for subsequent information retrieval.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Downloads and parses raw text files into structured sequences and labels for machine learning.
Glow is a terminal-based interface designed for browsing, rendering, and navigating markdown documentation. It functions as a command-line reader that allows users to discover and view formatted text files directly within their terminal environment. The tool distinguishes itself by providing a high-performance pager that supports both local file system navigation and remote repository access. It automatically scans directories and version control structures to index documentation, while its remote-aware fetching capabilities enable the retrieval of content from web sources and code repositori
Retrieves and views documentation files from remote code repositories and web addresses.
jsdom is a Node.js DOM implementation that functions as a headless browser emulator and virtual browser environment. It provides a pure JavaScript implementation of web standards, acting as a web standards polyfill that simulates the window and document objects within a non-browser runtime. The project implements W3C and WHATWG specifications to provide a programmatic environment for parsing HTML and manipulating content. It serves as an HTML parser and serializer, allowing for the transformation of HTML strings into document structures and the export of those structures back into text. The
Fetches content from remote web addresses to initialize a document structure.
Este proyecto es una utilidad de línea de comandos diseñada para automatizar la creación y el mantenimiento de tablas de contenido dentro de archivos markdown. Funciona como un procesador de documentación estática que analiza los encabezados de los documentos para generar listas de navegación jerárquicas, que luego se inyectan directamente en los archivos fuente. La herramienta se distingue por admitir tanto archivos locales como flujos de red remotos como fuentes de entrada. Utiliza la actualización de contenido basada en marcadores para refrescar las secciones de navegación existentes sin requerir ediciones manuales, e incluye soporte de autenticación para solicitudes remotas para evitar los límites de tasa de servicio al obtener documentación externa. Más allá de la generación básica, la utilidad maneja la normalización de encabezados en slugs de anclaje seguros para URL y gestiona los metadatos estructurales necesarios para una indexación de documentos consistente. Está destinada a agilizar los flujos de trabajo de documentación automatizando el mantenimiento de las estructuras de navegación en los archivos del repositorio y el contenido técnico distribuido.
Fetches and indexes markdown content from external network sources to generate unified navigation structures.