12 Repos
Systems that automatically parse and structure information from unstructured data sources into a searchable knowledge base.
Distinguishing note: Focuses on the automated synthesis of knowledge from agent interactions rather than manual document management.
Explore 12 awesome GitHub repositories matching artificial intelligence & ml · Automated Knowledge Extraction. Refine with filters or upvote what's useful.
This project is a structured educational resource and technical guide for designing and implementing autonomous systems using large language models. It provides a comprehensive curriculum and code samples focused on agentic design patterns, autonomous development, and the creation of systems capable of planning and executing multi-step tasks. The resource details the implementation of agentic retrieval-augmented generation, where models autonomously plan and refine data searches. It covers a wide array of orchestrators and design patterns, including metacognitive reflection for self-correctin
Implements observer agents that automatically extract and summarize valuable information from conversations into persistent knowledge bases.
Open Design is an AI design orchestration platform and LLM agent workspace designed for generating prototypes, presentations, and motion graphics. It functions as a local-first environment that integrates various command-line AI agents and coding tools into a unified design workflow, allowing users to migrate design specifications into brand-compliant source code. The project is distinguished by its ability to enforce visual consistency through a design system manager that defines brand contracts and tokens using Markdown. It features a specialized motion graphics generator that converts HTML
Automatically parses source packets and chat logs to synthesize new memory nodes and design system updates.
This project is an autonomous agent framework designed to integrate large language models with popular messaging platforms. It functions as a middleware platform that enables automated, multimodal interactions by decomposing complex user goals into sequential plans, executing them through external tools, and maintaining persistent context across sessions. The framework distinguishes itself through a modular skill architecture and a hybrid memory system. Users can extend system capabilities by installing custom logic modules from community hubs or generating them through natural language. The
Agent framework builds a structured knowledge base by automatically extracting insights from shared documents, conversation conclusions, or user requests.
gpt-crawler is a web scraping utility designed to extract website content and convert it into structured text files for use as AI model knowledge bases. It functions as a data generator that crawls specified web addresses to produce the knowledge files required for building custom GPTs, grounding large language models, and providing context to AI agents. The system transforms raw HTML into clean Markdown text to reduce token usage and improve readability for AI models. It utilizes token-aware content chunking and output file size limitations to ensure generated datasets remain compatible with
Extracts website content and converts it into structured data files to serve as AI model knowledge bases.
This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven
Extracts and analyzes patterns from multi-agent interactions to generate actionable insights and best practices for system improvement.
This project is a multi-model database system designed to store and manage information as documents, graphs, and key-value pairs within a single engine. It functions as a graph database and knowledge graph platform, providing the infrastructure to build, query, and visualize structured data models. By integrating vector search capabilities, the system serves as a vector database that supports retrieval-augmented generation for artificial intelligence applications. The platform distinguishes itself through a unified query language that allows users to perform document lookups, graph traversals
Identifies internal data sources and maps their relationships into structured knowledge graphs to provide relevant context for automated intelligence systems.
HRM is an automated reasoning engine and language framework designed to execute complex, multi-scale problem solving. It functions as a reinforcement learning agent that continuously updates internal knowledge representations to improve task performance based on incoming data streams. The system distinguishes itself through a hierarchical architecture that coordinates abstract, long-term planning with granular, low-level logic. By integrating evolutionary algorithms and reinforcement learning, the framework refines model parameters and weights over successive generations, ensuring that intern
Automatically updates and structures internal data models to maintain relevance for decision-making.
DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono
Analyzes query logs and transformation projects to continuously generate and validate semantic definitions and join patterns for use by artificial intelligence agents.
Skill Seekers is a toolset for generating large language model knowledge bases, featuring a multi-source content scraper and a dedicated RAG data pipeline. It extracts technical data from documentation, code, and video to create structured assets and configuration files for AI-powered IDE extensions. The project distinguishes itself through the ability to transform raw data into polished tutorials and specialized skills for AI plugin marketplaces. It utilizes abstract syntax tree parsing and optical character recognition to analyze GitHub repositories, PDFs, and video frames, converting these
Provides a pipeline to automatically parse and structure information from unstructured data into a searchable knowledge base.
memU is a long-term memory system for AI agents that provides a persistent knowledge base. It extracts facts and preferences from conversations into structured memories, organizing this information through a hierarchical knowledge base based on a file-system architecture of nested categories and linked resources. The system includes a multimodal data ingestion pipeline that converts audio, video, and images into standardized natural language for storage in large language model contexts. It also features a model provider abstraction layer, offering a unified interface to use interchangeable la
Automatically parses and structures information from conversations into a searchable knowledge base.
Dieses Projekt ist ein Multi-Channel-KI-Agent- und Chatbot-Framework, das es ermöglicht, eine einzige KI-Intelligenz über verschiedene Messaging-Plattformen, Web-Interfaces und E-Mail-Konten hinweg bereitzustellen. Es fungiert als Cross-Model-KI-Gateway und bietet ein einheitliches Interface, um Requests zwischen verschiedenen Large-Language-Model-Anbietern weiterzuleiten. Das System zeichnet sich durch seine autonomen Aufgabenplanungs- und Wissensmanagementfunktionen aus. Es kann komplexe Ziele in sequentielle Ausführungsschritte unter Verwendung externer Tools und eines Headless-Browsers zerlegen, während es gleichzeitig Informationen aus Konversationen extrahiert, um eine strukturierte Wissensdatenbank mit visuellen Beziehungsdiagrammen aufzubauen. Die Plattform enthält ein mehrstufiges Gedächtnissystem für den Langzeit-Kontextabruf, eine dynamische Skill-Plugin-Engine zur Erweiterung der Funktionalität und die Fähigkeit, Remote-Systembefehle auszuführen. Sie unterstützt zudem multimodale Workflows, die den Austausch von Bildern, Sprachnachrichten und Dateien über verschiedene Kommunikationskanäle hinweg ermöglichen. Die Instanz kann über eine Web-Konsole, ein Terminal-basiertes Befehlsinterface oder via In-Chat-Slash-Befehle verwaltet werden.
Automatically extracts key information from documents and conversations to create a structured, interlinked knowledge base.
OpenViking is a multi-tenant context server and knowledge base administration system designed to provide AI agents with persistent long-term memory. It enables the indexing of diverse documents and codebases to support retrieval-augmented generation, allowing agents to recall past interactions, user preferences, and learned experiences across sessions. The project is distinguished by its use of a URI-based virtual filesystem to organize memories, resources, and skills. It implements a tiered context loading system that balances retrieval precision with token budgets by structuring data into a
Distills reusable strategies and usage patterns from interaction records for knowledge accumulation.