awesome-repositories.com
Blog
MCP
awesome-repositories.com

Entdecke die besten Open-Source-Repositories mit KI-gestützter Suche.

EntdeckenKuratierte SuchenOpen-Source-AlternativenSelf-hosted SoftwareBlogSitemap
ProjektMCP-ServerÜber unsRanking-MethodikPresse
RechtlichesDatenschutzAGB
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

12 Repos

Awesome GitHub RepositoriesAutomated Knowledge Extraction

Systems that automatically parse and structure information from unstructured data sources into a searchable knowledge base.

Distinguishing note: Focuses on the automated synthesis of knowledge from agent interactions rather than manual document management.

Explore 12 awesome GitHub repositories matching artificial intelligence & ml · Automated Knowledge Extraction. Refine with filters or upvote what's useful.

Awesome Automated Knowledge Extraction GitHub Repositories

Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
  • microsoft/ai-agents-for-beginnersAvatar von microsoft

    microsoft/ai-agents-for-beginners

    67,369Auf GitHub ansehen↗

    This project is a structured educational resource and technical guide for designing and implementing autonomous systems using large language models. It provides a comprehensive curriculum and code samples focused on agentic design patterns, autonomous development, and the creation of systems capable of planning and executing multi-step tasks. The resource details the implementation of agentic retrieval-augmented generation, where models autonomously plan and refine data searches. It covers a wide array of orchestrators and design patterns, including metacognitive reflection for self-correctin

    Implements observer agents that automatically extract and summarize valuable information from conversations into persistent knowledge bases.

    Jupyter Notebookagentic-aiagentic-frameworkagentic-rag
    Auf GitHub ansehen↗67,369
  • nexu-io/open-designAvatar von nexu-io

    nexu-io/open-design

    65,830Auf GitHub ansehen↗

    Open Design is an AI design orchestration platform and LLM agent workspace designed for generating prototypes, presentations, and motion graphics. It functions as a local-first environment that integrates various command-line AI agents and coding tools into a unified design workflow, allowing users to migrate design specifications into brand-compliant source code. The project is distinguished by its ability to enforce visual consistency through a design system manager that defines brand contracts and tokens using Markdown. It features a specialized motion graphics generator that converts HTML

    Automatically parses source packets and chat logs to synthesize new memory nodes and design system updates.

    TypeScriptagent-skillsai-agentsai-design
    Auf GitHub ansehen↗65,830
  • zhayujie/chatgpt-on-wechatAvatar von zhayujie

    zhayujie/chatgpt-on-wechat

    45,353Auf GitHub ansehen↗

    This project is an autonomous agent framework designed to integrate large language models with popular messaging platforms. It functions as a middleware platform that enables automated, multimodal interactions by decomposing complex user goals into sequential plans, executing them through external tools, and maintaining persistent context across sessions. The framework distinguishes itself through a modular skill architecture and a hybrid memory system. Users can extend system capabilities by installing custom logic modules from community hubs or generating them through natural language. The

    Agent framework builds a structured knowledge base by automatically extracting insights from shared documents, conversation conclusions, or user requests.

    Pythonaiai-agentchatgpt
    Auf GitHub ansehen↗45,353
  • builderio/gpt-crawlerAvatar von BuilderIO

    BuilderIO/gpt-crawler

    22,248Auf GitHub ansehen↗

    gpt-crawler is a web scraping utility designed to extract website content and convert it into structured text files for use as AI model knowledge bases. It functions as a data generator that crawls specified web addresses to produce the knowledge files required for building custom GPTs, grounding large language models, and providing context to AI agents. The system transforms raw HTML into clean Markdown text to reduce token usage and improve readability for AI models. It utilizes token-aware content chunking and output file size limitations to ensure generated datasets remain compatible with

    Extracts website content and converts it into structured data files to serve as AI model knowledge bases.

    TypeScript
    Auf GitHub ansehen↗22,248
  • voltagent/awesome-claude-code-subagentsAvatar von VoltAgent

    VoltAgent/awesome-claude-code-subagents

    21,906Auf GitHub ansehen↗

    This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven

    Extracts and analyzes patterns from multi-agent interactions to generate actionable insights and best practices for system improvement.

    Shellai-agent-frameworkai-agent-toolsai-agents
    Auf GitHub ansehen↗21,906
  • arangodb/arangodbAvatar von arangodb

    arangodb/arangodb

    14,091Auf GitHub ansehen↗

    This project is a multi-model database system designed to store and manage information as documents, graphs, and key-value pairs within a single engine. It functions as a graph database and knowledge graph platform, providing the infrastructure to build, query, and visualize structured data models. By integrating vector search capabilities, the system serves as a vector database that supports retrieval-augmented generation for artificial intelligence applications. The platform distinguishes itself through a unified query language that allows users to perform document lookups, graph traversals

    Identifies internal data sources and maps their relationships into structured knowledge graphs to provide relevant context for automated intelligence systems.

    C++arangodbdatabasedistributed-database
    Auf GitHub ansehen↗14,091
  • sapientinc/hrmAvatar von sapientinc

    sapientinc/HRM

    12,546Auf GitHub ansehen↗

    HRM is an automated reasoning engine and language framework designed to execute complex, multi-scale problem solving. It functions as a reinforcement learning agent that continuously updates internal knowledge representations to improve task performance based on incoming data streams. The system distinguishes itself through a hierarchical architecture that coordinates abstract, long-term planning with granular, low-level logic. By integrating evolutionary algorithms and reinforcement learning, the framework refines model parameters and weights over successive generations, ensuring that intern

    Automatically updates and structures internal data models to maintain relevance for decision-making.

    Pythonbrain-inspired-aideep-learninglarge-language-models
    Auf GitHub ansehen↗12,546
  • datahub-project/datahubAvatar von datahub-project

    datahub-project/datahub

    12,141Auf GitHub ansehen↗

    DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

    Analyzes query logs and transformation projects to continuously generate and validate semantic definitions and join patterns for use by artificial intelligence agents.

    Pythondata-catalogdata-discoverydata-governance
    Auf GitHub ansehen↗12,141
  • yusufkaraaslan/skill_seekersAvatar von yusufkaraaslan

    yusufkaraaslan/Skill_Seekers

    9,641Auf GitHub ansehen↗

    Skill Seekers is a toolset for generating large language model knowledge bases, featuring a multi-source content scraper and a dedicated RAG data pipeline. It extracts technical data from documentation, code, and video to create structured assets and configuration files for AI-powered IDE extensions. The project distinguishes itself through the ability to transform raw data into polished tutorials and specialized skills for AI plugin marketplaces. It utilizes abstract syntax tree parsing and optical character recognition to analyze GitHub repositories, PDFs, and video frames, converting these

    Provides a pipeline to automatically parse and structure information from unstructured data into a searchable knowledge base.

    Pythonai-toolsast-parserautomation
    Auf GitHub ansehen↗9,641
  • nevamind-ai/memuAvatar von NevaMind-AI

    NevaMind-AI/memU

    9,470Auf GitHub ansehen↗

    memU is a long-term memory system for AI agents that provides a persistent knowledge base. It extracts facts and preferences from conversations into structured memories, organizing this information through a hierarchical knowledge base based on a file-system architecture of nested categories and linked resources. The system includes a multimodal data ingestion pipeline that converts audio, video, and images into standardized natural language for storage in large language model contexts. It also features a model provider abstraction layer, offering a unified interface to use interchangeable la

    Automatically parses and structures information from conversations into a searchable knowledge base.

    Pythonagent-memoryagentic-workflowclaude
    Auf GitHub ansehen↗9,470
  • zhayujie/bot-on-anythingAvatar von zhayujie

    zhayujie/bot-on-anything

    4,199Auf GitHub ansehen↗

    Dieses Projekt ist ein Multi-Channel-KI-Agent- und Chatbot-Framework, das es ermöglicht, eine einzige KI-Intelligenz über verschiedene Messaging-Plattformen, Web-Interfaces und E-Mail-Konten hinweg bereitzustellen. Es fungiert als Cross-Model-KI-Gateway und bietet ein einheitliches Interface, um Requests zwischen verschiedenen Large-Language-Model-Anbietern weiterzuleiten. Das System zeichnet sich durch seine autonomen Aufgabenplanungs- und Wissensmanagementfunktionen aus. Es kann komplexe Ziele in sequentielle Ausführungsschritte unter Verwendung externer Tools und eines Headless-Browsers zerlegen, während es gleichzeitig Informationen aus Konversationen extrahiert, um eine strukturierte Wissensdatenbank mit visuellen Beziehungsdiagrammen aufzubauen. Die Plattform enthält ein mehrstufiges Gedächtnissystem für den Langzeit-Kontextabruf, eine dynamische Skill-Plugin-Engine zur Erweiterung der Funktionalität und die Fähigkeit, Remote-Systembefehle auszuführen. Sie unterstützt zudem multimodale Workflows, die den Austausch von Bildern, Sprachnachrichten und Dateien über verschiedene Kommunikationskanäle hinweg ermöglichen. Die Instanz kann über eine Web-Konsole, ein Terminal-basiertes Befehlsinterface oder via In-Chat-Slash-Befehle verwaltet werden.

    Automatically extracts key information from documents and conversations to create a structured, interlinked knowledge base.

    Pythonchatgptclaudegemini
    Auf GitHub ansehen↗4,199
  • volcengine/openvikingAvatar von volcengine

    volcengine/OpenViking

    2,993Auf GitHub ansehen↗

    OpenViking is a multi-tenant context server and knowledge base administration system designed to provide AI agents with persistent long-term memory. It enables the indexing of diverse documents and codebases to support retrieval-augmented generation, allowing agents to recall past interactions, user preferences, and learned experiences across sessions. The project is distinguished by its use of a URI-based virtual filesystem to organize memories, resources, and skills. It implements a tiered context loading system that balances retrieval precision with token budgets by structuring data into a

    Distills reusable strategies and usage patterns from interaction records for knowledge accumulation.

    Pythonagentagentic-ragai-agents
    Auf GitHub ansehen↗2,993
  1. Home
  2. Artificial Intelligence & ML
  3. Automated Knowledge Extraction

Unter-Tags erkunden

  • Knowledge Discovery PipelinesAutomated workflows for identifying and mapping internal data sources into structured knowledge graphs. **Distinct from Automated Knowledge Extraction:** Distinct from Automated Knowledge Extraction: focuses on the discovery and mapping of organizational data domains specifically.