awesome-repositories.com
المدونة
awesome-repositories.com

اكتشف أفضل مستودعات المصادر المفتوحة باستخدام بحث مدعوم بالذكاء الاصطناعي.

استكشفعمليات بحث منسقةبدائل مفتوحة المصدربرمجيات ذاتية الاستضافةالمدونةخريطة الموقع
المشروعحولكيفية ترتيب النتائجالصحافةخادم MCP
قانونيالخصوصيةالشروط
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

27 مستودعات

Awesome GitHub RepositoriesMulti-Source Content Aggregation

Systems for merging technical data from disparate sources like websites, repositories, and media into a unified structure.

Distinct from Multi-file Aggregators: Candidates focus on real-time telemetry streams or simple file globs; this is multi-modal technical content aggregation.

Explore 27 awesome GitHub repositories matching data & databases · Multi-Source Content Aggregation. Refine with filters or upvote what's useful.

Awesome Multi-Source Content Aggregation GitHub Repositories

اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
  • camel-ai/owlالصورة الرمزية لـ camel-ai

    camel-ai/owl

    19,864عرض على GitHub↗

    Owl is a framework for agentic workflow automation and multi-agent orchestration. It functions as a system for coordinating autonomous large language model agents to decompose and execute complex tasks through shared communication and collaborative planning. The project distinguishes itself through a multi-modal toolset for processing images, audio, and video, alongside a synthetic data generator that produces domain-specific datasets using self-instruct and verifier loops. It further incorporates a retrieval-augmented generation pipeline framework that integrates long-term memory and real-ti

    Ships a suite of tools for processing images, audio, and video files alongside structured document parsing.

    Pythonagentartificial-intelligencemulti-agent-systems
    عرض على GitHub↗19,864
  • alibaba-nlp/webagentالصورة الرمزية لـ Alibaba-NLP

    Alibaba-NLP/WebAgent

    19,549عرض على GitHub↗

    WebAgent is an autonomous web navigation agent and research system designed to browse the internet and synthesize information to answer complex queries. It functions as a reasoning orchestrator that navigates the web iteratively to perform deep research and extract structured data. The project includes a reinforcement learning training pipeline that generates synthetic interaction datasets for model pre-training and fine-tuning. It employs token-level policy gradients to stabilize training in non-stationary environments and uses a dual-mode inference scaling mechanism to balance execution bet

    Normalizes heterogeneous inputs from live web pages and local PDFs into a uniform representation for processing.

    Python
    عرض على GitHub↗19,549
  • yusufkaraaslan/skill_seekersالصورة الرمزية لـ yusufkaraaslan

    yusufkaraaslan/Skill_Seekers

    9,641عرض على GitHub↗

    Skill Seekers is a toolset for generating large language model knowledge bases, featuring a multi-source content scraper and a dedicated RAG data pipeline. It extracts technical data from documentation, code, and video to create structured assets and configuration files for AI-powered IDE extensions. The project distinguishes itself through the ability to transform raw data into polished tutorials and specialized skills for AI plugin marketplaces. It utilizes abstract syntax tree parsing and optical character recognition to analyze GitHub repositories, PDFs, and video frames, converting these

    Combines content from websites, repositories, and media files into a unified knowledge structure.

    Pythonai-toolsast-parserautomation
    عرض على GitHub↗9,641
  • miniflux/v2الصورة الرمزية لـ miniflux

    miniflux/v2

    9,389عرض على GitHub↗

    This project is a self-hosted RSS feed aggregator and reader designed to collect and organize content from RSS, Atom, and JSON feeds. It functions as a privacy-focused client that blocks pixel trackers and strips URL parameters to prevent third-party tracking and referrer leakage. The system is built as a REST API feed reader, exposing its data and user accounts through a programmable interface for third-party clients. It maintains compatibility with the OPML standard for importing and exporting subscriptions and provides tools for web content extraction using readability parsers and custom r

    Collects and organizes content from Atom, RSS, and JSON sources into a unified interface.

    Goatomfeedgo
    عرض على GitHub↗9,389
  • wgh136/picacomicالصورة الرمزية لـ wgh136

    wgh136/PicaComic

    8,560عرض على GitHub↗

    PicaComic is a digital comic and manga reader that enables browsing and reading content from multiple online sources within a single unified interface. It aggregates data from various providers into a local database for consistent searching and browsing. The application supports custom content integration, allowing the registration of new third-party reading sources through a provider-based extension system. It also features cross-device reading synchronization to keep reading progress and favorite lists aligned across different devices. Additional capabilities include offline content manage

    Aggregates comic data from multiple third-party sources into a single unified interface.

    Dartandroid-applicationdarte-hentai
    عرض على GitHub↗8,560
  • gridsome/gridsomeالصورة الرمزية لـ gridsome

    gridsome/gridsome

    8,484عرض على GitHub↗

    Gridsome is a Vue.js static site generator designed for building Jamstack websites. It functions as a progressive web app framework that pre-renders components into static HTML files for delivery via content delivery networks. The system includes a GraphQL data orchestrator that unifies content from multiple APIs and local files into a single schema for site queries. It also integrates a frontend asset optimizer to automatically compress images and implement code-splitting. The framework provides support for offline-capable websites through prefetching pages and critical asset loading. Addit

    Combines content from various APIs and local files into a single interface to power a website's frontend.

    JavaScript
    عرض على GitHub↗8,484
  • jiangrui1994/cloudsaverالصورة الرمزية لـ jiangrui1994

    jiangrui1994/CloudSaver

    8,542عرض على GitHub↗

    CloudSaver is a multi-cloud file transfer manager and storage aggregator designed to discover remote resources and save them directly to cloud drives. It functions as a cloud file downloader and management platform that enables the movement of data between different cloud storage providers without requiring files to be downloaded to a local device first. The system uses OAuth authentication to manage secure connections to third-party cloud drives, facilitating direct server-to-server data transfers. It incorporates asynchronous streaming to move data between remote sources and destinations, p

    Merges searchable file information from disparate cloud providers into a unified structure for cross-platform discovery.

    Vue
    عرض على GitHub↗8,542
  • realm/jazzyالصورة الرمزية لـ realm

    realm/jazzy

    7,384عرض على GitHub↗

    Jazzy is a source code documentation tool and API generator designed for Swift and Objective-C. It analyzes project roots and compiled modules to produce searchable HTML websites or offline docsets. The system functions as a multi-module API documenter, aggregating documentation from separate source modules into a single site with cross-module linking. It serves as a markdown-based documentation engine that integrates technical guides and LaTeX mathematical equations to complement generated API references. The tool covers a broad capability surface including multi-language API generation for

    Merges technical API data from disparate source modules into a unified structure with shared search.

    Ruby
    عرض على GitHub↗7,384
  • thysrael/horizonالصورة الرمزية لـ Thysrael

    Thysrael/Horizon

    7,357عرض على GitHub↗

    Horizon هو نظام تجميع أخبار مدعوم بالذكاء الاصطناعي مصمم لبناء خطوط أنابيب مخصصة تجلب وتصفي وتثري المعلومات من مصادر ويب متنوعة. يستخدم نماذج لغوية كبيرة لأتمتة تصفية المعلومات، وتسجيل المحتوى لإزالة الضوضاء وتسليط الضوء على القصص عالية القيمة. يدمج النظام بروتوكول سياق النموذج (Model Context Protocol) لكشف مراحل خط الأنابيب كأدوات لمساعدي الذكاء الاصطناعي الخارجيين. يستخدم محولاً موحداً لتوحيد مزودي نماذج الذكاء الاصطناعي المتنوعين لمهام تسجيل المحتوى والتلخيص المتسقة. يجمع خط الأنابيب البيانات من خلاصات RSS، والمنصات الاجتماعية، ومجموعات الأدوات المالية، ومستودعات الكود. يدير المحتوى من خلال إلغاء التكرار، وتصفية الفئات القائمة على الحصص، والإثراء السياقي قبل تقديم إحاطات متعددة اللغات عبر البريد الإلكتروني أو خطافات الويب أو نشر الموقع الساكن. يتم تنسيق سير العمل من خلال أتمتة سحابية متكررة لإدارة الجمع والتقديم المجدول للمعلومات المعالجة.

    Aggregates technical content from diverse sources like RSS, social platforms, and repositories into a unified structure.

    Python
    عرض على GitHub↗7,357
  • droid-ify/clientالصورة الرمزية لـ Droid-ify

    Droid-ify/client

    7,010عرض على GitHub↗

    This project is an Android package manager and app store client designed for browsing, installing, and updating open-source software from F-Droid and custom third-party repositories. It functions as an open-source repository client that allows users to discover software through a synchronized catalog. The system features a local-first repository cache, enabling users to search and manage their software library in an offline operation mode without an active internet connection. It supports multi-source catalog management to aggregate application data from multiple repository URLs into a single

    Aggregates application data from multiple custom and default repository URLs into a single unified index.

    Kotlin
    عرض على GitHub↗7,010
  • jimmylv/bibigpt-v1الصورة الرمزية لـ JimmyLv

    JimmyLv/BibiGPT-v1

    6,116عرض على GitHub↗

    BibiGPT-v1 is an AI-powered media summarizer that generates concise summaries and enables interactive Q&A for audio and video content from multiple platforms. It uses large language models to process transcripts from sources like YouTube, Bilibili, and local files, delivering real-time streaming responses for an interactive chat experience. The project distinguishes itself by combining multi-platform content aggregation with a conversational learning assistant capability, allowing users to query audio and video content through AI-driven dialogue. It also includes export functionality for savi

    Fetches and processes media from diverse sources like YouTube, Bilibili, and local files into a unified AI workflow.

    TypeScriptbilibilichatgptgpt
    عرض على GitHub↗6,116
  • thinkinaixyz/deepchatالصورة الرمزية لـ ThinkInAIXYZ

    ThinkInAIXYZ/deepchat

    6,020عرض على GitHub↗

    DeepChat is a desktop application that connects to multiple cloud and local AI model providers through a single unified chat interface, while also integrating external ACP-compatible coding and task agents as selectable models. It manages local AI agent sessions with project folders, permission modes, and resumable context for long-running tasks, and connects external tools and data sources via the Model Context Protocol using StreamableHTTP, SSE, or Stdio transports. The application distinguishes itself by supporting remote desktop session control, binding messaging app channels to sessions

    Displays Markdown, code blocks, images, Mermaid diagrams, and artifacts within conversations for diverse result presentation.

    TypeScript
    عرض على GitHub↗6,020
  • souzatharsis/podcastfyالصورة الرمزية لـ souzatharsis

    souzatharsis/podcastfy

    6,051عرض على GitHub↗

    Podcastfy is an AI content-to-podcast generator that converts text, URLs, PDFs, images, and videos into conversational audio podcasts. It integrates with over 100 language models for transcript creation and multiple text-to-speech engines for audio output, with support for customizable dialogue style and optional local transcript generation for privacy. The project distinguishes itself through a flexible architecture that decouples job submission from result retrieval via asynchronous polling, normalizes heterogeneous inputs into uniform text, and routes content through pluggable LLM and TTS

    Transforms heterogeneous inputs like text, URLs, images, and PDFs into a uniform text representation.

    Pythonelevenlabsgeminigenai
    عرض على GitHub↗6,051
  • voltagent/voltagentالصورة الرمزية لـ VoltAgent

    VoltAgent/voltagent

    6,020عرض على GitHub↗

    Returns images or media from tools, allowing the LLM to analyze visual content.

    TypeScriptagentsaiai-agents
    عرض على GitHub↗6,020
  • algolia/autocompleteالصورة الرمزية لـ algolia

    algolia/autocomplete

    5,264عرض على GitHub↗

    هذا المشروع هو مكتبة محايدة لإطار العمل لبناء واجهات بحث أثناء الكتابة (Search-as-you-type) يمكن الوصول إليها. توفر طبقة منطق بدون رأس (Headless) تفصل إدارة حالة البحث وتصفية النتائج عن العرض المرئي، مما يسمح للمطورين بالحفاظ على السيطرة الكاملة على هيكل HTML الأساسي والتصميم. تتميز المكتبة ببنية معيارية للغاية تدعم تجميع البيانات من مصادر متعددة، مما يتيح دمج النتائج من المصفوفات الثابتة، وواجهات برمجة التطبيقات عن بُعد، والفهارس الخارجية في واجهة واحدة. تتميز بمحرك عرض مرن يتكامل مع مكتبات DOM افتراضية مختلفة، إلى جانب نظام قائم على الإضافات لتوسيع الوظائف بميزات مثل اقتراحات الاستعلام، وسجل البحث الأخير، وعمليات إعادة التوجيه المخصصة. يغطي النظام مجموعة واسعة من قدرات البحث، بما في ذلك تكامل الذكاء الاصطناعي التوليدي للإجابات المدركة للسياق، وتصفية النتائج في الوقت الفعلي، وضبط الصلة. يتضمن أدوات مراقبة مدمجة لتتبع تفاعلات المستخدم وحالة الشبكة، بالإضافة إلى دعم شامل لمعايير إمكانية الوصول WAI-ARIA لضمان التنقل الشامل بلوحة المفاتيح وقارئ الشاشة. تم تصميم المكتبة للتكامل في بيئات ويب متنوعة، حيث توفر أدوات تكوين لمصادر البيانات، وتوطين الواجهة، والتحسينات الخاصة بالهواتف المحمولة.

    Aggregates search results from diverse sources like static arrays, remote APIs, and external indices into a single unified interface.

    TypeScriptaccessiblealfredalgolia
    عرض على GitHub↗5,264
  • moshstudio/taichi-fletالصورة الرمزية لـ moshstudio

    moshstudio/TAICHI-flet

    4,729عرض على GitHub↗

    TAICHI-flet is an AI-integrated resource browser and Windows desktop application built with Flet. It serves as a centralized multimedia hub and web content aggregator designed to combine artificial intelligence utilities with tools for searching and accessing movies, music, and software. The application enables the aggregation of resources from multiple sources, including cloud storage drives and external web addresses. It provides specialized tools for streaming and downloading anime and music, reading online novels with text-to-speech playback, and automating operations on the Windows opera

    Aggregates multimedia and software resources from various web APIs and cloud drives into a unified interface.

    Python
    عرض على GitHub↗4,729
  • zu1k/proxypoolالصورة الرمزية لـ zu1k

    zu1k/proxypool

    4,017عرض على GitHub↗

    Proxypool هو زاحف ومجمع وكيل مؤتمت يكتشف ويتحقق وينسق خوادم الوكيل من الصفحات العامة وعناوين الاشتراك. يعمل كخدمة خلفية تجمع عقد الوكيل عبر بروتوكولات متعددة وتخدم القائمة التي تم التحقق منها الناتجة من خلال واجهة برمجة تطبيقات شبكة للاستهلاك الخارجي. يدير النظام دورة الحياة الكاملة لاكتشاف الوكيل من خلال تجميع البيانات من مصادر متعددة، وإلغاء تكرار الإدخالات، واستخدام مدقق اتصال لضمان الحفاظ على العقد النشطة والوظيفية فقط. تتم إدارة مصادر الزحف عبر ملف تكوين لاستهداف عناوين خارجية محددة. يتعامل المشروع مع إدارة قائمة الوكيل المستمرة من خلال مهام خلفية مجدولة تؤتمت تحديث وتحديث العقد المتاحة. تتضمن هذه العملية اختبار الاتصال المؤتمت وتقليم الخوادم غير النشطة للحفاظ على القائمة المنسقة محدثة.

    Collects and merges proxy nodes from multiple public pages and channels into a single curated list.

    Gocrawlerproxypool
    عرض على GitHub↗4,017
  • 0x727/shuize_0x727الصورة الرمزية لـ 0x727

    0x727/ShuiZe_0x727

    4,014عرض على GitHub↗

    ShuiZe_0x727 is an open-source intelligence gathering framework and attack surface management tool. It functions as an asset discovery engine and cyber intelligence aggregator designed to identify internet-facing assets, map network infrastructure, and visualize total network exposure. The project integrates vulnerability scanning and sensitive data leak detection to identify security weaknesses and unauthorized access points. It employs a combination of network space API queries, certificate log analysis, and public repository scanning to extract leaked credentials, API keys, and internal ad

    Merges technical data from certificate logs, DNS records, and crawlers into a single asset structure.

    Python
    عرض على GitHub↗4,014
  • hoothin/userscriptsالصورة الرمزية لـ hoothin

    hoothin/UserScripts

    4,065عرض على GitHub↗

    UserScripts is a collection of JavaScript browser userscripts designed to modify website behavior and add custom functionality to web browsers. It serves as a multi-purpose toolset for web page content automation, web interface enhancement, and specialized web scraping and downloading. The project distinguishes itself through a wide range of specialized utilities, including a browser-based text transformer for character encoding and terminology mapping, and tools for bypassing content censorship. It provides advanced web scraping capabilities such as deciphering obfuscated download links, agg

    Aggregates multi-chapter text from web pages into a single file by detecting main content automatically.

    JavaScriptadd-onauto-scrollautopager
    عرض على GitHub↗4,065
  • aidoku/aidokuالصورة الرمزية لـ Aidoku

    Aidoku/Aidoku

    3,951عرض على GitHub↗

    Aidoku is a manga reader application and digital library manager. It serves as a modular content aggregator that allows users to discover, download, and read manga from various third-party sources and local files. The application utilizes a modular source plugin system to integrate external provider packages, enabling the ingestion of content from multiple third-party sources. It includes a sync engine that communicates with external tracking APIs to maintain consistent reading progress across different platforms. The system covers manga library management, including the ability to search fo

    Merges manga content from disparate third-party sources into a unified internal structure for consistent rendering.

    Swiftiosmangareading
    عرض على GitHub↗3,951
السابق12التالي
  1. Home
  2. Data & Databases
  3. Multi-Source Content Aggregation

استكشف الوسوم الفرعية

  • Multi-Modal Content Normalizers2 وسوم فرعيةTransforms heterogeneous inputs—raw text, URLs, images, PDFs, and videos—into a uniform text representation for downstream processing. **Distinct from Multi-Source Content Aggregation:** Distinct from Multi-Source Content Aggregation: focuses on normalizing diverse input types into text, not merging technical data from disparate sources.