20 Repos
Mechanisms for collecting data from RSS feeds and third-party services.
Distinct from External Data Integrations: Distinct from External Data Integrations: focuses on feed-based content ingestion rather than general data enrichment.
Explore 20 awesome GitHub repositories matching data & databases · External Feed Integrations. Refine with filters or upvote what's useful.
ArchiveBox is a self-hosted web archiving system designed to capture and preserve permanent static copies of webpages, media, and PDFs on personal infrastructure. It functions as a digital content curator and personal web archive manager, allowing users to import URLs from bookmarks, RSS feeds, and browser history to create a centralized, searchable knowledge base. The project is distinguished by its ability to archive private, paywalled, or login-protected content using browser cookies and authenticated session persistence. It ensures long-term availability by saving pages in multiple concur
Automatically pulls fresh URLs from RSS feeds on a recurring timetable.
Karakeep is a self-hosted, open-source platform designed for personal knowledge management and web content archiving. It functions as a centralized repository where users can capture, organize, and preserve bookmarks, notes, and media files, ensuring long-term access to digital information even if original sources are removed or modified. The system distinguishes itself through its automated content processing and security-focused architecture. It utilizes headless browser crawling and optical character recognition to ingest and index web content, while a modular artificial intelligence pipel
Consolidates digital information by integrating external sources like RSS feeds and third-party services.
This project is a web-based Markdown profile builder designed to create professional landing pages for GitHub accounts. It functions as a profile README generator that collects user details and professional statistics to produce formatted Markdown code for showcasing technical skills and achievements. The tool distinguishes itself by integrating live data cards, such as contribution metrics and visitor counters, and providing an RSS feed embedder for automated blog syndication. It also automates the setup process by importing public user information and suggesting relevant skills based on a G
Provides the ability to ingest RSS feeds from external blogs to keep profile content updated.
Readest is a comprehensive digital reading platform designed to manage, annotate, and consume electronic books across multiple devices. It functions as a versatile library manager and reading environment, supporting a wide range of user needs from standard ebook consumption to specialized study and accessibility-focused workflows. The platform distinguishes itself through advanced features like parallel text study, which enables side-by-side document rendering with synchronized scrolling, and a robust text-to-speech engine that provides hands-free reading with synchronized visual highlighting
Connects to standard distribution feeds to discover, bookmark, and download digital content directly into the local library.
FullCalendar is a framework-agnostic UI library and JavaScript calendar component designed for building interactive event scheduling interfaces. It provides tools for managing time-based data, including an integrated iCal feed parser for importing external calendar files and recurring schedules into a unified web view. The library features a system for event scheduling and management, enabling users to reschedule entries via drag-and-drop, adjust event durations by resizing, and highlight specific time ranges for selection. It supports multiple date views, such as month, week, day, and list f
Implements a dedicated iCal feed parser to import external calendar files and recurring schedules into the interface.
SpiderFoot is an open-source reconnaissance and intelligence automation framework designed to streamline the collection and correlation of data for security investigations. It functions as a comprehensive platform that automates the querying of hundreds of public data sources to map digital footprints, identify exposed assets, and uncover potential security threats across an organization's external perimeter. The platform distinguishes itself through a modular, plugin-based architecture that executes data gathering tasks in parallel, supported by a directed graph data model that tracks relati
Integrates high-fidelity indicator feeds into security stacks to automate the detection and blocking of malicious activity.
FreshRSS is an open-source, self-hosted web feed aggregator designed to collect, organize, and display content from multiple websites in a single, centralized interface. It functions as a comprehensive reader for standard syndication formats, allowing users to track updates from various sources while maintaining full control over their data and privacy. The platform supports multi-user environments, enabling individual account management and personalized reading experiences. The application distinguishes itself through its robust synchronization and extensibility capabilities. It provides a s
Provides a standardized API for external mobile and desktop clients to synchronize feed subscriptions and reading progress.
Kakoune is a scriptable, modal text editor for the terminal that employs a client-server architecture. This model allows multiple terminal windows to connect to a single editing session, providing a programmable environment for managing source code and text. The editor is distinguished by its selection-first logic, where a text region must be predefined before a command is applied. It leverages regular expressions to manage multiple cursors and perform bulk edits across complex text patterns, and it integrates deeply with the shell by piping selections through external programs and filters.
Uses named pipes to stream data asynchronously between the editor and external shell processes.
Blinko is a personal knowledge management system and an LLM-powered knowledge base that enables users to capture and organize thoughts through a bi-directional knowledge graph. It functions as a RAG-enabled note-taking application and a self-hosted Markdown editor, allowing for the creation of permanent documentation and fleeting notes. The project distinguishes itself by integrating retrieval-augmented generation to provide conversational querying and AI-powered analysis of private document libraries. It supports both cloud-based and local AI model integration, enabling users to perform sema
Integrates external RSS feeds to ingest and incorporate outside information into the knowledge base.
WooCommerce is a comprehensive eCommerce framework for WordPress that transforms websites into fully functional online stores for physical and digital goods. It serves as a digital storefront manager for product catalogs, inventory, and customer orders across retail and wholesale business models. The system functions as a payment gateway integrator, connecting shops to diverse processors for credit cards, digital wallets, and subscriptions. It also operates as an order fulfillment system for calculating shipping rates, generating labels, and coordinating delivery via third-party couriers, whi
Connects store inventory to external search and social networks to create shoppable product feeds.
Arkime is a distributed packet analysis platform and full packet capture system designed for recording raw network traffic, indexing metadata, and performing network forensics. It functions as a network traffic indexer and security tool that enables the monitoring, querying, and browsing of large-scale network traffic across multi-cluster architectures. The platform distinguishes itself through its ability to manage distributed capture clusters from a centralized administrative dashboard. It integrates external data feeds with internal traffic logs to identify known threats and provides a pro
Integrates high-fidelity indicator feeds with internal logs to identify known network threats.
ReadYou is a self-hosted reading application and RSS feed aggregator that centralizes content from multiple web sources. It functions as a full-text RSS reader, extracting the complete body text from web pages to provide a distraction-free reading experience. The application includes specialized accessibility and speed tools, such as a bionic reading mode that uses pattern-based text highlighting to guide the eye and a text-to-speech system for audio content consumption. The project covers comprehensive subscription management through OPML import and export, feed categorization, and keyword-
Provides mechanisms for collecting content from RSS feeds and third-party services to synchronize data sources.
This project is a collection of reference implementations and sample applications for Flutter. It provides practical examples covering API integration, user authentication, data persistence, and a gallery of UI patterns. The repository distinguishes itself by offering a wide array of functional demos, including implementations for Google and email-based identity verification, cloud database synchronization, and the use of both relational and key-value local storage. It also includes specialized utility examples such as expense tracking, tip calculation, and body mass index tools. The project
Provides examples of fetching and displaying content from external news feeds.
IntelOwl ist eine Threat-Intelligence-Plattform und ein Security-Orchestration-Engine, die darauf ausgelegt ist, Sicherheits-Observables zu aggregieren, zu analysieren und anzureichern. Es fungiert als Tool zur Untersuchung von Sicherheitsvorfällen und als Threat-Intelligence-Aggregator, der Daten zu Dateien, Domains und IP-Adressen aus verschiedenen internen und externen Quellen sammelt. Das System zeichnet sich durch playbook-basierte Workflow-Automatisierung aus, die es Benutzern ermöglicht, wiederverwendbare Sequenzen von Analyseaufgaben zu definieren, die nachfolgende Jobs basierend auf vorherigen Ausgaben auslösen. Es vereinheitlicht disparate Sicherheitsdaten in einem gemeinsamen Schema und nutzt protokollbasierte Zugriffskontrollen, um die Ausführung von Analysatoren basierend auf der Datensensibilität einzuschränken. Die Plattform deckt ein breites Spektrum an Funktionen ab, einschließlich ereignisgesteuerter Indikator-Ingestion, automatisierter SOC-Workflows (Security Operations Center) und Intelligence-Anreicherung. Sie bietet Tools zur Untersuchungsorganisation und Visualisierung von Analyseergebnissen durch Dashboards zur Korrelation von Erkenntnissen. Das Projekt ist in Python implementiert.
Automatically triggers analysis playbooks when new observables are imported from external threat streams.
SimplifyReader ist eine Mehrzweck-Android-Anwendung und ein Multi-Modul-Client, der für den Konsum von Nachrichten und Medien sowie das Scannen von QR-Codes entwickelt wurde. Sie ist als Material-Design-Anwendung aufgebaut, die die Model-View-Presenter-Architektur implementiert, um Geschäftslogik von der Benutzeroberfläche zu trennen. Die Anwendung integriert mehrere funktionale Module in eine einzige Schnittstelle. Dazu gehören Nachrichtenaggregation zum Abrufen von Schlagzeilen und Artikeln, Bild-Browsing mit Such- und Zoomfunktionen, Video-Streaming und Audiowiedergabe für Musik aus Remote-Quellen. Das Projekt enthält zudem ein Dienstprogramm zum Scannen von QR-Codes, das eine Bilderkennungsbibliothek verwendet, um gescannte Daten in Text zu dekodieren. Remote-Inhalte werden über eingebettete Browser-Komponenten und adaptive Bildschirmlayouts gerendert.
Fetches content from third-party services to populate news and media feeds.
VDO.Ninja is a low-latency peer-to-peer media routing service and video streaming platform designed to integrate remote audio and video feeds into professional production workflows. It functions as a WebRTC broadcast integration tool and studio controller, allowing for the direct transmission of high-definition media between publishers and viewers with minimal delay. The platform distinguishes itself through extensive protocol bridging, converting between WebRTC, WHIP, WHEP, SRT, and RTMP to ensure compatibility across diverse network environments and professional studio software. It includes
Routes remote video and audio streams directly into OBS Studio or browser-based production tools.
This project is a date recurrence engine and iCalendar recurrence rule library. It provides tools for calculating lists of event instances from complex scheduling rules, managing inclusion or exclusion date sets, and calculating recurring event dates across different geographic timezone offsets. The library features a natural language calendar parser that translates human-readable text descriptions into structured iCalendar recurrence configurations and vice versa. It supports bidirectional serialization, converting recurrence rules and sets into RFC-compliant strings and parsing those string
Converts iCalendar strings or natural language descriptions into structured recurrence configurations.
InkyPi is a digital signage management system designed to schedule and display rotating content and dynamic data across network-connected screens. It functions as a networked display controller and external data integration engine, allowing for the fetching and rendering of third-party plugins, calendars, and news feeds. The system includes a hardware display driver manager that installs and configures model-specific drivers for various electronic paper display controllers. It utilizes a web-based interface for remote configuration, enabling the management of display settings and content upda
Fetches and renders third-party plugins, calendars, and news feeds for visual displays.
Stellar Core is the primary software implementation of the Stellar blockchain network, serving as a distributed ledger and a Federated Byzantine Agreement system. It functions as a core node that maintains the shared state of the network and provides a runtime environment for executing WebAssembly smart contracts. The project enables the creation and management of digital assets, including the implementation of decentralized exchanges through distributed orderbooks and automated liquidity pools. It facilitates cross-border payment settlement by routing assets via path payments and bridging di
Feeds external data sources into the network to trigger smart contract automation.
Feeder is an RSS and Atom feed reader that aggregates content into a single interface. It functions as a full-text content extractor that removes website clutter to isolate the main body of articles, and a self-hosted feed synchronizer that maintains subscription lists and read statuses across devices via a private backend server. The application integrates AI services and external API keys to translate and generate concise summaries of long-form articles. It also features a text-to-speech reader that uses system engines with automatic language detection to convert written content into spoken
Provides mechanisms for exposing feed data to external applications through a standardized content provider.