Awesome GitHub RepositoriesData Aggregators

OpenBBTerminal is a Python financial data platform and command line interface designed for aggregating and analyzing market data from diverse APIs. It serves as a quantitative analysis tool for processing stock, crypto, and derivative datasets to identify market trends and build investment strategies. The project utilizes a pluggable financial API framework with an adapter-based architecture, allowing external financial data providers to be integrated as independent modules. This system standardizes information from public and proprietary sources into a unified layer to support cross-asset an

RSSHub is a headless, server-side engine designed to generate standardized RSS and Atom feeds from websites that do not natively provide them. By acting as an extensible data aggregator, it enables the automated collection of web content, allowing users to monitor updates from disparate sources through centralized feed readers or workflow automation tools. The platform distinguishes itself through a route-based data extraction framework that maps specific URL patterns to custom scraping logic. This modular architecture is supported by a middleware-driven request pipeline and declarative route

This project is an open-source, privacy-focused web analytics platform designed for high-throughput data ingestion and multi-tenant data management. It provides a cookie-less tracking engine that captures visitor interactions using ephemeral request metadata, ensuring comprehensive traffic visibility while maintaining strict privacy standards. The architecture utilizes an event-driven ingestion pipeline and aggregated metric storage to decouple data collection from processing, enabling efficient long-term retrieval and responsive dashboard performance. What distinguishes this platform is its

Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network

Automa is a browser-based automation platform that enables users to build, schedule, and execute repetitive web tasks through a visual, no-code interface. By operating as a browser extension, it provides a canvas-based environment where users construct workflows by connecting functional blocks to interact with web elements, manage browser state, and process data. The platform distinguishes itself through its deep integration with the browser environment, allowing for complex orchestration such as event-driven triggers, cross-origin request handling, and the ability to package workflows as sta

This project is a comprehensive repository of curated domain blocklists designed for network-wide DNS filtering. It functions as a DNS sinkhole feed, providing the necessary data to intercept and block unwanted network requests at the resolution layer before they reach their destination. By returning null or loopback addresses for identified domains, it prevents connections to malicious infrastructure, advertising servers, and tracking endpoints across all devices on a network. The repository distinguishes itself through a tiered categorization logic that allows users to select protection lev

Relay is a GraphQL client framework and state manager used for building data-driven applications. It functions as a declarative data fetching layer and a GraphQL compiler that transforms declarations into optimized runtime code with automatic type generation. The framework distinguishes itself through a build-time compilation process that generates optimized queries and a data masking system that prevents components from accessing undeclared data. It employs a normalized client-side cache to maintain consistency across entities and an optimistic update mechanism to provide immediate interface

This project provides a comprehensive implementation of the AT Protocol, serving as a framework for building decentralized social networking applications. It enables the creation of distributed data repositories where users maintain cryptographic ownership of their identity and content, allowing for portable accounts that can be migrated between independent servers without central authority intervention. The platform distinguishes itself by decoupling content hosting from discovery through modular algorithmic curation. Users can select third-party services to filter and organize their feeds,

Telegraf is a modular, cross-platform telemetry pipeline designed to collect, process, and route metrics from diverse infrastructure, applications, and hardware. It functions as a server-side middleware that normalizes heterogeneous data into a unified format, enabling consistent monitoring across complex environments. By utilizing a plugin-driven architecture, the agent manages the entire lifecycle of telemetry data from initial ingestion to final transmission. The project distinguishes itself through a declarative, configuration-driven execution model that allows users to define complex dat

Midday is an open-source, self-hosted financial dashboard designed for business expense management and automated bookkeeping. It functions as a centralized platform that aggregates transaction history and account balances from multiple external banking providers, allowing users to maintain full control over their sensitive financial data on private infrastructure. The platform distinguishes itself through its automated reconciliation workflows, which categorize business expenditures and generate structured financial reports to reduce manual data entry. By integrating with financial data aggre

AI-Trader is a framework for managing autonomous trading agents and executing simulated financial operations. It provides a structured environment for registering and authenticating agents, tracking their reputation, and managing simulated capital balances within a competitive market ecosystem. The platform distinguishes itself through integrated social trading and collaborative investment capabilities. Users can follow experienced participants to automatically mirror their market positions, or organize into teams to execute shared strategies, vote on collective investment proposals, and comp

BrasilAPI is a REST API gateway that aggregates and exposes official Brazilian public data from fragmented government sources. It functions as a multi-provider data aggregator that normalizes heterogeneous information into a standardized JSON schema for consistent delivery. The system utilizes a multi-provider fallback pipeline to ensure reliable data resolution, querying several external APIs in sequence if a primary provider fails. It also incorporates a caching proxy gateway to reduce latency and avoid redundant requests for frequently accessed public data. The platform covers a broad ran

Proxyman is a cross-platform HTTP debugging proxy that captures, inspects, and modifies HTTP, HTTPS, and WebSocket traffic. It functions as a man-in-the-middle proxy, decrypting SSL/TLS traffic to allow real-time inspection and modification of encrypted requests and responses. The tool is designed for debugging web and mobile applications, with capabilities for API mocking and simulation, scriptable traffic modification, and team collaboration on network logs. What distinguishes Proxyman is its deep integration with mobile and cross-platform development workflows. It provides automated certif

Actual Budget is an open-source personal finance application that stores all financial data locally on the user's device using a SQLite database, enabling offline access and complete data ownership without cloud dependency. It packages the entire application stack into Docker containers for one-click deployment on any hosting platform with container support, and connects to over 10,000 financial institutions through the Plaid API to automatically sync account balances, transactions, and investment data. The application implements a monthly budget model that tracks spending against category li

Wuhan2020 is an open platform for collecting, validating, and visualizing epidemic relief data, originally focused on coordinating community response during the COVID-19 crisis. It aggregates information on hospitals, factories, logistics providers, hotels, and donations from multiple sources into a central repository, making it accessible through an interactive geographic map and a programmatic API. The platform distinguishes itself by using GitHub issues as its primary data store, with label-driven organization and command-based task assignment that allows volunteers to claim and track work

Reqable is a cross-platform network debugging tool that functions as an HTTP/HTTPS debugging proxy, a REST API client, and a traffic replay tool. It captures, inspects, and modifies live traffic using a local MITM proxy engine, supports VPN tunnel capture for mobile devices, and provides a Python scripting sandbox for custom traffic processing. The application is available on Windows, macOS, Linux, iOS, and Android. The tool distinguishes itself by combining traffic interception with breakpoint-based request modification, allowing users to pause live HTTP traffic for manual inspection and alt

FundamentalAnalysis est une bibliothèque complète d'analyse financière, un framework de finance quantitative et un intégrateur de données macroéconomiques. Elle fournit des outils pour calculer des ratios financiers, exécuter des métriques de santé d'entreprise et tarifer des dérivés et des obligations à l'aide de modèles mathématiques. Le projet intègre divers flux de données, incluant des indicateurs économiques mondiaux, des cotations de marché en temps réel et des états financiers d'entreprise standardisés. Il dispose d'un moteur d'analyse technique pour générer des indicateurs de momentum et de volatilité, ainsi qu'un analyseur de performance de portefeuille pour suivre les rendements ajustés au risque et l'allocation d'actifs. Sa surface analytique couvre l'évaluation d'actifs via des modèles de flux de trésorerie actualisés (DCF) et de valeur intrinsèque, la gestion des risques via la Value at Risk (VaR) et la prévision de volatilité stochastique, ainsi que l'analyse des revenus fixes. Il inclut également des capacités de tarification de dérivés, de modélisation des risques multi-facteurs et l'extraction d'estimations d'analystes et de recommandations consensuelles. La bibliothèque est implémentée en Python.

easyquotation is a Python library that provides access to Chinese stock market data, including real-time quotes, historical daily candlestick prices, exchange-traded fund details, and a stock code database sync utility. It retrieves live trading data from Chinese exchanges, A-shares, and Hong Kong listed stocks without requiring manual API key configuration, offering a unified interface to multiple public data feeds. The library combines several market data providers behind a single query interface, using asynchronous I/O to handle parallel requests and a polling engine that delivers sub-seco

The FinanceToolkit is an open-source Python library for quantitative finance that provides a unified framework for financial analysis, asset valuation, and risk management. It serves as a comprehensive platform for computing over 200 financial metrics and ratios, with capabilities spanning financial ratio analysis, fixed income analytics, macroeconomic data aggregation, options pricing, and portfolio risk management. The toolkit distinguishes itself through a modular architecture that separates data retrieval from computation, with stateless engines for financial models like Black-Scholes, GA