Awesome GitHub RepositoriesMulti-Cloud Data Aggregation

Steampipe is a cloud infrastructure query engine and API-to-SQL mapper that translates REST and GraphQL API responses into relational rows and columns. It allows for the retrieval and joining of real-time data from multiple cloud service providers using a relational database interface. The project functions as a PostgreSQL foreign data wrapper and an SQLite API extension, mapping external API endpoints to virtual tables. This enables the use of standard SQL to query live cloud services and aggregate data from different providers and service accounts into a single unified dataset. The system

CloudQuery is a cloud infrastructure ETL tool and multi-cloud data pipeline designed to collect, synchronize, and normalize resource metadata from various cloud providers and SaaS platforms. It functions as a centralized asset inventory manager and security posture manager, extracting configuration and state data into relational databases, data lakes, or data warehouses. The system distinguishes itself by transforming complex, nested cloud API responses into flat relational tables, enabling the use of standard SQL for asset querying and analysis. It employs a modular plugin system for data ex

Komiser 是一个多云基础设施检查器和资产库存管理器。它提供了一个集中式系统，用于审计、编目和分析跨 AWS、GCP 和 Azure 环境部署的服务及资产。 该项目通过基于提供商的插件架构，将来自不同云厂商的异构资源模式转换为统一的结构化表示。它使用无代理 API 检查和基于轮询的资源发现来检索元数据和配置状态，而无需在目标资源上安装代理。 该平台涵盖了通过成本聚合和支出分析进行的财务管理、用于识别闲置或未标记资产的资源审计，以及用于检测漏洞和基础设施配置错误的安全态势管理。