awesome-repositories.com
Blog
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetÀ proposNotre méthodologiePresseServeur MCP
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

40 dépôts

Awesome GitHub RepositoriesData Sources

Structured repositories providing programmatic access to specific data sets.

Distinguishing note: Focuses on the data source aspect of icon collections.

Explore 40 awesome GitHub repositories matching data & databases · Data Sources. Refine with filters or upvote what's useful.

Awesome Data Sources GitHub Repositories

Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
  • awesome-selfhosted/awesome-selfhostedAvatar de awesome-selfhosted

    awesome-selfhosted/awesome-selfhosted

    299,516Voir sur GitHub↗

    Ce projet est un répertoire de logiciels open source organisé par la communauté, conçu pour être déployé dans des environnements de serveurs privés et des laboratoires domestiques. Il sert de ressource complète pour découvrir des alternatives indépendantes et auto-hébergées aux services cloud grand public, permettant aux utilisateurs de conserver la pleine propriété des données et le contrôle de leur infrastructure numérique. Le répertoire est structuré par une taxonomie hiérarchique qui organise une vaste collection d'applications en catégories logiques, allant de la gestion multimédia et de l'analyse de données à la communication privée et aux outils de productivité d'équipe. Il se distingue par un processus de revue par les pairs collaboratif, où les membres de la communauté valident la qualité et la pertinence de chaque soumission pour garantir que le répertoire reste précis et fiable. Le projet couvre une large surface de capacités, notamment l'automatisation de l'infrastructure, le déploiement de services basés sur des conteneurs et la gestion de configuration déclarative. Ces outils aident les utilisateurs à maintenir des environnements de serveur reproductibles et à gérer des dépendances de services complexes sur du matériel privé. Le répertoire est maintenu en tant que dépôt contrôlé par version, garantissant que toutes les mises à jour et les changements pilotés par la communauté sont suivis et transparents.

    Combines multiple disparate data sources into a unified GraphQL interface to simplify querying across different backend systems.

    awesomeawesome-listcloud
    Voir sur GitHub↗299,516
  • gatsbyjs/gatsbyAvatar de gatsbyjs

    gatsbyjs/gatsby

    55,941Voir sur GitHub↗

    Gatsby is a React static site generator and hybrid rendering framework used to build websites by pre-rendering components into static HTML files for delivery via content delivery networks. It functions as a hybrid rendering platform that supports a combination of static generation, server-side rendering, and deferred page loading. The framework operates as a GraphQL data aggregator, pulling content from various APIs, headless CMS integrations, and files into a single unified schema for frontend queries. It also serves as a frontend performance optimizer, automating code splitting, resource pr

    Aggregates content from disparate APIs and files into a unified GraphQL schema for build-time querying.

    JavaScriptblogcompilergatsby
    Voir sur GitHub↗55,941
  • hasura/graphql-engineAvatar de hasura

    hasura/graphql-engine

    32,064Voir sur GitHub↗

    graphql-engine is an automated GraphQL API engine that transforms database tables and relationships into a queryable GraphQL schema. It functions as a federation gateway and mapper, instantly generating APIs with built-in filtering, pagination, and mutations from existing databases and remote schemas. The project distinguishes itself through a fine-grained access control layer that enforces row-level and field-level permissions. It further provides a real-time data subscription server that converts standard queries into live streams and a system for triggering event-driven webhooks and notifi

    Merges multiple remote GraphQL schemas and data sources into a single unified API endpoint.

    TypeScriptaccess-controlapiautomatic-api
    Voir sur GitHub↗32,064
  • simple-icons/simple-iconsAvatar de simple-icons

    simple-icons/simple-icons

    24,495Voir sur GitHub↗

    Simple Icons is a comprehensive repository of standardized brand logos provided in scalable vector format. It serves as a programmatic data source that offers direct access to official brand vector paths and color codes, enabling developers to integrate consistent visual assets into software projects and user interfaces. The project functions as a web-ready asset provider that supports multiple delivery methods, including direct file imports, remote image embedding, and font-based rendering. By centralizing the storage of icon geometry as raw vector path strings, it ensures consistent renderi

    Offers a structured data set for direct access to brand vector paths and color codes.

    JavaScriptbrandbrand-assetsbrand-colors
    Voir sur GitHub↗24,495
  • apify/crawleeAvatar de apify

    apify/crawlee

    24,002Voir sur GitHub↗

    Crawlee is a web scraping framework designed for building scalable, reliable, and distributed data extraction pipelines. It provides a unified interface for managing headless browser automation and lightweight HTTP requests, allowing developers to handle complex web navigation, dynamic content rendering, and large-scale data collection within a single, modular architecture. The project distinguishes itself through its resource-aware concurrency controller, which dynamically scales task execution based on real-time CPU and memory usage to prevent host machine exhaustion. It also features a rob

    Integrates external data sources with internal queues to control how URLs are accessed and processed during a crawl.

    TypeScriptapifyautomationcrawler
    Voir sur GitHub↗24,002
  • vonng/ddiaAvatar de Vonng

    Vonng/ddia

    22,648Voir sur GitHub↗

    This project serves as a comprehensive technical reference for the architecture and design of data-intensive applications. It provides a structured analysis of the fundamental principles required to build reliable, scalable, and maintainable software systems, covering the core trade-offs inherent in modern data infrastructure. The repository explores the mechanics of distributed data management, including strategies for replication, partitioning, and achieving consensus across multiple nodes. It details the design of storage engines, indexing techniques, and transaction management models, whi

    Designates primary systems as the authoritative source of truth for all other system components.

    Pythonbookdatabaseddia
    Voir sur GitHub↗22,648
  • saleor/saleorAvatar de saleor

    saleor/saleor

    22,610Voir sur GitHub↗

    Saleor is a headless, API-first commerce platform designed to manage complex retail operations through a decoupled architecture. It provides a centralized backend that uses a GraphQL-based interface to handle product catalogs, order lifecycles, and multi-channel sales across diverse global markets. By separating the commerce engine from the storefront, the platform enables developers to build custom, high-performance shopping experiences while maintaining granular control over data interactions. The platform distinguishes itself through an event-driven architecture that allows for deep extens

    Aggregates core entities and custom metadata into a unified GraphQL interface for commerce operations.

    Pythoncartcheckoutcommerce
    Voir sur GitHub↗22,610
  • open-ani/animekoAvatar de open-ani

    open-ani/animeko

    18,500Voir sur GitHub↗

    Animeko is a cross-platform desktop media client designed to aggregate video streams and peer-to-peer content into a single, unified interface. It functions as a centralized hub for media consumption, allowing users to manage multiple content providers and playback sources within one application. The client distinguishes itself by integrating a specialized engine for real-time peer-to-peer stream buffering, which enables immediate playback of media files directly from decentralized network sources. It further enhances the viewing experience by rendering community-contributed text overlays dir

    Combines video streams from various providers to automatically select the best quality source.

    Kotlinandroidanianime
    Voir sur GitHub↗18,500
  • vercel/vercelAvatar de vercel

    vercel/vercel

    15,738Voir sur GitHub↗

    Vercel is a cloud platform for building, deploying, and scaling web applications. It provides a unified infrastructure that automates the build process by detecting project frameworks and distributing static and dynamic content through a global content delivery network. The platform executes application logic using serverless functions that scale automatically based on real-time traffic demand. The platform distinguishes itself through a centralized AI gateway that proxies requests to multiple model providers, enabling standardized authentication, observability, and cost tracking. It supports

    Restricts information sources to ensure relevance and compliance.

    TypeScriptclicloudcommand
    Voir sur GitHub↗15,738
  • android10/android-cleanarchitectureAvatar de android10

    android10/Android-CleanArchitecture

    15,540Voir sur GitHub↗

    This is a reference implementation of Uncle Bob's clean architecture for Android, structured into distinct domain, data, and presentation layers. The project demonstrates how to organize an Android application around business use cases, keeping domain logic and entities free from framework dependencies. The architecture enforces dependency inversion through layered separation, where inner domain layers define interfaces that outer layers implement. This approach enables repository abstractions for data source switching, presenter-view separation for testable UI logic, and use-case composition

    Allows runtime or compile-time swapping of data sources (e.g., remote API vs. local cache) through repository implementations behind a common interface.

    Javaandroidandroid-applicationandroid-architecture
    Voir sur GitHub↗15,540
  • hunlongyu/zy-playerAvatar de Hunlongyu

    Hunlongyu/ZY-Player

    14,516Voir sur GitHub↗

    ZY-Player is a cross-platform video player and media library manager designed for streaming video and live TV content from custom or imported source lists. It functions as a media metadata browser that fetches movie ratings and information from external databases to assist in content discovery. The application integrates with external player software by handing off media streams to third-party applications. It provides tools for organizing video resources through a media library manager that supports poster views and custom source list definitions. The system includes global media search to

    Imports, exports, and defines custom source lists to organize available media content.

    Vueelectronelectron-appelectron-application
    Voir sur GitHub↗14,516
  • dbt-labs/dbt-coreAvatar de dbt-labs

    dbt-labs/dbt-core

    13,051Voir sur GitHub↗

    dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based d

    Accesses information about model lineage, test results, and source freshness to help users understand data structure and quality.

    Rustanalyticsbusiness-intelligencedata-modeling
    Voir sur GitHub↗13,051
  • keiyoushi/extensionsAvatar de keiyoushi

    keiyoushi/extensions

    13,045Voir sur GitHub↗

    This project is a centralized repository of plugins designed to integrate diverse external manga sources into a single reading interface. It functions as a content aggregation system that allows users to browse and access digital comics from multiple online platforms through a unified application. The system utilizes a framework of web scrapers that normalize data from various websites into a consistent viewing format. To manage these integrations, the project employs a background synchronization service that performs automated version checks, ensuring that installed plugins remain compatible

    Manages and selects optimal media sources from multiple international providers to facilitate content discovery.

    HTML
    Voir sur GitHub↗13,045
  • aws/aws-cdkAvatar de aws

    aws/aws-cdk

    12,817Voir sur GitHub↗

    The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It

    Combines multiple disparate data sources into a unified GraphQL interface.

    TypeScriptawscloud-infrastructurehacktoberfest
    Voir sur GitHub↗12,817
  • abraunegg/onedriveAvatar de abraunegg

    abraunegg/onedrive

    12,577Voir sur GitHub↗

    This project is a command-line synchronization client for OneDrive and SharePoint libraries on Linux. It functions as a synchronization engine that aligns local filesystems with cloud storage through bidirectional, unidirectional, or download-only workflows. The client supports headless authentication for servers without web browsers and can be deployed as a background service or within a containerized environment. It enables the management of multiple distinct cloud accounts on a single system and integrates with shared SharePoint sites and document libraries. The synchronization engine inc

    Implements a mirroring mode where the local filesystem is the authoritative source for remote cloud storage.

    D
    Voir sur GitHub↗12,577
  • datahub-project/datahubAvatar de datahub-project

    datahub-project/datahub

    12,141Voir sur GitHub↗

    DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autono

    Creates native documentation within the catalog to resolve conflicting metrics or processes and provide a single source of truth.

    Pythondata-catalogdata-discoverydata-governance
    Voir sur GitHub↗12,141
  • boto/boto3Avatar de boto

    boto/boto3

    9,834Voir sur GitHub↗

    Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and contain

    AWS fetches data from multiple sources through a single GraphQL API endpoint to simplify client-side querying.

    Pythonawsaws-sdkcloud
    Voir sur GitHub↗9,834
  • gridsome/gridsomeAvatar de gridsome

    gridsome/gridsome

    8,484Voir sur GitHub↗

    Gridsome is a Vue.js static site generator designed for building Jamstack websites. It functions as a progressive web app framework that pre-renders components into static HTML files for delivery via content delivery networks. The system includes a GraphQL data orchestrator that unifies content from multiple APIs and local files into a single schema for site queries. It also integrates a frontend asset optimizer to automatically compress images and implement code-splitting. The framework provides support for offline-capable websites through prefetching pages and critical asset loading. Addit

    Aggregates disparate content sources into a single GraphQL schema for unified querying during the build process.

    JavaScript
    Voir sur GitHub↗8,484
  • apify/crawlee-pythonAvatar de apify

    apify/crawlee-python

    8,097Voir sur GitHub↗

    Crawlee-python is a web crawling framework for building scalable scrapers using Python. It serves as a comprehensive tool for web scraping automation, providing a system to extract structured data from websites using both lightweight HTTP requests and headless browser automation. The framework is distinguished by its anti-bot evasion capabilities, which include browser fingerprint impersonation and tiered proxy rotation to bypass detection systems and solve challenges such as Cloudflare. It also incorporates artificial intelligence for autonomous website navigation and schema-based data extra

    Integrates custom data sources to feed the list of URLs into the crawling queue.

    Pythonapifyautomationbeautifulsoup
    Voir sur GitHub↗8,097
  • mystenlabs/suiAvatar de MystenLabs

    MystenLabs/sui

    7,612Voir sur GitHub↗

    Sui is a blockchain platform featuring an object-centric state model and resource-oriented smart contracts. It utilizes parallel transaction execution to increase network throughput and supports programmable transaction blocks that bundle multiple operations into single atomic units. The platform distinguishes itself with a capability-based access control system and zero-knowledge login mechanisms, enabling users to authenticate via identity providers without seed phrases. It also implements deterministic object addressing to allow predictable state lookups and supports the creation of soulbo

    Aggregates data from indexers and archives through a unified GraphQL RPC server.

    Rustblockchaindistributed-ledger-technologymove
    Voir sur GitHub↗7,612
Préc.12Suivant
  1. Home
  2. Data & Databases
  3. Data Sources

Explorer les sous-tags

  • Authoritative5 sous-tagsSystems designated as the primary, definitive reference for data state. **Distinct from Data Sources:** Distinct from generic data sources: focuses on the architectural role of a system as the source of truth.
  • Data Source Loading StrategiesDefining whether data is retrieved as static sets or via dynamic functions. **Distinct from Data Sources:** Distinct from general data sources: focuses on the mechanism of loading (static vs dynamic) rather than the repository itself.
  • Data Source RoutingMechanisms for directing data requests to different storage sources based on availability or runtime logic. **Distinct from Data Sources:** Focuses on the routing logic between memory, disk, and cloud, rather than just providing the data source itself.
  • GraphQL AggregatorsCombining multiple disparate data sources into a unified GraphQL interface. **Distinct from Data Sources:** Distinct from Data Sources: focuses on the aggregation layer for GraphQL rather than raw data repositories.
  • Media Source Managers1 sous-tagTools for organizing and selecting optimal video streams from multiple providers. **Distinct from Data Sources:** Focuses on managing and selecting media sources, distinct from generic data source repositories.
  • MessageProtocols for supplying message objects to a chat interface and handling user interactions. **Distinct from Data Sources:** Distinct from Data Sources: focuses on message-specific data source protocols for chat interfaces, not general data source connectivity.
  • Music Service SwitchingControls for toggling between official and alternative music streaming backends within a client application. **Distinct from Data Sources:** Distinct from Data Sources: focuses on switching between music service backends rather than general data source selection.
  • Pluggable MarketSupplies historical and real-time market data through a replaceable data source abstraction that can connect to local bundles or external providers. **Distinct from Data Sources:** Distinct from Data Sources: focuses on a pluggable interface specifically for financial market data, not general data repositories.
  • Query-Based Table SpecificationsDefining the structural output of a data source using query statements to return specific tables of results. **Distinct from Data Sources:** Focuses on defining the output structure via queries rather than just the source of the data.
  • Request Source IntegratorsTools for connecting external data sources to internal crawling queues. **Distinct from Data Sources:** Distinct from Data Sources: focuses on the integration logic for feeding URLs into a crawler rather than the data source itself.
  • Source Metadata Retrievers2 sous-tagsQueries configuration and status information for data sources within a project. **Distinct from Data Sources:** Distinct from Source Metadata Capture: focuses on querying existing source metadata rather than capturing origin information during ingestion.
  • Source Restrictions1 sous-tagControls for specifying or limiting the information sources used by AI models. **Distinct from Data Sources:** Distinct from Data Sources: focuses on the configuration of source usage policies rather than the data repositories themselves.
  • Switching MechanismsPatterns for swapping between different data source implementations at runtime or compile time through a common interface. **Distinct from Data Sources:** Distinct from Data Sources: focuses on the mechanism to switch between sources, not the sources themselves.
  • View Data Providers1 sous-tagIntermediaries that provide data and handle behavioral callbacks for view components like tables and collection views. **Distinct from Data Sources:** Distinct from Data Sources: focuses on the UI-specific role of providing data and handling callbacks for view components.