13 repositorios
Utilities for transferring processed data into Azure Blob Storage containers.
Distinct from Document Storage: Distinct from Document Storage: focuses on specific cloud storage export integration rather than general storage solutions.
Explore 13 awesome GitHub repositories matching data & databases · Azure Blob Storage Exporters. Refine with filters or upvote what's useful.
Vector is a high-performance observability data pipeline designed to collect, transform, and route logs, metrics, and traces across distributed infrastructure. It functions as a modular engine that decouples data ingestion from processing and transmission, utilizing a component-based architecture to connect diverse sources to multiple destinations. The project distinguishes itself through a focus on reliability and flow control. It implements backpressure-aware data movement to prevent data loss during traffic spikes and utilizes disk-backed event buffering to ensure durability during network
Exports processed observability data to Azure Blob Storage with support for batching and compression.
Unstructured is an enterprise-grade data orchestration engine designed to transform raw, unstructured files into structured, machine-readable formats. It functions as a comprehensive platform for document ingestion, partitioning, and enrichment, specifically engineered to prepare complex data for retrieval-augmented generation and agentic AI workflows. The platform distinguishes itself through its sophisticated document processing strategies, which combine rule-based extraction with vision-language models to handle diverse file layouts, tables, and images. It provides a modular architecture t
Transfers processed document data into specified cloud storage containers for downstream applications.
go-cloud es un kit de herramientas de bibliotecas agnósticas a la nube que proporcionan interfaces portátiles en Go para interactuar con servicios comunes en la nube. Permite el desarrollo de aplicaciones multi-cloud al desacoplar la lógica de negocio de las implementaciones de API de proveedores específicos. El proyecto utiliza un sistema basado en drivers para mapear llamadas de interfaz genéricas a solicitudes específicas del proveedor. Esto permite a las aplicaciones cambiar entre diferentes backends de nube para almacenamiento de blobs, bases de datos relacionales y mensajería asíncrona de publicación-suscripción sin cambiar el código central de la aplicación. Más allá del almacenamiento y la mensajería, el kit de herramientas incluye un gestor para rastrear y actualizar variables de configuración dinámicas en tiempo de ejecución sin requerir el reinicio del proceso. También proporciona una capa de observabilidad estandarizada para trazado distribuido, registro de solicitudes y verificación de estado.
Standardizes binary data operations and bucket management across multiple cloud blob storage providers.
This project is a Node.js and Express backend application that provides a RESTful API for managing video content, channel subscriptions, and community engagements. It utilizes a MongoDB NoSQL database for document management and leverages a middleware-based request pipeline to handle business logic and network requests. The system implements a secure user authentication framework using password hashing and JSON Web Tokens to manage sessions and protect private API routes. It also integrates cloud-based blob storage to handle the uploading and distribution of images, documents, and video files
Integrates cloud-based blob storage to handle the uploading and distribution of large images and video files.
Flux is a Kubernetes GitOps delivery tool used to automate application deployments by synchronizing cluster state with configurations stored in Git, OCI, or Helm repositories. It functions as a set of controllers that monitor desired state in external sources and continuously reconcile the live cluster to match those definitions. The system distinguishes itself through a multi-cluster management plane that coordinates application delivery across fleets of remote clusters from a central hub. It provides a dedicated mechanism for automated image updates, which scans container registries for new
Pulls manifests from Azure blob storage containers and packages them as artifacts.
sccache is a compiler cache wrapper and distributed compilation cache designed to store and reuse compilation results. It functions as a specialized caching solution for the Rust compiler, as well as a general tool to avoid redundant build cycles and reduce total build time. The project distinguishes itself through a cloud-backed build cache and remote storage backends. It enables the synchronization of build artifacts across multiple machines or team members using distributed memory caches or cloud object storage. Supported storage backends include local file systems, WebDAV, and a wide arr
Persists build artifacts to remote Azure Blob Storage containers.
Kraken is a distributed blob store and peer-to-peer Docker registry designed for the high-throughput distribution of container images. It functions as a decentralized content delivery network that shares image layers across a network of nodes to prevent bottlenecks at a central registry. The system utilizes peer-to-peer blob distribution and distributed content addressing to maintain download speeds across large clusters. It implements asynchronous rule-based replication to synchronize image data between disparate geographical clusters. The project covers pluggable external blob storage inte
Integrates with external blob storage providers to manage the underlying data layer for container images.
OpenStack is an open-source cloud computing platform for building and managing public and private cloud infrastructure at scale. It provides a framework for deploying, configuring, and operating cloud services, orchestrating compute, storage, and networking resources across a datacenter through a unified management layer. The platform is built on a decoupled service architecture where individual cloud services are developed and versioned independently within their own repositories. This meta-repository tracks interoperable versions of all OpenStack components as verified submodules, with each
Provisions compute, storage, and networking resources across a datacenter through a unified dashboard and API.
La librería de cliente de Google Cloud para Go es un conjunto de paquetes de Go y un kit de desarrollo de software utilizado para interactuar con los servicios y APIs de la plataforma Google Cloud. Proporciona el medio principal para que las aplicaciones de Go se integren con los endpoints de servicios en la nube a través de patrones de lenguaje simplificados y manejo automatizado de solicitudes de API. El proyecto cuenta con librerías especializadas para gestionar la identidad y el acceso a través de cuentas de servicio, claves de API y resolución de credenciales basada en el entorno. Incluye SDKs dedicados para la orquestación programática de recursos y el despliegue y gestión de funciones serverless, trabajos contenedorizados y servicios web escalables. La superficie de capacidad de la librería cubre la gestión de datos en la nube a través de almacenamiento relacional, NoSQL y de objetos, así como la orquestación de infraestructura para máquinas virtuales y contenedores. También proporciona herramientas para el desarrollo de IA generativa, análisis de datos a gran escala y monitoreo de aplicaciones en la nube a través de captura de registros y seguimiento de errores.
Implements lifecycle and configuration management for Google Cloud Storage buckets and binary blob objects.
This project is a .NET Core content management system and multi-site management platform designed to organize and publish structured digital content across independent websites from a centralized interface. It functions as both a headless CMS and a static site generator, rendering dynamic templates into HTML files to increase loading speed and scalability. The system integrates retrieval-augmented generation to transform website documents and content into searchable AI knowledge bases. It includes a visual AI workflow orchestrator to define the logic between user queries and large language mo
Offloads static files and assets to external cloud storage providers to separate the delivery layer from the application.
This project provides the formal technical specifications and reference logic for the Ethereum proof-of-stake consensus layer. It defines the standards for block production, state transition rules, and the beacon chain logic required to ensure consistent network agreement. The implementation covers specialized mechanisms for chain security and efficiency, including fork-choice algorithms for canonical chain determination, committee-based signature aggregation, and KZG-based blob commitments for data availability. It also specifies the protocols for light client synchronization using sync comm
Provides the ability to request and retrieve sequences of blob sidecars across specific slot ranges.
This project is a set of hands-on labs for practicing cloud development, focusing on implementing web apps, functions, storage solutions, and containerized workloads. It provides a practical framework for developing solutions within the Azure ecosystem. The content covers a wide range of specialized cloud capabilities, including serverless development with HTTP and timer triggers, container orchestration using apps and instances, and API management for routing and transforming traffic. It also emphasizes identity and access management through OpenID Connect and managed identities. Additional
Manages the lifecycle of cloud storage containers and performs secure uploads of binary files.
This project serves as a comprehensive technical guide and framework for building, deploying, and managing event-driven applications. It focuses on serverless architecture development, providing patterns and practices for implementing cloud-native services that execute code in response to triggers without requiring persistent server infrastructure. The repository distinguishes itself by offering a unified approach to polyglot runtime orchestration, allowing developers to manage components written in multiple programming languages within a single project. It emphasizes local cloud emulation, e
Configures and provisions cloud-based storage, databases, and network gateways to support application infrastructure.