minio/minio-go
Minio Go
minio-go is a client library and software development kit for interacting with S3-compatible object storage. It provides a programmatic interface for Go applications to manage buckets and objects using the S3 protocol.
The library enables the execution of complex storage operations, including multi-part uploads for large datasets, data synchronization between filesystems, and the management of bucket lifecycle and replication policies. It also supports advanced data retrieval through object searching and SQL-based querying of stored data.
The toolkit covers a broad range of administrative and security capabilities, including server-side encryption, bucket policy management, and the generation of presigned URLs. It further provides utilities for object immutability enforcement, event-driven bucket notifications, and storage usage auditing.
Features
- S3 Storage Management - Serves as a comprehensive SDK for developing Go applications that interact with S3-compatible object storage.
- S3-Compatible Storage Adapters - Provides a comprehensive SDK that acts as an adapter for interacting with any S3-compatible object storage API.
- Cloud Object Storage - Provides a high-level toolkit for managing unstructured data as blobs in S3-compatible cloud environments.
- Object Data Management - Provides utilities for object tagging, immutability locks, and server-side encryption to protect stored data.
- Large File Transfers - Enables the transfer of massive datasets between local systems and remote storage using multi-part upload optimizations.
- Multi-Part Upload Orchestration - Orchestrates the splitting of large objects into smaller chunks for concurrent transmission and final assembly on remote storage.
- Object Storage Persistence - Provides a programmatic interface for performing standard CRUD operations across compatible object storage systems.
- Bucket Management - Provides administrative controls to create, list, and remove buckets used to organize object storage resources.
- Bucket Access Policies - Provides the ability to define and retrieve access rules to control user permissions for specific storage buckets.
- Storage Access Control - Implements secure data access using bucket policies, presigned URLs, and external identity provider integration.
- Object Lifecycle Operations - Implements fundamental operations for managing individual objects, including retrieval, copying, and deletion.
- Local-to-Cloud File Transfers - Provides capabilities to upload and download files directly between a local filesystem and remote object storage.
- Object Storage SDKs - Provides a full-featured Go SDK for executing multi-part uploads, data synchronization, and bucket lifecycle management.
- S3 Protocol Clients - Provides a programmatic client implementation for connecting to and managing remote storage using the S3 protocol.
- Request Signing - Generates HMAC cryptographic signatures for every request to verify identity and prevent tampering during transit.
- Presigned URL Generation - Generates cryptographically signed, time-limited URLs to provide temporary access to private objects without sharing keys.
- Bucket Replication Configuration - Sets up server-side replication to synchronize data between buckets in active-active configurations.
- Cloud Storage Automation - Provides programmatic interfaces to automate bucket creation, lifecycle policies, and data replication.
- Storage Content Synchronization - Mirrors content between local filesystems and remote buckets by identifying and copying missing or changed objects.
- Direct Object Store Querying - Enables the execution of SQL queries directly on stored objects to retrieve specific subsets of data.
- Lifecycle Rule Configuration - Configures expiration and transition rules to automatically move or delete objects based on their age.
- Object Search - Allows locating specific files or objects across storage systems using prefix and wildcard matching.
- Storage State Comparison - Identifies differences between directories or buckets by listing missing objects or size discrepancies.
- Storage Tiering - Automates the movement of data between different storage tiers based on object age and access frequency rules.
- Concurrent Stream Buffering - Uses Go channels and buffers to efficiently manage data transfers between local files and remote sockets without overloading memory.
- Object Locking - Implements object locking and legal holds to prevent accidental or malicious deletion of data.
- Bucket Encryption Configuration - Provides methods to set or remove encryption settings to ensure data remains encrypted while at rest in a bucket.
- S3 Server-Side Encryptions - Configures server-side encryption (SSE) modes for storage buckets to ensure data is encrypted by the storage provider.
- Provider Abstractions - Provides standardized interfaces that allow the client to interact with diverse S3-compatible storage backends through a consistent API.
- Third Party APIs - Client for Amazon S3-compatible storage.
- Third-party APIs - Minio/S3-compatible storage client.
