minio/minio-go
Minio Go
minio-go is a client library and software development kit for interacting with S3-compatible object storage. It provides a programmatic interface for Go applications to manage buckets and objects using the S3 protocol.
The library enables the execution of complex storage operations, including multi-part uploads for large datasets, data synchronization between filesystems, and the management of bucket lifecycle and replication policies. It also supports advanced data retrieval through object searching and SQL-based querying of stored data.
The toolkit covers a broad range of administrative and security capabilities, including server-side encryption, bucket policy management, and the generation of presigned URLs. It further provides utilities for object immutability enforcement, event-driven bucket notifications, and storage usage auditing.
Features
- S3 Storage Management - Serves as a comprehensive SDK for developing Go applications that interact with S3-compatible object storage.
- S3-Compatible Storage Adapters - Provides a comprehensive SDK that acts as an adapter for interacting with any S3-compatible object storage API.
- Cloud Object Storage - Provides a high-level toolkit for managing unstructured data as blobs in S3-compatible cloud environments.
- Object Data Management - Provides utilities for object tagging, immutability locks, and server-side encryption to protect stored data.
- Large File Transfers - Enables the transfer of massive datasets between local systems and remote storage using multi-part upload optimizations.
- Multi-Part Upload Orchestration - Orchestrates the splitting of large objects into smaller chunks for concurrent transmission and final assembly on remote storage.
- Object Storage Persistence - Provides a programmatic interface for performing standard CRUD operations across compatible object storage systems.
- Bucket Management - Provides administrative controls to create, list, and remove buckets used to organize object storage resources.
- Bucket Access Policies - Provides the ability to define and retrieve access rules to control user permissions for specific storage buckets.
- Storage Access Control - Implements secure data access using bucket policies, presigned URLs, and external identity provider integration.
- Object Lifecycle Operations - Implements fundamental operations for managing individual objects, including retrieval, copying, and deletion.
- Local-to-Cloud File Transfers - Provides capabilities to upload and download files directly between a local filesystem and remote object storage.
- Object Storage SDKs - Provides a full-featured Go SDK for executing multi-part uploads, data synchronization, and bucket lifecycle management.
- S3 Protocol Clients - Provides a programmatic client implementation for connecting to and managing remote storage using the S3 protocol.
- Request Signing - Generates HMAC cryptographic signatures for every request to verify identity and prevent tampering during transit.
- Presigned URL Generation - Generates cryptographically signed, time-limited URLs to provide temporary access to private objects without sharing keys.
- Bucket Replication Configuration - Sets up server-side replication to synchronize data between buckets in active-active configurations.
- Cloud Storage Automation - Provides programmatic interfaces to automate bucket creation, lifecycle policies, and data replication.
- Storage Content Synchronization - Mirrors content between local filesystems and remote buckets by identifying and copying missing or changed objects.
- Direct Object Store Querying - Enables the execution of SQL queries directly on stored objects to retrieve specific subsets of data.
- Lifecycle Rule Configuration - Configures expiration and transition rules to automatically move or delete objects based on their age.
- Object Search - Allows locating specific files or objects across storage systems using prefix and wildcard matching.
- Storage State Comparison - Identifies differences between directories or buckets by listing missing objects or size discrepancies.
- Storage Tiering - Automates the movement of data between different storage tiers based on object age and access frequency rules.
- Concurrent Stream Buffering - Uses Go channels and buffers to efficiently manage data transfers between local files and remote sockets without overloading memory.
- Object Locking - Implements object locking and legal holds to prevent accidental or malicious deletion of data.
- Bucket Encryption Configuration - Provides methods to set or remove encryption settings to ensure data remains encrypted while at rest in a bucket.
- S3 Server-Side Encryptions - Configures server-side encryption (SSE) modes for storage buckets to ensure data is encrypted by the storage provider.
- Provider Abstractions - Provides standardized interfaces that allow the client to interact with diverse S3-compatible storage backends through a consistent API.
- Third Party APIs - Client for Amazon S3-compatible storage.
- Third-party APIs - Minio/S3-compatible storage client.
Star history
How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
