awesome-repositories.com
Blog
MCP
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetServeur MCPÀ proposNotre méthodologiePresse
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·
s3tools avatar

s3tools/s3cmd

0
View on GitHub↗
s3tools.org/s3cmd↗

S3cmd

s3cmd is a command-line client for Amazon S3 and S3-compatible cloud storage services. It provides a unified terminal interface for managing buckets and objects, transferring files, and synchronising directories. All operations are performed over HTTPS with HMAC-SHA256 request signing and TLS encryption to secure data in transit.

The tool supports incremental transfers using S3 ETags, so only new or modified files are sent during sync. Large files are handled with multipart upload chunking, reducing the impact of failures and improving throughput. Directory synchronisation works recursively with checksum-based comparisons, and includes bidirectional sync, one-way mirroring, and incremental updates.

Beyond transfer and sync, s3cmd manages bucket lifecycle rules, configures access controls via ACLs and bucket policies, and handles object listing, copying, deletion, and metadata. The tool is written in Python and operates entirely from the terminal, making it straightforward to integrate into scripts and automation pipelines.

Recherche par IA

Explorez plus de dépôts awesome

Décrivez vos besoins en langage naturel — l'IA classe des milliers de projets open source sélectionnés par pertinence.

Start searching with AI

Features

  • S3 Protocol Clients - Provides a command-line interface for managing Amazon S3 and compatible cloud storage services.
  • Checksum-Based Directory Syncs - The storage CLI synchronizes local directories with remote storage, uploading only changed files for efficient backups.
  • Cloud File Uploaders - Uploads local files and directories with recursive, multipart, and incremental options.
  • Object Storage - Lists, copies, deletes, and manages metadata and access controls on storage objects.
  • Bucket Management - Manages S3 buckets with creation, deletion, listing, access controls, policies, metadata, and usage monitoring.
  • Bucket Access Policies - Manages bucket and object permissions through Access Control Lists and bucket policies via API calls.
  • Local-to-Cloud File Transfers - Uploads and downloads files to and from S3 with recursive and integrity-verified transfers.
  • Bidirectional Cloud Directory Synchronizers - Synchronizes local and remote directories bi-directionally with incremental updates based on checksums.
  • Command Line Interfaces - Operates entirely through a terminal command-line interface with flags and subcommands.
  • AWS S3 - Provides a full client for the Amazon S3 REST API.
  • S3 File Transfer Tools - Transfers files between local systems and S3 storage with upload, download, copy, and multipart support.
  • Multipart Uploaders - Provides multipart upload with chunking and resumption for reliable large file transfers to S3.
  • Cloud File Downloads - Downloads objects from remote storage with recursive support and integrity verification.
  • Incremental S3 ETag Transfers - Uses ETags to incrementally sync only changed files for efficient transfers.
  • Directory Structure Mirroring - Mirrors local directories to remote storage, copying only new or changed files.
  • Multipart Transfer Utilities - Transfers files using multipart and incremental uploads for efficient large-file handling.
  • Gestion des données - Command-line interface for Amazon S3 storage.
  • Gestion d'infrastructure - Full-featured S3 storage client.
  • Command Line Tools - Legacy command-line interface for managing cloud storage buckets and objects.
  • Networking and Storage - CLI for managing S3 and CloudFront.
  • Downloaders - Command-line tool for managing Amazon S3.
4,862 stars·910 forks·Python·gpl-2.0·13 vues

Historique des stars

Graphique de l'historique des stars pour s3tools/s3cmdGraphique de l'historique des stars pour s3tools/s3cmd

Alternatives open source à S3cmd

Projets open source similaires, classés selon le nombre de fonctionnalités partagées avec S3cmd.
  • minio/minio-goAvatar de minio

    minio/minio-go

    2,907Voir sur GitHub↗

    minio-go is a client library and software development kit for interacting with S3-compatible object storage. It provides a programmatic interface for Go applications to manage buckets and objects using the S3 protocol. The library enables the execution of complex storage operations, including multi-part uploads for large datasets, data synchronization between filesystems, and the management of bucket lifecycle and replication policies. It also supports advanced data retrieval through object searching and SQL-based querying of stored data. The toolkit covers a broad range of administrative an

    Goaws-signatureclient-sdkcloud
    Voir sur GitHub↗2,907
  • tickstep/aliyunpanAvatar de tickstep

    tickstep/aliyunpan

    4,952Voir sur GitHub↗

    This is a command-line client for managing multiple Aliyun Drive accounts from a single interface. It authenticates each account via an OAuth browser-based login flow, stores tokens separately, and allows switching between active sessions. The tool unifies local and cloud file paths under a common tree structure, enabling consistent browsing, upload, download, and organization across all connected accounts. The client implements several techniques to accelerate and control file transfers. Downloads are split into chunks and transferred concurrently across multiple streams, with progress track

    Goadrivebackuplinux
    Voir sur GitHub↗4,952
  • peak/s5cmdAvatar de peak

    peak/s5cmd

    3,921Voir sur GitHub↗

    s5cmd is a command line interface for high-performance data transfers and management tasks across S3 compatible storage services. It functions as a parallel data transfer tool and bucket synchronization utility, designed to accelerate the uploading and downloading of large volumes of files using concurrent workers. The tool acts as a batch command processor capable of executing thousands of object management operations in parallel from command files or piped streams. It also serves as an S3 Select query client, allowing the execution of SQL expressions against stored JSON records to retrieve

    Goawsclifilesystem
    Voir sur GitHub↗3,921
  • houtianze/bypyAvatar de houtianze

    houtianze/bypy

    8,555Voir sur GitHub↗

    bypy is a Python client for interacting with Baidu Yun cloud storage via its official API. It functions as both a library for programmatic integration and a command-line manager for organizing and listing files within a cloud account. The project features a multi-process transfer tool that utilizes parallel processing to accelerate high-volume uploads and downloads. It provides bidirectional directory synchronization to align content between local file systems and remote cloud storage by identifying missing or outdated files. The tool covers recursive file transfers, automated cloud data bac

    Python
    Voir sur GitHub↗8,555
Voir les 30 alternatives à S3cmd→

Questions fréquentes

Que fait s3tools/s3cmd ?

s3cmd is a command-line client for Amazon S3 and S3-compatible cloud storage services. It provides a unified terminal interface for managing buckets and objects, transferring files, and synchronising directories. All operations are performed over HTTPS with HMAC-SHA256 request signing and TLS encryption to secure data in transit.

Quelles sont les fonctionnalités principales de s3tools/s3cmd ?

Les fonctionnalités principales de s3tools/s3cmd sont : S3 Protocol Clients, Checksum-Based Directory Syncs, Cloud File Uploaders, Object Storage, Bucket Management, Bucket Access Policies, Local-to-Cloud File Transfers, Bidirectional Cloud Directory Synchronizers.

Quelles sont les alternatives open-source à s3tools/s3cmd ?

Les alternatives open-source à s3tools/s3cmd incluent : minio/minio-go — minio-go is a client library and software development kit for interacting with S3-compatible object storage. It… tickstep/aliyunpan — This is a command-line client for managing multiple Aliyun Drive accounts from a single interface. It authenticates… peak/s5cmd — s5cmd is a command line interface for high-performance data transfers and management tasks across S3 compatible… houtianze/bypy — bypy is a Python client for interacting with Baidu Yun cloud storage via its official API. It functions as both a… bloomreach/s4cmd — Super S3 command line tool. prefecthq/prefect — Prefect is a workflow orchestration platform designed to define, schedule, and monitor complex data pipelines as…