

to know more see Use of Exclude and Include Filters. The –include (string) option don’t exclude files or objects in the command that match the specified pattern. Here is an example aws s3 cp s3://source-awsexamplebucket/ s3://destination-awsexamplebucket/Īnother advantage of the cp command is that you can include –exclude and –include parameters can filter files by name. The copy command syntax is easy to use, and can combine different type of sources on the same command from local to cloud, or from cloud to local aws s3 cp or or Just remember, in order to run s3 commands you need AWS CLI installed and configured, if you don’t have it yet, no worries, here is a full reference to do so. This way you can transfer huge amount of files on record time.

These parallel instances, also work for other commands such as move (mv) and sync, not just copy (cp) for AWS CLI. In the backend it takes advantage of multi-threading process. In other words, you can split the transfer operation through multiple mutually exclusive operations to improve the transfer performance. AWS S3 cp command triggers a distributed action by using the parallel uploads embebed on AWS CLI copy command. The best way to do it is by using cp command to transfer large amount of data on AWS S3. How to transfer large amount of data on AWS S3? Imagine the followed scenario You have a huge file or a large amount of data you need transfer, lets say 1 TB, from 1 bucket to another bucket on Amazon Simple Storage Service (S3).
