如何使用PowerShell在S3存儲桶之間複製大於5GB的文件

Question

如何使用PowerShell在S3存儲桶之間複製大於5GB的文件？

有幾個使用PowerShell在AWS S3存儲桶之間複製文件的例子，但他們使用的是Copy-S3Object命令，該命令爲limited to files less than 5GB。

Answer 1

您必須先download並安裝AWS Tools for Windows PowerShell。

這是基於AWS網站上的C＃example。

$AWSCredentials = Get-AWSCredentials -ProfileName YourProfileName # use Get-AWSCredentials -ListProfiles 

$sourceBucket = " " #source Bucket 
$targetBucket = " " #target Bucket 
$sourceObjectKey = " " #source filename 
$targetObjectKey = " " #target filename 
$region="USEast1" #region 
$copyResponses = @() 

$s3Config = New-Object Amazon.S3.AmazonS3Config 
$s3Config.RegionEndpoint = [Amazon.RegionEndpoint]::$region 


$s3client = New-Object Amazon.S3.AmazonS3Client($AWSCredentials,$s3Config) 

$initiateRequest = New-Object Amazon.S3.Model.InitiateMultipartUploadRequest 
$initiateRequest.BucketName = $targetBucket 
$initiateRequest.Key = $targetObjectKey 

$initResponse = $s3client.InitiateMultipartUpload($initiateRequest) 
$uploadId = $initResponse.UploadId 
$uploadId 

$metadataRequest = New-Object Amazon.S3.Model.GetObjectMetadataRequest 
$metadataRequest.BucketName = $sourceBucket 
$metadataRequest.Key = $sourceObjectKey 

$metadataResponse = New-Object Amazon.S3.Model.GetObjectMetadataResponse 
$metadataResponse = $s3client.GetObjectMetadata($metadataRequest) 
$objectSize = $metadataResponse.ContentLength; # in bytes 
$objectSize 

$partSize = 1GB 
$objectSize/$partSize 

$bytePosition = 0 
for ($i = 1; $bytePosition -lt $objectSize; $i++) 
{ 
    $copyRequest = New-Object Amazon.S3.Model.CopyPartRequest 
    $copyRequest.DestinationBucket = $targetBucket 
    $copyRequest.DestinationKey = $targetObjectKey 
    $copyRequest.SourceBucket = $sourceBucket 
    $copyRequest.SourceKey = $sourceObjectKey 
    $copyRequest.UploadId = $uploadId 
    $copyRequest.FirstByte = $bytePosition 
    $copyRequest.LastByte = if ($bytePosition + $partSize - 1 -ge $objectSize) { $objectSize - 1} else {$bytePosition + $partSize - 1} 
    $copyRequest.PartNumber = $i 

    $copyResponses += $s3Client.CopyPart($copyRequest) 
    $bytePosition += $partSize      
} 

$completeRequest = New-Object Amazon.S3.Model.CompleteMultipartUploadRequest 
$completeRequest.BucketName = $targetBucket 
$completeRequest.Key = $targetObjectKey 
$completeRequest.UploadId = $uploadId 
$completeRequest.AddPartETags($copyResponses) 

$completeUploadResponse =$s3Client.CompleteMultipartUpload($completeRequest)