Move Archives - Thomas Maurer

Jun182019June 18, 2019June 18, 20192 Commentsby Thomas Maurer

Migrate Amazon S3 bucket to Azure blob Storage

Migrate AWS S3 buckets to Azure blob storage

Posted in Cloud, Microsoft, Microsoft Azure, Windows, Windows 10

With the latest version of AzCopy (version 10), you get a new feature which allows you to migrate Amazon S3 buckets to Azure blob storage. In this blog post, I will show you how you can copy objects, folders, and buckets from Amazon Web Services (AWS) S3 to Azure blob storage using the AzCopy command-line utility. This makes it easy to migrate S3 storage to Azure or create a simple backup of your AWS S3 bucket on Azure.

AzCopy will use the Put Block from URL API, which allows you to directly copy files from AWS directly to Azure. This means you will not use a lot of bandwidth from your computer. You can even copy large objects or buckets from S3 to Azure.

Configure access and authorize AzCopy with Azure and AWS

First, you will need to install AzCopy to your machine. After that, you will need to authorize AzCopy with Microsoft Azure and AWS. To authorize with AWS S3, you have to use an AWS access key and a secret access key.

AWS access key and secret access key, and then set these environment variables:

OS	Command
Windows	set AWS_ACCESS_KEY_ID=
	set AWS_SECRET_ACCESS_KEY=
Linux	export AWS_ACCESS_KEY_ID=
	export AWS_SECRET_ACCESS_KEY=
macOS	export AWS_ACCESS_KEY_ID=
	export AWS_SECRET_ACCESS_KEY=

Copy an AWS S3 object to Azure blob

You can copy a simple object using the following command:

azcopy cp "https://s3.amazonaws.com/tomsbucket/tomsobject" "https://tomsstorageaccount.blob.core.windows.net/tomscontainer/tomsblob"

Copy and migrate Amazon S3 folder to Azure

You can copy a folder from the Amazon S3 bucket to the Azure blob storage:

azcopy cp "https://s3.amazonaws.com/tomsbucket/tomsfolder" "https://tomsstorageaccount.blob.core.windows.net/tomscontainer/tomsfolder" --recursive=true

Copy an Amazon S3 bucket to Azure blob storage

You can also copy one or multiple Amazon S3 buckets to Azure:

azcopy cp "https://s3.amazonaws.com/tomsbucket" "https://tomsstorageaccount.blob.core.windows.net/tomscontainer" --recursive=true

I hope this gives you a quick idea of how you can migrate data from Amazon AWS S3 storage to Azure using AzCopy. If you want to know more, check out the official Microsoft Docs about how to copy data from Amazon S3 buckets by using AzCopy.

Mar042015March 4, 2015March 26, 202032 Commentsby Thomas Maurer

PowerShell Sort and move files by date month year

PowerShell: Sort and Move Files by Date to month and year

Posted in Cloud, Microsoft, PowerShell, Windows, Windows 10, Windows 8, Windows 8.1, Windows Server, Windows Server 2008 R2, Windows Server 2012, Windows Server 2012 R2, Work

This quick blog post, shows, how you can sort and move files to folder sorted by date (year and month) with PowerShell. I had to sort a lot of files and put them into folders for each month and year. So for example when the files was created/modified in February 2012, the file had to be moved into the folder 2012 and the subfolder 2 (for February). For this, I created this quick and dirty script. This script gives you an example of how you can sort and move files by date using PowerShel.

# Get the files which should be moved, without folders
$files = Get-ChildItem 'C:\Users\Thomas\OneDrive\OneDrive Camera Roll' -Recurse | where {!$_.PsIsContainer}
 
# List Files which will be moved
$files
 
# Target Filder where files should be moved to. The script will automatically create a folder for the year and month.
$targetPath = 'C:\Users\Thomas\OneDrive\pictures\Albums'
 
foreach ($file in $files)
{
# Get year and Month of the file
# I used LastWriteTime since this are synced files and the creation day will be the date when it was synced
$year = $file.LastWriteTime.Year.ToString()
$month = $file.LastWriteTime.Month.ToString()
 
# Out FileName, year and month
$file.Name
$year
$month
 
# Set Directory Path
$Directory = $targetPath + "\" + $year + "\" + $month
# Create directory if it doesn't exsist
if (!(Test-Path $Directory))
{
New-Item $directory -type directory
}
 
# Move File to new location
$file | Move-Item -Destination $Directory
}

Please as always if you use a PowerShell script from the internet, test it first before you run it against your production environment. This script can for example also be very handy to sort documents, pictures or Windows Logfiles.

I hope this blog post helps you to sort and move files by date using PowerShell. If you have any questions, let me know in the comments below.

Sep282011September 28, 2011September 28, 20110 Commentby Thomas Maurer

Windows Server 8 Hyper-V Virtual Machine Replication

Posted in Hyper-V, Microsoft, Virtualization, Windows Server, Windows Server 8, Work

One of the biggest new features in Windows Server 8 Hyper-V is Hyper-V Replica. Hyper-V Replica allows you to replicate Virtual Machines over the network to another Hyper-V Hosts. This is great if you replicate the VM to another datacenter or if you don’t want to create a Hyper-V Cluster and still have the requirement to start the Virtual Machine in 30 minutes on another host.

With the Hyper-V VM Move feature you can even push this and live migrate a Virtual Machine to another host even if you don’t have a cluster. This can be useful if you have a maintenance window on your Hyper-V hosts.

Tag: Move

PowerShell: Sort and Move Files by Date to month and year

Windows Server 8 Hyper-V Virtual Machine Replication

Follow Me

About

Get Updates

Sponsor

Sponsor

Sponsor

Sponsor