For a lot of big data moves that don’t require special software but need to be logged, you can us ROBOCOPY, a built in file moving command that will not only let you log the moves but also enabling a multi-threaded structure for faster moves. Use this command with the following switches for the fastest possible Robocopy without interruption:
robocopy C:\Folder1 C:\Folder2 /TEE /LOG:"C:\Test\log.txt" /E /FP /R:5 /W:1 /MT:128
- robocopy C:\Folder1 C:\Folder2 is the base of your script. This will copy everything from the first folder to second. If your paths have spaces you need to use quotes.
- /TEE will write everything it does to the console so you can watch it.
- /LOG:”C:\Test\Log.txt” will write a log to a file named log.txt
- /E is everything including empty folders
- /FP is full path in the logs so you can see exactly where the file is located.
- /R:5 is retry. This will retry the file 5 times if it is in use. If you do not set this, the default is 1 million and you will not finish your move.
- /W:1 is wait time between retries. It is set to 1 second.
- /MT:128 is multi-threading, the most important switch of all. The default is very low, less than 10, so be sure to increase this to as high as you can make it to max out the drivers ability to migrate the files.
These are all my favorites. I hope they help you with your data migrations.