windows - How to monitor progress of md5 hashing of large drives/many files?

Question

I am looking for the simplest and least intrusive way to monitor the progress of md5 fingerprinting of large drives, many files (8 TB, 2 million).

What would be the best option, for example in case it gets stuck or begins an infinite loop, I can see the trouble file?

The code:

Get-childitem -recurse -file | select-object @{n="Hash";e={get-filehash -algorithm MD5 -path $_.FullName | Select-object -expandproperty Hash}},lastwritetime,length,fullname | export-csv "$((Get-Date).ToString("yyyyMMdd_HHmmss"))_filelistcsv_MD5_LWT_size_path_file.csv" -notypeinformation

aaaa

Answer 1

If you want to list progress, you need to know where your process will end, so you need to list all the files BEFORE you start operating on them.

Write-Host "Listing Files..." -Fore Yellow
$AllFiles = Get-ChildItem -Recurse -File
$CurrentFile = 0 ; $TotalFiles = $AllFiles.Count

Write-Host "Hashing Files..." -Fore Yellow
$AllHashes = foreach ($File in $AllFiles){
    Write-Progress -Activity "Hashing Files" -Status "$($CurrentFile)/$($TotalFiles) $($File.FullName)" -PercentComplete (($CurrentFile++/$TotalFiles)*100)

    [PSCustomObject]@{
        File = $File.FullName
        Hash = (Get-FileHash -LiteralPath $File.FullName -Algorithm MD5).Hash
        LastWriteTime = $File.LastWriteTime
        Size = $File.Length
    }
}

$AllHashes | Export-Csv "File.csv" -NoTypeInformation

This will give you a nice header with a progress bar, which looks like this:

ISE:

Normal Shell: