How's the progress here?  I'd say this is an important enhancement as I routinely transfer tens of thousands (small) files from one system to another and --progress would be an overkill for the purpose of monitoring progress -- all I want is just a neat and tidy summary.

I second this, it's about the only feature I consistently wish for in rsync. Also, can Wayne or Tam change this to Hardware: All please?

Created attachment 3390 [details]
patch to give total run progress indication

Here's a little patch that creates a new flag "--total-progress", which causes the progress indication to be based on data-copied/total-data, rather than on a per-file basis. It may be used with or without -v(erbose).

Is this useful, or would people prefer to just use the existing --progress/-P flag, and have the global totals only used in non-verbose mode?

Also, when used with -r(ecursive) mode, you can see some interesting oddities, as it scans subdirectories as it goes. This means it's possible to have the total number of files (and the % completed) *decrease* as it runs as it scans more subdirectories. I'm not sure if there's any real way around this.

Oh, forgot to mention, but that patch should apply to v3.0.3.

Thanks for the patch.  I'm incorporating this idea into the latest rsync (3.1.0dev) using the new general-purpose --info=FLAGS option to turn this on:  the --progress option will infer --info=progress (along with the other output flags that it traditionally affects) and gives you the normal per-file progress.  You can instead specify --info=progress2 to get overall transfer progress, which will output on a single line (if rsync is not outputting any names).  I'm still working on what I want the various fields to display, but it is working in the latest git repository version.

Great!! I wasn't sure what output format, options, and behavior would end up being the most useful or user friendly, so I'll defer to your judgment on that. In any case, I know quite a few people who'll be very happy when this feature makes it into the major distributions they use, so thanks again. :)

There seems to an error with speed calculation with --info=progress in version 3.1dev. It's showing a continues speed of 26.90MB/s which is just impossible to attain under my internet downstream. 

# rsync3 -arth --info=progress2 --no-motd --exclude=debug/ rsync://mirrors.kernel.org/centos/5.4/updates/i386 /Raid/centos/5.4/updates

        135.08M   8%   26.90MB/s    0:00:54  Quit68, to-chk=275/346)

I'd also like this enhancement very much, especially because when I use -v the process stalls somehow during the transfer (simple home directory backup) and I have to "killall rsync".

Why does --progress imply --verbose? I was expecting -v to be one thing and --progress to be another, completely independent.

Thanks for this great program.