Bug 10580 - Total file size reported wrong with --stats --info=progress2
Summary: Total file size reported wrong with --stats --info=progress2
Status: ASSIGNED
Alias: None
Product: rsync
Classification: Unclassified
Component: core (show other bugs)
Version: 3.1.1
Hardware: x64 Linux
: P5 major (vote)
Target Milestone: ---
Assignee: Wayne Davison
QA Contact: Rsync QA Contact
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2014-05-01 13:09 UTC by Vania Toperich
Modified: 2014-05-26 18:19 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Vania Toperich 2014-05-01 13:09:21 UTC
Hi,

For some reason, rsync reports wrong total file size of transfer.... It reports 3.13G and stops on 50% when all the files are transferred correctly....:

sending incremental file list
              0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=10/14)
home/media/Movies/Джек Николсон/Томми 1975/Томми 1975_1.avi
        733.67M  23%   71.74MB/s    0:00:09 (xfr#1, to-chk=0/14) 
home/media/Movies/Джек Николсон/Томми 1975/Томми 1975_1.srt
        733.68M  23%   71.73MB/s    0:00:09 (xfr#2, to-chk=5/14)
home/media/Movies/Джек Николсон/Томми 1975/Томми 1975_2.avi
          1.57G  49%   71.64MB/s    0:00:20 (xfr#3, to-chk=3/14)
home/media/Movies/Джек Николсон/Томми 1975/Томми 1975_2.srt
          1.57G  50%   28.28MB/s    0:00:52 (xfr#4, to-chk=0/14)

Number of files: 14 (reg: 8, dir: 6)
Number of created files: 0
Number of regular files transferred: 4
Total file size: 3.13G bytes
Total transferred file size: 1.57G bytes
Literal data: 0 bytes
Matched data: 1.57G bytes
File list size: 0
File list generation time: 0.006 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 224.51K
Total bytes received: 392.49K

sent 224.51K bytes  received 392.49K bytes  10.37K bytes/sec
total size is 3.13G  speedup is 5,076.28

Here is info on both sides:

Remote:
root@reng:/home/media/Movies/Джек Николсон/Томми 1975# du -h
1.5G	.

Local:
du -h /home/media/Movies/Джек\ Николсон/Томми\ 1975/
1.5G	/home/media/Movies/Джек Николсон/Томми 1975/

Please let me know if you need any additional information. 

Looking forward to hear from you.

Kind regards,

Vania
Comment 1 Vania Toperich 2014-05-01 13:10:53 UTC
ls -la /home/media/Movies/Джек\ Николсон/Томми\ 1975/
total 1529336
drwxr-xr-x  2 media media      4096 Aug 20  2011 .
drwxr-xr-x 14 media media      4096 Mar 13 12:07 ..
-r-xr--r--  1 media media 733667328 Jul 11  2011 Томми 1975_1.avi
-r-xr--r--  1 media media     15467 Jul 11  2011 Томми 1975_1.srt
-r-xr--r--  1 media media 832309248 Jul 11  2011 Томми 1975_2.avi
-r-xr--r--  1 media media     27318 Jul 11  2011 Томми 1975_2.srt
Comment 2 Vania Toperich 2014-05-01 13:28:47 UTC
rsync  version 3.1.1pre1  protocol version 31
Copyright (C) 1996-2014 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
    64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
    socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
    append, no ACLs, xattrs, iconv, symtimes, prealloc

rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
are welcome to redistribute it under certain conditions.  See the GNU
General Public Licence for details.
Comment 3 Vania Toperich 2014-05-01 15:03:25 UTC
I am using --include-files and list is created automatically. Here is an example:

/home/media/Movies/Джек Николсон/Беспечный ездок 1969
/home/media/Movies/Джек Николсон/Беспечный ездок 1969/Беспечный ездок 1969.avi
/home/media/Movies/Джек Николсон/Беспечный ездок 1969/Беспечный ездок 1969.srt

It seems that rsync will calculate size for root folder as well and then add also files in it....
Comment 4 Wayne Davison 2014-05-26 18:19:52 UTC
The --info=progress2 option only works with incremental recursion at present. Performing a --files-from=FILE copy does an implied --no-inc-recursive scan, which doesn't work at all with --info-progress2 at present.  We'll need to look into how best to fix that.  Thanks for the report.