Bug 12530 - [REQ] Improve fuzzy using files being uploaded
[REQ] Improve fuzzy using files being uploaded
Status: NEW
Product: rsync
Classification: Unclassified
Component: core
3.1.2
All All
: P5 normal
: ---
Assigned To: Wayne Davison
Rsync QA Contact
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2017-01-19 08:05 UTC by Ben RUBSON
Modified: 2017-01-19 08:05 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben RUBSON 2017-01-19 08:05:33 UTC
Hello,

Let's imagine the sender is uploading a bunch of files which are quite similar.
For example, the following dir :
/directory
|-backup1.iso
|-backup2.iso
|-backup3.iso
|-backup4.iso
|-backup5.iso

For the moment, if no remote fuzzy basis is found at the very beginning of the transfer, every file will be fully uploaded.
Goal would then be to improve rsync so that once the first file has been uploaded, fuzzy algorithm could look at this new file as a fuzzy basis file for the other new files arriving. Same thing once the second file has been uploaded etc...
Perhaps it could be done once for all at the very beginning of the transfer, also taking the list of files which will be uploaded (sent by the sender), and their properties, to feed the fuzzy algorithm.

This would speed-up transfer in a number of situations.

Thank you very much !

Ben