Hello, Let's imagine the sender is uploading a bunch of files which are quite similar. For example, the following dir : /directory |-backup1.iso |-backup2.iso |-backup3.iso |-backup4.iso |-backup5.iso For the moment, if no remote fuzzy basis is found at the very beginning of the transfer, every file will be fully uploaded. Goal would then be to improve rsync so that once the first file has been uploaded, fuzzy algorithm could look at this new file as a fuzzy basis file for the other new files arriving. Same thing once the second file has been uploaded etc... Perhaps it could be done once for all at the very beginning of the transfer, also taking the list of files which will be uploaded (sent by the sender), and their properties, to feed the fuzzy algorithm. This would speed-up transfer in a number of situations. Thank you very much ! Ben
I go one step further than this: rsync should not only look for a file to reference in fuzzy mode but also take into account what it transferred previously. So instead of throwing away any information it gathered for the first file once it is done it could keep the transfer information and reuse it. It would then a) automatically fulfill you request by having the information for the first iso already b) not rely on similarity by size and/or name only but on the data itself! Of course this would increase memory usage but that's something the user can decide if it is worth or not.