Bug 13082 - [REQ] Hardware / SSE based MD5 operations
[REQ] Hardware / SSE based MD5 operations
Status: NEW
Product: rsync
Classification: Unclassified
Component: core
3.1.3
All All
: P5 normal
: ---
Assigned To: Wayne Davison
Rsync QA Contact
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2017-10-12 11:31 UTC by Ben RUBSON
Modified: 2017-10-12 11:31 UTC (History)
0 users

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Ben RUBSON 2017-10-12 11:31:40 UTC
Hi,

I made some performance tests and ses that rsync can be a bottleneck while it is calculating hashes of basis files (not a surprise).

For example, while I can read a big test file directly from the storage at 300 MB/s, rsync checksums it at about 200 MB/s.

Thus impact of calculating hashes for big files can be quite important (some minutes for files of several hundreds of GB).

Then, what about MD5 implementation based on SSE ?
Do you think we would have a performance improvement ?

Thank you !

Ben