It's because modern OS's (Windows especially) are still dumb and will only utilize one CPU thread per file copy operation at a time, which is fine for bigger files since you only have to process one read/write cycle for one file, but when you get to those thousands of little files you hit a bottleneck as your system goes through the read/write cycle for each file, with only one thread to process those cycles.
GBAtemp.net - The Independent Video Game Community
Tom Bombadildo
Was never really a problem when HDD's were the main storage system of choice, since HDDs are slow enough that the bottleneck was with the drive itself so you'd see no real difference in speeds, but with SSDs being the standard now...
Tom Bombadildo
What's great is that the technology to fix that has literally existed since like 2009 (and probably earlier, really), which is when Robocopy (a more advanced command line tool for copying files) in Windows added support for multithreading, it's just File Explorer by default won't use that system for...whatever reasons.
https://github.com/Cinchoo/ChoEazyCopy < is a GUI for that tool
https://github.com/Cinchoo/ChoEazyCopy < is a GUI for that tool
19.822 small 1 KB Files - 470 KB / sec.
Aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaahhhh..........
Reactions: Mama Looigi and Jiehfeng