Why does my Samsung EVO 860 paste from 100kbps to 550mbps?

[Bruno Vincent]

I'm quite confused about the SSD thing, maybe I'm copying and pasting all wrong?

Why does a 100 kilobytes document take as long as a 100 meg file if there are many of em?

5 gigs of small files, takes an hour, but 1 large 5 gig file takes seconds...

Now I understand that smaller files take more CPU but why is pasting dropping to under 100kbps on a brand new SSD with brand new system (16 gigs Ram, AsRock z370, i5-8400, Samsung evo 860)...

Am I missing something here?

 

[USAFRet]

Because of the CPU/RAM/OS overhead needed to locate those thousands of tiny files, one by one.

 

[Bruno Vincent]

Because of the CPU/RAM/OS overhead needed to locate those thousands of tiny files, one by one.

I'm surprised it's so slow, even in 2018?

I mean how do they compute on the Hubble telescope?

The genome project?

What about banks with trillions of files? 100kbps?

These transfer speed seem like mid 70's ? 😉

Will we need nano computers to make this work fast ? Lol!

 

[USAFRet]

Because of the CPU/RAM/OS overhead needed to locate those thousands of tiny files, one by one.

I'm surprised it's so slow, even in 2018?

I mean how do they compute on the Hubble telescope?

The genome project?

What about banks with trillions of files? 100kbps?

These transfer speed seem like mid 70's ? 😉

Will we need nano computers to make this work fast ? Lol!

Those functions have server farms the size of your neighborhood. And they're not "copying" hundreds of thousands of files. They are relying on CPU to do millions of calculation per sec. Big difference.

Try transferring that exact same data with HDD's. Way, way slower, because in addition to the system overhead, the drive has to physically spin and move the heads around to access all those tiny files.

 

[Bruno Vincent]

Because of the CPU/RAM/OS overhead needed to locate those thousands of tiny files, one by one.

I'm surprised it's so slow, even in 2018?

I mean how do they compute on the Hubble telescope?

The genome project?

What about banks with trillions of files? 100kbps?

These transfer speed seem like mid 70's ? 😉

Will we need nano computers to make this work fast ? Lol!

Those functions have server farms the size of your neighborhood. And they're not "copying" hundreds of thousands of files. They are relying on CPU to do millions of calculation per sec. Big difference.

Try transferring that exact same data with HDD's. Way, way slower, because in addition to the system overhead, the drive has to physically spin and move the heads around to access all those tiny files.

Actually I did and SSD to SSD for 100 000 files is only 10% faster than SSD to HDD , tested this 😉

So I speculate that an NVME wouldn't even do better, maybe 11%, 12% !

 

[USAFRet]

Actually I did and SSD to SSD for 100 000 files is only 10% faster than SSD to HDD , tested this 😉

Now try it from HDD to SSD.

Writing to the HDD, it mostly put them in one contiguous space.
Reading from an HDD with files scattered all over (as happens with normal use) will be much slower.