seekaliao :
I dont get it, OS being the bottleneck? The main thing with OS is due to accessing numerous small files and low QD. But I/O is highly random in nature rather than sequential. Unless you pack everything into a single file that can be read sequentially.
Yes and no. First, even if you put everything in one file, there will still be random access. But SSDs don't mind random access nearly as much as HDDs did. Especially if it's concurrent with other I/O.
seekaliao :
Also, OS has a well developed cache structure to minimise HDD reads.
Now, you're on to something. Operating systems are designed around very slow storage, relatively speaking. The APIs they provide to applications reflect this, as do the majority of application software out there. So, when the storage becomes nearly as fast DRAM, now the overhead of archaic APIs, filesystems, etc. prevent the true speed of the storage from being harnessed. NVMe was a big step in the right direction, but even
that is too slow for 3D XPoint.
seekaliao :
This is still true today even with optane. Optane is still much slower than DRAM.
Not really. 3D XPoint is within about an order of magnitude of DRAM speeds. If you put it in NV DIMMs, then you might find that disk caching overhead is actually slower than reading directly from persistent memory, not least because it's byte-addressable while disk caches are probably sector or block-based.
But that requires a whole new set of APIs and software ecosystem. It'll take a while to get there.
seekaliao :
Some have resorted to creating DRAM drive with their main memory to get lightning fast access. Of course, thats rather costly and DRAM is violatile.
IMO, this is kind of pointless when you can load up a machine with as much as 1.5 TB of DRAM (depending on the CPU). For most purposes, I'd say just get a fast SSD and maybe install some extra RAM in your mobo and you'll be happy. If need be, you can still configure some of that RAM as a software ramdisk, which should be even faster than if it were sitting out on PCIe or over SATA.
The kinds of hardware RAM disk devices you describe made more sense, back before SSDs came of age.