[SOLVED] Windows Server 2019 slow write performance with NVMe datastore on VMware ESXi 6.7 U3 ?

[srmvel]

Hi All,

I have 2 DELL R630. ESXi 6.7 U3 is running. When I'm testing the disk benchmark from Windows 2019 VM on both the ESXi , I see different results.

All the R630 configurations are the same except for the physical CPU.

1st server "ESXi01" has 2cpu and each cpu has 16 cores.

Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz

Model 79 Stepping 1

2nd server "ESXi02" has 2cpu and each cpu has 18 cores.

Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz

Model 63 Stepping 2

We use the below NVME adapater/disk directly(PCIE)on both the R630 servers for data. Please note,we are not using any RAID for NVME.

Ableconn PEXM2-130 Dual PCIe NVMe M.2 SSDs Carrier Adapter Card - PCI Express 3.0 x8 Card Support 2X M.2 NGFF PCIe NVMe SSD for Mac & PC (ASMedia ASM2824 Switch) - Support Non-Bifurcation Motherboard

Inland Platinum 2TB SSD NVMe PCIe Gen 3.0x4 M.2 2280 3D NAND Internal Solid State Drive, R/W up to 3,400/3,000 MB/s, PCIe Express 3.1 and NVMe 1.3 Compatible, Utimate Gaming Solutions (2TB)


Windows 2019 from 1st ESXi server "ESXi01"

for 4 KB,im getting around 262 MB/s.


Windows 2019 from 2nd ESXi server "ESXi02"

for 4 KB,im getting around 127 MB/s.

What might the issue? except CPU all are same.Physical CPU plays a major role on 2nd ESXi ?

Please help.

Thanks,
Raj

 

[jeremyj_83]

If I am understanding your setup correctly you have 2 ESXi hosts and are using M.2 > PCIe Adapter card to house a single M.2 NVMe SSD in each host. Am I correct on this or do you have dual M.2 SSDs in each host?

Do you have any other storage besides that? Are you using storage resource pools? How many VMs are running on the each datastore?

 

[srmvel]

If I am understanding your setup correctly you have 2 ESXi hosts and are using M.2 > PCIe Adapter card to house a single M.2 NVMe SSD in each host. Am I correct on this or do you have dual M.2 SSDs in each host?

Do you have any other storage besides that? Are you using storage resource pools? How many VMs are running on the each datastore?

each nvme adapter has 2 nvme disks.
this is testing environmnent,so 1st esxi has 1 windows vm and 2nd esxi also 1 vm.

 

[jeremyj_83]

each nvme adapter has 2 nvme disks.
this is testing environmnent,so 1st esxi has 1 windows vm and 2nd esxi also 1 vm.

Right click on the VM and click "Edit Setting." Go to the HDD and hit the carrot down and see what it says for "Shares." Make sure Shares is set to Normal or High. While with a single VM the Shares shouldn't affect storage performance, it is a simple thing to check. If this is running in a vCenter environment check to see if there is a something set differently in your Storage Policies or Storage I/O control is enabled.

All things considered you should be having much better disk performance.