Question Slow SATA 6Gbps SSD write speeds? Motherboard issue?

Sarchar

Distinguished
Dec 13, 2011
5
0
18,510
0
I have two brand new Samsung 870 QVO 1TiB SATA3 SSDs in a encrypted RAID 1 mirror mounted at /home:

sda 8:0 1 931.5G 0 disk
└─ssd2_encrypted 254:11 0 931.5G 0 crypt
└─md125 9:125 0 931.4G 0 raid1
└─md125p1 259:6 0 931.4G 0 part /home
sdd 8:48 1 931.5G 0 disk
└─ssd1_encrypted 254:12 0 931.5G 0 crypt
└─md125 9:125 0 931.4G 0 raid1
└─md125p1 259:6 0 931.4G 0 part /home

Is this write test slow?

# dd if=/dev/urandom of=/home/spam.data bs=1G count=20 status=progress
21474836480 bytes (21 GB, 20 GiB) copied, 239 s, 89.7 MB/s
20+0 records in
20+0 records out
21474836480 bytes (21 GB, 20 GiB) copied, 254.581 s, 84.4 MB/s

# ls -la /sys/block/sda
lrwxrwxrwx 1 root root 0 Sep 1 07:50 /sys/block/sda -> ../devices/pci0000:00/0000:00:01.2/0000:02:00.0/0000:03:09.0/0000:08:00.0/ata3/host2/target2:0:0/2:0:0:0/block/sda/

# ls -la /sys/block/sdd
lrwxrwxrwx 1 root root 0 Sep 1 07:50 /sys/block/sdd -> ../devices/pci0000:00/0000:00:01.2/0000:02:00.0/0000:03:0a.0/0000:09:00.0/ata6/host5/target5:0:0/5:0:0:0/block/sdd/

# dmesg | grep ata3
[ 0.808208] ata3: SATA max UDMA/133 abar m2048@0xfa500000 port 0xfa500200 irq 43
[ 1.286501] ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)

# dmesg | grep ata6
[ 0.808931] ata6: SATA max UDMA/133 abar m2048@0xfa400000 port 0xfa400180 irq 58
[ 1.288566] ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)

More info that may be relevant: this is also on a brand new Gigabyte Aorus X570 Wifi Pro mainboard that seems to be exhibiting SATA command errors only with HDDs (those HDDs are also new!). I can provide more info on that if needed, but I'm not seeing those SATA command timeouts on the SSDs at all.

Does anyone have any suggestions/tips/help? Is it likely this write speed is actually correct given the raid+encryption overhead? Read speeds are ~500+MB/sec, which I think is correct.

Cheers & thanks
 
I have two brand new Samsung 870 QVO 1TiB SATA3 SSDs in a encrypted RAID 1 mirror mounted at /home:

sda 8:0 1 931.5G 0 disk
└─ssd2_encrypted 254:11 0 931.5G 0 crypt
└─md125 9:125 0 931.4G 0 raid1
└─md125p1 259:6 0 931.4G 0 part /home
sdd 8:48 1 931.5G 0 disk
└─ssd1_encrypted 254:12 0 931.5G 0 crypt
└─md125 9:125 0 931.4G 0 raid1
└─md125p1 259:6 0 931.4G 0 part /home

Is this write test slow?

# dd if=/dev/urandom of=/home/spam.data bs=1G count=20 status=progress
21474836480 bytes (21 GB, 20 GiB) copied, 239 s, 89.7 MB/s
20+0 records in
20+0 records out
21474836480 bytes (21 GB, 20 GiB) copied, 254.581 s, 84.4 MB/s

# ls -la /sys/block/sda
lrwxrwxrwx 1 root root 0 Sep 1 07:50 /sys/block/sda -> ../devices/pci0000:00/0000:00:01.2/0000:02:00.0/0000:03:09.0/0000:08:00.0/ata3/host2/target2:0:0/2:0:0:0/block/sda/

# ls -la /sys/block/sdd
lrwxrwxrwx 1 root root 0 Sep 1 07:50 /sys/block/sdd -> ../devices/pci0000:00/0000:00:01.2/0000:02:00.0/0000:03:0a.0/0000:09:00.0/ata6/host5/target5:0:0/5:0:0:0/block/sdd/

# dmesg | grep ata3
[ 0.808208] ata3: SATA max UDMA/133 abar m2048@0xfa500000 port 0xfa500200 irq 43
[ 1.286501] ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)

# dmesg | grep ata6
[ 0.808931] ata6: SATA max UDMA/133 abar m2048@0xfa400000 port 0xfa400180 irq 58
[ 1.288566] ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)

More info that may be relevant: this is also on a brand new Gigabyte Aorus X570 Wifi Pro mainboard that seems to be exhibiting SATA command errors only with HDDs (those HDDs are also new!). I can provide more info on that if needed, but I'm not seeing those SATA command timeouts on the SSDs at all.

Does anyone have any suggestions/tips/help? Is it likely this write speed is actually correct given the raid+encryption overhead? Read speeds are ~500+MB/sec, which I think is correct.

Cheers & thanks
Full system specs?
 

Sarchar

Distinguished
Dec 13, 2011
5
0
18,510
0
Full system specs?
# lscpu|grep Model
Model name: AMD Ryzen 9 5900X 12-Core Processor

Ram - Corsair Vengeance LPX 64GB (2x32GB) 3200MHz DDR4

# uname -a
Linux arch 5.19.3-arch1-1 #1 SMP PREEMPT_DYNAMIC Sun, 21 Aug 2022 18:55:22 +0000 x86_64 GNU/Linux

Am I missing anything else? Thanks
 

kanewolf

Titan
Moderator
I have two brand new Samsung 870 QVO 1TiB SATA3 SSDs in a encrypted RAID 1 mirror mounted at /home:

sda 8:0 1 931.5G 0 disk
└─ssd2_encrypted 254:11 0 931.5G 0 crypt
└─md125 9:125 0 931.4G 0 raid1
└─md125p1 259:6 0 931.4G 0 part /home
sdd 8:48 1 931.5G 0 disk
└─ssd1_encrypted 254:12 0 931.5G 0 crypt
└─md125 9:125 0 931.4G 0 raid1
└─md125p1 259:6 0 931.4G 0 part /home

Is this write test slow?

# dd if=/dev/urandom of=/home/spam.data bs=1G count=20 status=progress
21474836480 bytes (21 GB, 20 GiB) copied, 239 s, 89.7 MB/s
20+0 records in
20+0 records out
21474836480 bytes (21 GB, 20 GiB) copied, 254.581 s, 84.4 MB/s

# ls -la /sys/block/sda
lrwxrwxrwx 1 root root 0 Sep 1 07:50 /sys/block/sda -> ../devices/pci0000:00/0000:00:01.2/0000:02:00.0/0000:03:09.0/0000:08:00.0/ata3/host2/target2:0:0/2:0:0:0/block/sda/

# ls -la /sys/block/sdd
lrwxrwxrwx 1 root root 0 Sep 1 07:50 /sys/block/sdd -> ../devices/pci0000:00/0000:00:01.2/0000:02:00.0/0000:03:0a.0/0000:09:00.0/ata6/host5/target5:0:0/5:0:0:0/block/sdd/

# dmesg | grep ata3
[ 0.808208] ata3: SATA max UDMA/133 abar m2048@0xfa500000 port 0xfa500200 irq 43
[ 1.286501] ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)

# dmesg | grep ata6
[ 0.808931] ata6: SATA max UDMA/133 abar m2048@0xfa400000 port 0xfa400180 irq 58
[ 1.288566] ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)

More info that may be relevant: this is also on a brand new Gigabyte Aorus X570 Wifi Pro mainboard that seems to be exhibiting SATA command errors only with HDDs (those HDDs are also new!). I can provide more info on that if needed, but I'm not seeing those SATA command timeouts on the SSDs at all.

Does anyone have any suggestions/tips/help? Is it likely this write speed is actually correct given the raid+encryption overhead? Read speeds are ~500+MB/sec, which I think is correct.

Cheers & thanks
As soon as you say encrypted, I am suspicious. How is that encryption being handled ?
 

Sarchar

Distinguished
Dec 13, 2011
5
0
18,510
0
That says that the CPU is doing the encryption. That will slow things significantly.
1. Read speeds aren't hindered by the (de-)encryption. Still get 500+MB/sec which tells me the CPU is fully capable of enc/dec at a fast enough speed.

2. HDD speeds (also RAID 1 with LUKS encryption) are higher than the SSDs in the exact same system:

# cd /mnt/hdd
# dd if=/dev/urandom of=spam.data bs=1G count=10 status=progress
10737418240 bytes (11 GB, 10 GiB) copied, 97 s, 110 MB/s
10+0 records in
10+0 records out
10737418240 bytes (11 GB, 10 GiB) copied, 97.3726 s, 110 MB/s

one of the drives in the HDD raid (the other looks the same). They're WD Purple 6TB:

sdc 8:32 1 5.5T 0 disk
└─hdd2_encrypted 254:5 0 5.5T 0 crypt
├─hdd2vg-hdd_storage 254:6 0 3.6T 0 lvm
│ └─md127 9:127 0 3.6T 0 raid1
│ └─md127p1 259:4 0 3.6T 0 part /mnt/hdd
 

ASK THE COMMUNITY