No, they shouldn't be able to make any sound like you described.
Can you still hear it after removing the SSD?
Are you possible hearing the piezoelectric effect? SSDs can emit a high/medium pitched squeal whine.
Dell acknowledges the sound - https://www.dell.com/support/kbdoc/...y-laptop-makes-a-strange-squeal-buzzing-noise
It can also be due to MLCCs. There's probably other potential reasons as well. Although quieter than HDDs SSDs are definitely not silent.
No, they shouldn't be able to make any sound like you described.
Can you still hear it after removing the SSD?
You are most likely hearing vibrations from elsewhere in the laptop getting amplified by the SSD's mostly hollow housing acting like a speaker membrane.I recently swapped my mechanical drive for a WD ssd in my laptop and since the first startup it has this constant low/mid frequency hum. It is only clearly audible when I press my ear against it though, but I thought SSDs make no sound at all, is this normal?
You are most likely hearing vibrations from elsewhere in the laptop getting amplified by the SSD's mostly hollow housing acting like a speaker membrane.
The only noise I can imagine SSDs really making on their own would be coil/capacitor whine from on-board DC-DC converters.