More or less.
OEM systems can use proprietary units, those are not universal.
Most PSUs will fall into the ATX form factor, meaning they will fit in the ATX case. (some cases have a max length for PSUs)
There are also SFF psus, those only fit SFF cases.