Quality. Cheap ones skimp out on well-built components and safety features that shouldn't be overlooked, and can potentially even cause expensive damage. Most cheap PSUs also can't supply their advertised load either.
The best cheap PSUs I know are the Seasonic S12II or Corsair CXM. They're both $50 in my country, USA for a 430W unit.