When you look at the most generic/reference VGA there is no difference. However each manufacturer used their own supplier( sametimes the same one) when it comes to capacitors...etc The difference in non-reference could be in cooling, capacitors, resistors, memory, and even the board itself.
The non reference cards have better components and cooling that the reference designs...that is why they usually are clocked at higher speeds.