Well - budget build is a relative term, and considering the power of the machine we're talking about, it's a discount when compared to anything close to equivalent. Remember what an 8 or 10 core NEW i7-6850X chip costs - $600 by itself. And that is only a hex-core hyperthreaded CPU. An i7-6950x is a 10c/20t CPU, and that sucker lists for over $1500.00 by itself. So - when you can get an entire computer core (motherboard/CPU/RAM) for $600, it IS a budget build. And that build in multi-core tests will decimate the $1500 CPU (yes, single core tests the i7-6950x will beat it but otherwise it'll get hosed).
Also - you don't need registered DIMMS, the boards do use regular UDIMMS (my Xeon E3-1230 is running 8GB DDR3 plain jane RAM, and my Xeon X3470 build on the P7F7-E WS is running 16GB of regular UDIMMS as well). ECC registered DIMMS vs non-ECC DIMMS is supported at the motherboard level - the Xeon CPUs themselves will run with either type.
Finally, remember, - the $600 isn't just for the motherboard. $600 is for two 8 core Xeons, a motherboard, and 16GB of RAM. Add case, PSU, graphics and storage. All in all, you could get away with the build for probably in the $1200 range depending on the graphics and storage. Is it moderately expensive in absolute terms? Yes. But this also isn't your off the shelf Dell computer you're going to buy at Office Depot. Considering what you're getting it's still less than a single flagship-level Intel CPU, let alone a flagship BUILD.
Here's someone who built and tested it:
http://www.techspot.com/review/1155-affordable-dual-xeon-pc/
Personally, I have two builds at home is exactly the type of budget build you're talking about - the difference is the cores.
Build 1:
Xeon X3470/Asus P7F7-E WS/16Gb DDR3 ($200 for all of it). 256GB SSDs (Samsung 830s x2 RAID0) ($40 each). Case - older Antec 4400 series that I've had forever. Twin GTX960s SLI ($340). Strider Gold PSU ($90). Total build cost: $710.00
Build 2:
Xeon E3-1230 ($70)/Asus H61M-E($50)/8GB DDR3($50)/256GB SSD Crucial 550 ($80)/Generic case($50)/Antec 380w PSU($40)/GTX1060($300). Total build cost: $640.
The build above though (dual Xeon E5's) would kill either one of these systems.
------------edit-----------
BTW, it's easily possible to find motherboards for the CPU he picked (which is exactly what they used in the dual Xeon build). He just needs an X79 based motherboard. A quick search of Amazon finds them readily available, just double check for Xeon V1 BIOS support. Looking at it, the GA-X79-UP4 (Gigabyte board) supports both the V1 and V2 high end Xeons. It is a bit pricey though, but when it supports quad SLI, Xeon 8 cores, gobs of RAM, it's NOT going to be cheap.