With regards to the 32-bit server variants, there is a feature called PAE (Physical Address Extension) which the server OSes happen to support. PAE was first offered in the Pentium Pro processor. With PAE, the address table's size is essentially increased to 36-bit... allowing for a max of 64GB of addressable memory rather than just the 4GB with 32-bit. The problem is with drivers... most 32-bit drivers are not large address aware and quite often there would be issues with most consumer hardware and PAE. Because server platforms are more tightly controlled, it's much easier to implement it on the server level. With 64-bit gaining more and more support, PAE will be rendered useless. After all, there is no point in offering a 32-bit OS only partially supporting 36-bit addressing when 64-bit is available widely now.
So in a nutshell, with 32-bit Windows you are still limited to 4GB. However, because your RAM is NOT the only addressable memory in your system and any hardware that has memory must have it's memory allocated first, you'll never be able to make use of the full 4GB of RAM. Actual addressable RAM will be 4GB minus however much memory is on your video card or cards, any other RAM or ROM that may be present on any add-in cards, and any cache memory on your hard drives / optical drives. So while you may only have 4GB of RAM installed, you can still benefit from installing 64-bit Windows... because you'll be able to make use of all 4GB. With 32-bit Windows, some of that RAM is going to waste.