please define gaming SERVER. are you just storing the games on it? In which case I think the ram you have is fine.
if you're using it to host LAN parties and other networked gaming sessions, I don't think the ram bandwidth will matter much either.
if you're trying to stream games from it... well I'd like to know how you're doing this 😛