*Would you like to comment further about:
a) type of noise, and
b) how frequent it is?
If it's just the occasional coil whine I would not return the card.
1) Coil whine is usually inherent in the design of the card itself, so RMA'ing may not help. It's simply a circuit, and surrounding board material that oscillates in the audible range. Basically acting as a mini speaker.
Coil whine is avoided in the design, but it can be hard to completely eliminate.
2) If it is coil whine then it's usually more obvious in high-FPS scenes such as a load screen running 300FPS+ (no VSYNC on). Often it's a high-pitched "screeching" sound that is varying in frequency.
3) *first comment said they "shouldn't give you a refurbished one back" but that's...