I recently purchased a top-spec 27" iMac with the Pro Vega 48 card.
As soon as I turn it on, and whenever the iMac is awake, regardless of how little it is doing, I can hear a slight but certain fan noise coming from it. It is very quiet, but in a quiet room it is noticeable when working at it...