If you simply cut the power wire to the fan and plumb an inline resistor there, the fan RPM will drop everywhere on the curve from idle to max. Without the fan specs it's impossible to tell what value resistor to use but you can start trial-and-error with around 20-30 ohms and a goal of around 25% drop in idle RPM. Keep an eye on the temperatures esp under load because the max fan RPM will also be proportionately dropped.
More elegant and expensive would be to epoxy an NTC thermistor right onto the heatsink. With this as your inline resistor, the resistance will be high when cold and drop to near zero when hot.
Be sure to select components appropriate for the wattage of the fan, or they could eventually burn out to leave you with no RPM on the fan.