You replaced the original fan in the PSU with a Noctua model that is of the 4-pin design. For future reference, you should have used a 3-pin type, becasue that is how the PSU will regulate its fan. But this 4-pin fan CAN be managed by the PSU anyway.
You did not know, apparently, that almost all PSU's do their OWN fan speed control because there is NO standard way to feed the PSU internal TEMPERATURE out to the mobo, and that is how fan speed if managed. The PSU has its own internal temp sensor and fan speed control based on that. So the real key is: where / how to connect wires from the new fan.
The new fan should be connected inside the PSU to the SAME place the old fan was. That will have only TWO connections: Ground and +VDC power. Often they are colour-coded as Black for Ground, Red for +VDC. If you still have your old fan around, examine its connector, then see if you can figure out how that was plugged into a pair of pins inside the PSU. If it was simply soldered into two spots on a board, you may have to do a bit of exploring. If you can find the spots or pins but to not know polarity, you may have to open the PSU case (as you did for the replacement operation) and do a possibly DANGEROUS operatiom with the unit turned on. This can be dangerous because you WILL have exposed components at 120 VAC, and you WILL charge up even low-voltage capacitors to dangerous levels, so you MUST not touch anything during this test!! PLUS, you MUST safely discharge any residual charges AFTER you shut it down!! The aim here is simply to use voltmeter probes on the two fan power points to identify which is Ground, and which is +. This may be difficult because a PSU normally will not come "on" without being connected to the mobo load.
With that info, we turn to the new fan's 4-hole female connector. It has two ridges running down one side. Three of its holes are between the ridges; the fourth hole is beyond, and that is Pin #4, the PWM signal line. Next to it just inside one ridge is Pin #3, the Speed signal line. You do NOT connect either of these to anything. At the other end of the connector, Pin #1 is the Ground line, and Pin #2 in the MIDDLE of the span between ridges is the +VDC line. These two are to be connected to the PSU's internal fan points. IF you have the old fan with a connector on its wires, the easiest way is to cut that connector INCLUDING a couple inches of wire from the old fan. Then snip off the connector on the new fan's wires. Splice the Ground and +VDC lines from the old connector onto the new wires from Pins 1 and 2, and tape them. For the other two wires from the new fans, cut each of them shorter, then tape up the ends of each individually. Lastly, tuck those two unused wires into a safe place where they won't get caught on something. As a final test, try to start up the PSU and verify that the new fan rotates in the correct direction.
By the way, for you in future and for others, IF the replacement fan you get is the older 3-pin design that was intended for an application like this, all 3-pin fans use a common wire colour code: Ground is Black, +VDC is Red, and the Speed line is Yellow.