You should be concerned. It’s either the fan has a fault or something is touching the fan. If it’s an internal wire in the psu touching the fan that is a defect. If it’s something in the pc case pushing through the fan grill that needs to be sorted. If it’s the fan itself then the fan may soon fail.