You've answered your own question, you'll be fine but you're leaving performance on the table.
What platform are you dealing with? Pleas don't say specs in my sig(we ask users to pass on their specs in the thread's body) as sig space specs can and will change over time rendering this thread and any possible suggestions moot to the person in the same boat as you're in now.
FYI, Ryzen platforms love high frequency, dual channel setups to get the best out of that platform.