Ok, I'm seriously going to pull my hair out on this one!
I recently sold my RX 580 due to the same stuttering issues, thinking it was the drivers on AMD's side of things, which isn't untrue to say the least. With the old 580 I would get high frames but really bad stuttering due to the gpu...