I've been having this problem for 2 years now and it has persisted even after switching from a GTX 1060 to a 1070.
My system specs are:
i5 6600k (oc to 4.2GHz but problem persists with or without oc)
Asus Z170M-Plus
Zotac GTX 1070 Mini (upgraded from Zotac 1060 Amp)
12GB Corsair 2133mhz ram...