After I got my GTX 1070, I started realizing how much of a bottleneck my CPU apparently is. For a card that is supposed to be beating the Titan X, it is running at something like 40% slower.
Now, I'm not sure how much of a bottleneck it actually is, because my GPU still shows high usage. But...