I had a minor epiphany, recently. A fundamental problem with the current approach to AI is that we're making it in our own image (sound familiar?). Because it's trained on the products of humans and designed to function in a world populated by us, of course it's going to inherit some of our vices and failings.
Perhaps it needn't be this way, but the more AI understands us and how to deal with us, the more like us it'll tend to become. So, at some level, it's a tradeoff between utility and safety. You can't have an AI that truly understands you, that doesn't also understand how to manipulate you.