Only YouTube videos? What about videos from other sites or sources?
May not necessarily be YouTube causing the problem.
Could be a device configuration issue, a network issue, maybe some buggy app being run.
See if you can narrow down the freezing/pausing to some specific set of circumstances.