It depends on the size of the system. Also, if the reason you are doing the restore is because of a major data loss, if you're trying to restore to the same drive, it may never succeed if the reason for the original problem is a drive failure.
Or, if the restore process is having to format the destination drive first, that could add considerably to the time required; once the drive is formatted, the rest of the process should be much quicker.