Sure if in all the world of randomness he somehow randomly lands on your exact email address and exact password. The odds of this happening are lower than that of winning the lottery, 1000+ times in a row.
If someone got into your account they got your email and password from some sort of leak, or you have a keylogger on your system, or your password is so ridiculously simple that someone who knows you and wants to "hack" you can easily guess it.