First thing to remember is there is no such thing as wake on WAN. Everything you see related to waking stuff up from device on the internet is a hack, and the vast majority of the instructions skip the fact that it will never work unless your router has the ability to set a static arp table entry. That is very rare feature. They want to get their clicks on their silly pages so they don't admit even if they know that it will not actually work.
Most the idiots that write these guides have no clue and do not test properly. If they did they would find out it has the problem you describe. It works at first because there is a ARP table entry cached for a period of time in the router. After about 15 minutes or so this is purged...