Yeah, so great question. AI is one of those things that many of us still don't have a great handle on exactly how or when possessing our own dedicated AI chip will benefit us, but I have to figure that with news of impending AI-based internet security threats, a good way to counteract them will as you suggest be by having an AI-based defense solution. At some point pfSense / OPNsense is sure to include options for different options for integrated AI models.
We don't know how long that will take, though, and I do expect to wait a bit. Maybe another generation or half generation, as far as CPUs/APUs are concerned. For the time being I plan to keep an eye on the options, and my hope is that now that AMD appears to be entering the NUC ring with Intel, that we will see some very low-power chips meant to compete with Intel's N1XX / N2XX series, but with an added AI chip. AI will eventually become part of much of what we do, and while I don't think I have a reason to buy a laptop or desktop with an integrated AI chip just yet, I do plan to buy one whenever it makes sense to build a secure router solution around the tech.
But we'll see how AMD scales its chips to compete in the super low-wattage segment. As long as the AI chip itself doesn't require too much power, they should be able to pair it with cut-down Ryzen cores without raising the power envelope too much... and as always, my hope is for passively cooled!