Well, the kernel's GPU driver framework is specifically designed to make graphics drivers portable across different platforms, including different ISAs. The fact that all he had to do was disable the VGA console stands as testament to this fact!
Where things might've gotten a bit hacky is in his workarounds of the various issues he encountered in Mesa. In this case, perhaps you could say his solutions to some of those problems were a bit hacky, rather than undertaking all the work needed to port it in a clean and elegant way. However, like the Kernel's driver framework, Mesa is also designed to be cross-platform. So, any issues he hit should've been places in the Xe code that were somewhat needlessly x86-specific.