Well, it depends on what you are looking to run in VR. If you are talking about games like Fallout VR or other high end titles with lots of effects, maybe not, but there are plenty of games for VR that don't require all that power. You could easily play games like Beat Saber, Fruit Ninja VR, and maybe even Holopoint.
You might have an ideal use case here for a WMR headset too as they require less powerful hardware to drive. You could easily run some of the more simple games.
Then you'd have a VR headset for when you are ready to upgrade and if you drop in something like a Ryzen 5 and a GTX 1060 you'd be able to play just about anything.
I use a WMR headset on my desktop (i5 4590S, RX 470) and laptop (i7 7700HQ, GTX 1060), and I'm at...