You'll be able to turn on the pc, run Windows and other very light duty graphical stuff. But sooner or later, the gpu will demand more than the power supply can output and that's gonna cause all sorts of problems, from bluescreens to corrupted data, possible damage to the psu as the capacitors in low end psus are susceptible to failure at high loads, overheating damage, burned out psu, possible date to cpu/gpu/motherboard/ram if the psu does fail and spike.
The simple answer is yes it'll work, but you are strongly advised not to even try it. Consider yourself warned.