I got into the PC game "late" so to speak - my first machine was a Win95 Pentium 133 from Dell.
It came with a 2MB STB video card, PCI, that was based on an S3 chip, if I'm not mistaken.
The first 3D GPU I bought, the second highest price I ever paid for a video card, was an STB Velocity 128, 4MB Riva 128 chipset from Nvidia. I think I got it in late 1997 or early 1998. Cost me a whopping $180 back then.
My first actual computer? Commodore 64, and for storage, a datasette. I saved up the money and got the 5-1/4 floppy drive later, which, if I recall, cost a little more than the computer itself.