A few routes you can go. You could get powered studio monitors designed for studios. They are powered meaning they don't require an amp. The problem is they are a flat response across the frequency range. They are design to reproduce the sound without altering it for mixing audio in studios. So they may sound plain/flat to you. But they are inexpensive and very high quality. Personally I love the sound from them as they are full range, not high pitched and tinny, and not low and boomy, like cheap speaker systems.
Another route would be to get some bookshelf speakers and a small stereo amp. You can get amps that have bluetooth and USB built in for connecting to the computer.
Personally I would look at getting a USB DAC...