AceMovie :
I don't know why it says 25w my graphics card works fine. It's vague.
You running with the original power supply? It's nice to see a proof point that a 240W PSU can handle a small CPU and a GTX1050.
For new case, there are an huge number of options. I like a mini-tower format. You can get tiny gaming ITX cases with full height PCIe slots, portable LAN party cases, huge full tower gaming cases, etc. You can get $40 cases that work well, or spend $100 and get something really nice. With your parts cooling airflow will be fine on any case.
You will need to:
1. Mount your MB in the new case. Likely the mounting holes will line up, but they may not. Check the web to see if anyone has moved the SFF MB from your system. Check the dell pubs to see if they give the MB format, it might be standard.
2. Live with the IO plate missing from the back of your PC. The IO plate normally comes with a MB, and moves from Case to Case. Your Dell will not have a movable IO plate, they solder them in.
3. Get a new Power Supply that is ATX format. ($50) The format PSU you currently have is rare, and is extremely rare in cases that take a full height video card. It's very likely your case will need an ATX power supply.
4. Play mix and match with the motherboard connectors. If Dell has a custom MB connector (likely) rather than the separate pin headers you would get on a standard MB then you may need to take the header with you and splice wires rather than push pins onto a pin block.
All of this is doable. You'd need to view this work as fun and something you want to try or you'd just get a $50 MB that fits without bother. (then you get a better CPU to go with the $50 MB, then you'd add a few more things and discover you were $300 into buying parts and have an entirely new PC).
The only advice I'd give is *DO NOT* get a combo case+power supply. A $50 case plus power supply comes with a crappy $20 PSU that is not worth having. I'd pay not to get one, and you couldn't pay me enough to run a PC on one of those POS power supplies. I'm not that fussy, I have a bunch of HPs running on their Bestech PSUs, and think your Dell PSU is fine, it's just the stuff they put in those combo deals is scary given they can destroy your MB, CPU and disk drive with one high voltage failure, and they can cause blue-screen stability problems at any time as their output voltage swings with every line current hit.
Aside, Your SFF case with the side off likely has good cooling, but double check. Sometimes they duct the airflow assuming the side is on and the air MUST flow over certain components in a particular order. The CPU cooler airflow and the VRM would be things to consider. If this is what your PC looks like you are likely OK:
https://cwl.cc/2012/09/review-dell-optiplex-390-small-form-factor.html