p1que :
So would it make sense to get a bigger case and then get semi or full modular?
Larger cases are, of course, easier to work with. Cooling is usually harder in a smaller case, and you'll need to be more careful about whether certain video cards and CPU heatsinks/fans will fit. But if you want/need a smaller PC and you're prepared to deal with those extra considerations, go for it. Mini-ITX PCs are cool.
I'd recommend semi- or fully modular power supplies regardless, as they are objectively an improvement over hard-wired ones in any form factor. The only reason you wouldn't want one is to save some money, and even that isn't necessarily a given with so many decent mid-range semi-modular units available today.