Micyia001, the basic answer is yes, it would be more secure. It would be like giving a folder the hidden attribute. Normally people wouldn't see it, but if they turned on "view hidden files" then they could. Likewise, if someone was looking around with a spectrum analyzer (which aren't terribly expensive if you're into war-driving) and launch kismet, etc. then it didn't matter if you turned off broadcasting.
In the real world, war-drivers or even people trying to cause trouble would just move on to easier targets. If it's a neighbor with some time, or someone specifically targeting a person, then turning off broadcasting wouldn't matter.