Am almost certain the way you want it hooked up is going to cause problems, but u can always experiment, the worst is, it won't work, nothing is going to blow up.
"Out there" network designers are worried about boxes redundancy, and a box failing may take down all the connections with it, like a road closing, so the designer places backup boxes (multiple switches), in the ready in the event that a box fails. The switches talk to themselves via a TRUNKING protocol, and knows when the main path has failed, then turn on the backup path, but NEVER have both paths turned on at the same time. The trunking protocol does this automatically and in real time. The switches capable of doing this costs thousands of dollars.
Routers, again building redundancy, means duplicate redundant boxes which provides MULTIPLE PATHS TO A DESTINATION, which helps if a link (i.e. cable down by a construction digger), but multiple routers are more intelligent and can load balance as well as for failsafe. This stuff of course is for enterprise networking, 24x7 up time mandatory, am guessing not the expense you have in mind.