Stick with dual channel, they're way faster than single channel, and will improve performance a lot.
EDIT: Three sticks won't slow your system that much. By adding the 3rd sticks you'll be in a single channel mode. This might reduce system performance but nothing to worry, all depends how fast...