It depends on two factors.
First, the second memory module has to have similar characteristics to that of the first memory module in order for the modules to work together compatibly. Note that using a memory module even with the same make and part number as the other memory module is no guarantee that the two individual memory modules will be compatible with each other due to variations in module characteristics.
Ideally, to ensure inter-module compatibility, use of a dual channel kit is recommended since the two modules from the kit have been tested for and guaranteed to be compatible with each other and should work immediately without any issues.
Buying individual modules instead of a dual channel kit, there is a risk of inter-module incompatibility. In this case other modules may have to be bought and tried as well until a compatible combination is found. This process may take some time and cost more in the end.
Second, in order for the two modules to operate in dual channel mode, requires that one module be installed in one channel, and the other module installed within the other channel. Typically for systems with four memory slots, one module goes in slot two, and the other module goes in slot four. Sometimes though, one module might have to go in slot one, and the other module might have to go in slot three instead. This depends on the motherboard; refer to motherboard manual for details.