There's more than one virtual machine that you may be using. They all behave a bit differently. What virtual machine are you using?
Some allow drag and drop between the VM and the host, others must be linked by a virtual network.
I use VMware Workstation and it's a simple drag and drop from one machine to the other.