How are you moving them makes a difference.
If being done on the same drive then:
Copy & paste will take a long time as the drive will need to read & write the actual data.
Cut & paste is much much quicker; the drive just needs to rewrite the table of contents to say these files are now in this folder.
As always, make sure you have a valid backup esp before doing things with your data.
For example; I would never use Cut & Paste to move files from one drive to another, if the paste fails and your file buffer corrupts during the transfer, all those files will need to be recovered. Copy & paste, verify the files after the transfer, then delete source when all is good.