Windows has built-in FTP client (not the best, but it's there). From Windows explorer, open your FTP site like ftp://ftp.mysite.com, then simply copy/paste your files there.
Thirdparty clients like @R1 mentioned have the advantage of being capable to resume broken downloads/uploads, etc.