So after checking Event Viewer and looking at the drivers, even thought it said that it's "The latest driver installed" I went on to Realtek's website to update it manually with a much newer driver for my network adapter. Now after testing continuous pings and downloading, it doesn't drop...