Check with your ISP. Most companies give you a lot more download connection speed than an upload connection -- for example, my connection with Earthlink (previously via Time Warner, now via Spectrum) is rated at 20Mbps down, plus the Cable MAX boost, & my download tests are generally in the 20Mbps range. My uploads however, never go higher than 1.5Mbps (although they always stay at least above 1Mbps).
It's just the nature of the service, though. ISPs figure that customers are primarily interested in downloading content vs. uploading it, so you're generally going to see your upload speeds be much, much lower. It's primarily 'business-class' customers that need to have a more balanced load -- not just actual businesses, but anyone who has a need for high upload bandwidth/upload speeds (i.e. someone who has a static IP address because they're running a file/game server).
The big question is, when you ran the speed tests, did it give you a QoS percentage and/or a ping value, & what were your download speeds? Again, unless you're gaming or uploading a lot of files (either because you're uploading large files or because you're running a file server), your download speed is going to have the most effect on your Internet experience. And if you're gaming, you can have a "slow" upload speed, but if your ping is low (<100ms) that'll have the best effect on your gaming experience. If your QoS (Quality of Service) is low, however, then it doesn't matter what your speeds are, because low QoS means your connection isn't consistent. Whether that's due to in-house issues (i.e. lots of people sharing a connection, bad router/modem, etc.), "last mile" issues (i.e. squirrels have chewed on the cables a lot -- happened once to us, & I don't know how many times to my brother-in-law), or even true ISP issues (i.e. bad equipment in the local node/central office, malfunctioning boosters/repeaters, network issues, etc.), will depend on the results of troubleshooting.