IMO Throttle back from ultra to High on your graphics then I would do the 'basics' just to make sure it isn't something else also in the background:
((I took the time to type this out, please take the time to do each one, one at a time and respond back the result AS OF this post.
Do not TL
R, there is never any "click this type this one command SOLVED" answers.))
Version of Windows? 10? 8? 7? - BEST ANSWER IS UPDATE TO NEWEST OS, which 10 is free and painless for only a little bit longer.
Did you install all Windows Updates? Including OPTIONAL items except BING? Check them and repeat till ALL are installed.
Download and run Slim Drivers, install all the latest updates but you don't need to reboot until you do the last update
Go to www.filehippo.com, download Malwarebytes, go to CUSTOM Scan and set it to do a full system scan (by DEFAULT IT DOESN"T DO THAT, and AntiVirus doesn't pick up alot of malware) - this resolved almost ALL other similiar posts to date as most had Malware the AV didn't pick up.
Remove whatever AV your using and download AVIRA, AVG, Comodo or Panda go to CUSTOM Scan and set it to do a full system scan (by DEFAULT IT DOESN"T DO THAT) - this repeatedly has resolved alot of people issue relying on MS Essentials.
Repeat the AV/Malware scans till the system comes up clean.
Download AUTORUNS and turn off anything NOT critical on startup, so you don't need to run JAVAScheduler to check for Java updates everytime you start your computer for example. BE CAREFUL AND KNOW WHAT YOUR TURNING OFF BEFORE YOU DO IT.
OKAY SOFTWARE DONE, NOW HARDWARE:
Open Computer, Can Air dust out the bunnies and use paint brush on the vents, coolers, fans, etc.
OKAY HARDWARE DONE, NOW LET'S CHECK OUR WORK!:
Download and run SPECCY, copy and paste the first tab to show your idle temps
Download and run MSI Afterburner, in the settings turn ON OSD, then go through and SET the stuff to 'watch' by enabling them in OSD (On Screen Display)
Now run some of the games that run poor, what temps are you getting when underload as compared to what you posted?
With MSI Afterburner Do you see anything funny that the CPU or other parts are maxing out (we are testing here not trying to WIN at the games, so if your screen is filled with readouts then just deal as we are just observing).
Check all the games you listed, and provide if there they ALL or just SOME are having this issue?