[SOLVED] PC won't shut down completely

[stefan_destept42]

Recently I installed a new video card but, I didn't realized that the jack from the monitor was like a trapeze and the one from the video card had a rectangular shape . So I just leaved it there until my order of a new cable arrives.

The problem is , that every time I shut down the computer everything goes normal, except that the fan from the cooler keeps working and the lights are on. (the mouse, the keyboard and the monitor are off) And I can only stop the pc by holding the start button. Plus, now it takes more to load when starting the computer.
What can be the cause?

Here is a picture, if my explanation from the beginning wasn't good enough:

 

[Lutfij]

Mind sharing your full system's specs like so:
CPU:
Motherboard:
Ram:
SSD/HDD:
GPU:
PSU:
Chassis:
OS:

How old is your PSU? You also forgot to mention what your new GPU is and what your prior GPU was.

 

[stefan_destept42]

Mind sharing your full system's specs like so:
CPU:
Motherboard:
Ram:
SSD/HDD:
GPU:
PSU:
Chassis:
OS:

How old is your PSU? You also forgot to mention what your new GPU is and what your prior GPU was.

CPU: AMD A10-7850K APU (2014 D.Ka)
GPU: AMD Radeon R7 Graphics
HDD: WD Blue 1TB (2012)
RAM: Kingston HyperX DDR3 2400 C11 1x8GB
MBD: Gigabyte GA-F2A88XM-D3H
New GPU : Sapphire Radeon RX 560 PULSE 2GB GDDR5 128-bit
PSU : nJoy Titan series 500W (bought about 3 or 4 years ago)
Running on Windows 10
Chassis: Segotep Racing (An older version)
Thermaltake Frio Silent 14 CPU cooler

 

[Lutfij]

That PSU is more of a firecracker than a PSU...change it out ASAP!

 

[stefan_destept42]

That PSU is more of a firecracker than a PSU...change it out ASAP!

BTW, what PSU should I buy? I don't have a lot of money right now and I need a PSU to run for at least 2 years.