I can't imagine you'll get much of a benefit from 32 GB of RAM unless you're doing workstation tasks. Stop at 16 GB if not.
The rest of the upgrades aren't likely to happen unless you have a very unusual AIO. AIO's are essentially awkward laptops, not desktops, and if you're using SODIMM, you don't appear to have one of the
rare exceptions.
Here's an image of a motherboard from a Dell AIO with an i5-6500 (you didn't provide your exact model).
Like most AIOs, there's something crucial missing: a PCI-Express slot. You'll also run into problems upgrading the power supply, but if you can't upgrade the GPU, then a PSU upgrade likely isn't needed.
If you're going to actually upgrade this PC, you need to buy a proper motherboard, case, power supply, and RAM that's appropriate for a desktop, and then move the CPU into it. Or sell the i5-6500 and build on a more modern platform.
Unfortunately, AIOs are terrible purchases for upgrading. You pretty much use them until they become too slow and then they go off to the recycling center. Companies like selling these because they're essentially expensive, disposable computers.
Now, if your performance has gotten
worse, it's likely you would get a lot of benefit from just doing a full wipe and reinstall of Windows. PCs don't really "wear" in this manner, so if the same software used in the same way runs worse now than before, it's likely there's just something else going on.