Defrag is completely irrelevant to SSD. It seems that you know not to defrag the SSD itself because that will just put wear on it for no reason, but even a nice defragged image restored to it will make no difference.
That said, there are a few things that can cause an SSD to slow down. The most common is that it is either nearly full or / and TRIM was not enabled. May I ask
) What version of OS are you running?
) Was is initially installed to that SSD or cloned from an HD installation?
) What motherboard are you using or, if a pre-built system, the make and model?
) In the BIOS, is the hard drive controller set to AHCI or IDE mode?
And there's always the last resort - but if you don't have proper TRIM or the drive is full, it will just slow down again some time after doing this.
1) Do an image backup to an external HDD.
2) Test the heck out of that backup. Your system's survival will depend on it.
3) Do a Secure Erase of the SSD. This will reset it to factory condition.
4) Restore the image backup to the SSD.
This process is equivalent to a full-disk TRIM. Now, there are members who will disagree with me, some strongly and nastily, and say that Garbage Collection will take care of things even if TRIM is not enabled. If they are right, then I am wrong. You pays your money and takes your chances.
EDIT: Slowed down how much? It would have to be pretty extreme, or the load that you put on it pretty intense, to notice a significant difference.