See if your custom keyboard exhibits the same issue on a donor system/laptop or systems/laptops. If not then you've ruled out the problem to be on your initial desktop. If the issue is found on other systems, you might want to look at how you've soldered on the switches and the quality of your soldering job.
What switches did you use? Also, did you lubricate the switches?