I disabled windows defender and slideshow of images on desktop and the problem got fixed.
Now if I reenable them, it doesn't affect my fps.
This is the strangest problem ever I encountered, it just solved itself alone.
Also the process which was causing the fps problem is: Windows Explorer.exe