check all the movable parts... cpu fan, gpu fan, psu fan, psu itself (even though its not movable, its a transformator, can whine a buzz), hard drives, optical drives...
its likely the psu...
lol, you can even unplug the system\BIOS speaker... lol jk