I found this reddit post, which more or less describes the same problem that I have,
View: https://www.reddit.com/r/pcmasterrace/comments/uez7gl/psa_if_your_gigabyte_motherboard_buzzes_like_this/
But this "faxing" \ buzzing noise appears in my system only on idle (less than CPU VCORE 1.2 V)...