Since it stays in place by wedging itself between the motherboard and case, if you pressed it in, on the outside of the case, it will fall out and none of your ports will line up. Since that is the first thing you do with a case, you should correct it before going any further in assembly.