Doesn't look like it's installed upside down, but something is very wrong if you can only line up two holes as the ILM is connected with 4 and those holes should match up exactly.
Looking at the top left hole does it look grey in there like the color of the bracket itself, not the brown motherboard color. Is the hole puched through as it should be? Like can you look through it when having the bracket in your hands.