That's fine for steel. You should start worrying about it flexing too much when you can't get the side panel on because it's bulging too far out.
The only thing really to worry about is the cables underneath, rather than the actual panel. Make sure you don't have them pressed hard up against a sharp edge of the motherboard tray or anything.