How to install LED in PC case

Solution
Yup, you do.
You may need a molex to 3 pin converter, or molex to 6 pin if you don't have a molex cable that came bundled with your power supply.
You can typically pick one of these up for very cheap from any local PC retailer.