Was it working before you took the hard drive out?
If you have a USB drive somewhere, try this I found this solution online:
Find a usb drive that is larger than 168 MB and format that to FAT32.
2. A computer.
3. Download the newest firmware from the computer (2).
4. Go inside the usb drive and make a new folder which you call PS3, and under that you make another which you name UPDATE. Under that folder is where you keep the firmware (3).
5. Plug the usb drive into the ps3 and power it.
6. Now it will read that you need to press select and start at the same time, but it should be easy from here.