You can try turning on ICS (internet connection sharing) on your computer. I've never used this so I don't know if more than 2 PC's can share the internet. Your best bet is to get a router.
You didn't mention your OS, but here is ICS on vista.
http://windows.microsoft.com/en-US/windows-vista/Using-ICS-Internet-Connection-Sharing