Verify: you are indeed using Windows Workgroup? Or did you just mean that the computers are all on the same network?
You need to take a careful methodical approach to getting it all sorted out and back in operational order. Especially if routers have been reset or otherwise reconfigured.
Twofold approach:
1) Figure out and understand how your network is currently set up/configured.
2) Reconfigure each device, one at a time, as necessary, to get it back into service.
Sketch out a network diagram showing all of your connected devices.
On the diagram list each device or computer name, IP addresss, and subnet mask. Use "ipconfig /all" on each computer to get that information. You may find some things are not as you expect.
Get a big picture view of your network so you can see what is what.
Be certain that only one router is providing DHCP IP addresses. And that any assigned static IP addresses are outside of the available DHCP IP address range and that the static IP is reserved on the router via the device MAC for that device.
Make a simple checklist of what needs to be accomplished on each computer - does not need to be perfect the first time around and you may realize on the 3rd of 4th system that something was overlooked on the first two. Evolve the process as needed.
Disconnect all but one computer and (using the checklist) work to get the computer configured first for network access, workgroup membership, and internet as applicable.
Be careful and methodical. Pay close attention to any error messages or pop-up windows. Some of them may not be all that helpful but they still can provide some clue as to what has or is going astray.