Your router isn't just for Wi-Fi—here's everything a network switch actually fixes ...
I have a router here at home and that's what I use to share internet access among all of the computers. I just configure the router, plug the DSL modem in it, uplink it to a switch for expandability ...