The router model no. is: BEFSR41

I thought about the ethernet connection, but we both only have one ethernet port. So I don't see how we could connect to each other directly and use only one computer's internet connection.

Does it exist an ethernet port splitter like you would use for tv cables?

Could it be just a matter of compatibility between macs and pcs?