WARNING: Stupid comment, this will probably not help you.

It would be cool to pipe through SSH.
Would it be OK if people knew your IP addresses, but after that everyone would need to know a "master" password to get on to your "group"?
How about having a central server?
Why not just set up a secure web server or FTP server that needs a password to log in and share files?