I think it is designed to be this way.

When you connect to an Ultranode, you automaticly drop all other connections, since they are not needed.

Now, the ultranode you connected to, was probably confgiured to connect to only 3 other hosts.

I do not think this has anything to do with how many Ultranodes are out there.