Is it actually taking up too much bandwidth or just looking unwieldy with all of the connections? When you have that many connections you are now an ultrapeer to other hosts. This helps them out like you were helped out when connected to three ultrapeers initially.

If you still want to turn it off, it's in Options:Speed, disable ultrapeer.