Exactly. That's what it seems to be. Again, this is actual experience, not just me theorizing. And if that's the case, more ultrapeers means less upload bandwidth available in the network.

This could be an isolated exceptional case, but it seems unlikely. I'm on a completely average, normal cable connection.