That's how Limewire is supposed to work. It will only make you an UltraPeer if it's in need of more UltraPeers.

UltraPeers take extra strain of the network by more traffic routed through fast connections and shielding the slower ones. It helps the network, but if you don't wan't to use the extra bandwidth then check the "Dissable...." box.