There are several ways of limiting people - you can restrict people to one slot at a time:

Options|Uploads|slots

If you increase the maximum number of people who can download from you but limit your upstream bandwidth:

Options|Uploads|Basic

then you shouldn't need to kick anyone off - as many people will use your connection as is room for - with the first change, each person only gets one slot.

Mark