Unless you have a really fast connection, you might want to reduce your number of upload slots a little! I have 3 open (2 uploads per person) with a T1 connection, means that people can get uploads of 10-15 KB/s.
It's up to you though, but I think 20 is too many. If you're not firewalled & your incoming is true then I don't know why you're not seeing uploads