Well, think about it: If you're downloading from 20 people, you're downloading 20 seperate segments. As segments complete, you're going to lose connection to those machines - leaving the slower ones to complete last (though your machine might be trying to further segment the remaining portion and re-connect to some of those fast connections). So, it's perfectly normal.