Why can't I browse so many of the people uploading from me? Isn't that the whole point of p2p?

If there's nothing I can do to be able to browse their files, is there any way I can ban them permanently from browsing mine?