Who is your internet service provider?
What brand & model of modem/router do you have?
Try downlding just a single file from here:
http://www.magnetmix.com/video.shtml
Make sure you're only downlding one file at the time (pause others if necessary.) And tell us what happens. Does the speed remain consistent? Do you lose connection?