That can happen when downloading from busy or unreliable sources.
See what speeds you get from a reliable host (like the one set up by LimeWire at
http://www.magnetmix.com/audio2.shtml )
The magnetmix server was a bit slow tonight, but should be fast enough to check out your download speeds and compare with this: