What player are you using? - the only time I've experienced anything like you're describing is the times I've tried using the Limewire player - I use Jet Audio from www.cowon.com and never have problems (the new Winamp is also prety good)

Cheers, bad_vlad