I had similar problems and someone told me to turn off iTunes support and disable ultrapeer.

I did this and it helped massively. At the same time I set up so that they cleared on completion, but I couldn't tell you exactly which of these things made the diifference...

Hope that helps

Ben