I'm not so sure. I mainly notice this when there's only one host in the group. I'll try and download a search result, the download starts, waits a few seconds and is then marked as failed. I've never seen a download start after that.

I can see the value of not waiting before trying other hosts, but are you sure there isn't a problem when there's actually no other hosts in the list to try for that download? Does it know it has to hang on for a bit before giving up entirely?