If you're talking about the My Music folder that appears in My Documents, you don't want to delete that because it's built-in. If I were you I'd create a folder named Downloaded Music on whichever drive you want to use (other than C). And use that as your download folder.

See my previous reply regarding the Incomplete folder.