Try enabling hidden files. Go to Start-->Control Panel-->Folder Options-->View Now scroll down to where it says "show hidden files and folders" and select that, then press OK.

IF that doesn't work either, then the album art is somehow embedded in the music files and I have no idea how to make them show on the folder.