Sometimes when you see that error it's just because Explorer needs a refresh of
the screen. Hit F5 and see if the name disappears from view.

Sometimes, rarely, you need to scan the disk for errors because the file name
wasn't removed from the folder at the same time as the file was deleted.