Try rebooting in safe mode & see if the shortcuts delete.
Getting into Windows Safe Mode

Otherwise, try one of the tools here (I've used both Unlocker & DelinVfile).
Incomplete Download File won't delete at all.

Does your computer seem to be running normally? It might not be a bad idea to update your AV & scan your computer...just to make sure you haven't picked up some malware.