Offline installer version is always recommended. Not sure why you can't remove it. But it does sound like there must have been a problem with the original installation of it. So yes, I guess install over the top. A utility to cleanup the registry is this free one http://www.ccleaner.com/