I'm not a windows user (like a tropic islander telling an eskimo how to keep cool.) Next time LW starts, go to LW's menu Tools>Options>Connections & untick option to connect on startup. Press Apply & OK buttons. As for deleting the app, I'm not too sure. I guess you could repair LimeWire using the Add/Remove Programs utility & try again. Else try:
http://support.microsoft.com/default.aspx?kbid=290301 Add/Remove programs is the normal way to do it!