Yes, it is only used to install the program, which then sits in its own folder in Program Files. However, if you're in doubt, throw it away but don't emtpy the recycling. Files in the recycling bin cannot be used, and if the .exe file is necessary, just restore it.

Dan