All apps in OS X don't close when you click the big red button. It's quicker to keep it open then if you want it again go and open a new window. And when they have no windows open they don't take much CPU power or RAM. If you want to quit the App there's plenty of ways. Apple-Q. File>Quit