If you delete the song while in the lW library it is gone from your pc. If you delete it outside of LW by finding the file on your hd it will go to the recycle bin.
Alot of people post that they deleted their whole library (by accident) and can't get it back.
For a little more info. Check out this post:
recover deleted files?