I've just heard of people having panics while trying to empty trash, maybe due to file sizes, etc. The apple discussions board has documentation on the subject.

At the least, I would do an fsck and a permissions check/repair to see if anything turns up amiss.

Otherwise, if all other actions are normal, and it only happens when trashing some files, I wouldn't be too worried.