I found if you minimize the Search section on the left using the small arrows on the upper left, the clear inactive button will come back.