Popup icons don't go away immediately when you are no longer in charge of a given character