Visibility filters won't close when clicking filters button

I was expecting that clicking the above sucker would close the filters UI. It looks like it closes on click but opens back up when I release the mouse button.

It closed fine when I clicked off in to the world but it wasn't the behavior I was expecting.