At the top of the inventory there is an up/down arrow to display the state of that piece of clothing (if its contents are being displayed or not.)
You can open/close the clothing by clicking on the arrow itself, and its state will be updated correctly - however, you can also close that clothing by clicking on the X to the right of the inventory slots.
When you close a piece of clothing via this X, the visual of the arrow is not updated (it is updating correctly in the background however, as you only need to click once to bring it back - but visually it does not change)
In the first 10 seconds of this video I am clicking the arrow directly and everything is working as intended, however notice how when I click on the X instead, the arrow icon next to my plate carrier does not change, even though the inventory slots are gone.