Punching or jumping fixes the problem.

When laying your back it works perfectly fine, it seems to be only when you're laying on your stomach.

Update: It also happens if you take it out of a belt sheath.