Can reproduce this, the uncontrollable movement can sometimes last around 10s or more.
Workaround: Disabling TrackIR (default F9) and reenabling it when you lose control. Obviously this work around is not very viable in combat