When you use the Rangefinder (or Binoculars) in prone position the sway is much harder to control than in crouch or standing up positions, I dont know if this is intended or minor bug.

Edit: As of 1.18 Stable I can confirm the problem besides ocurring with Rangefinder also exists with the binoculars