Fixed it. Under the alternative method of looking up in the control settings, you have something like 'right thumbstick up'. Just delete that binding.