Just happened to me, character shouldn't step forward to go down ladder. Should probably just teleport onto the ladder if you're close enough to scroll wheel the climb down option.