When a player climbs up/down a ladder, it's impossible for him to be impeded by any player-built structures for the duration that he is in the ladder animation. Players can walk right through filled HESCO boxes.