After dropping the gun for good and saying goodbyes to it, I realized that the gun as a "physical" object actually does NOT have a magazine attached even though the inventory representation (even while on ground) does indicate there being one.

There's actually four watchtowers around the perimeter there that are placed too low into the ground so that you cannot climb down enough to exit the ladder.