Happened to me too. I mostly just hear the sounds, but have suffered the occasional thumping. Running away doesn't seem to work, nor does swinging wild with melee weapons. Maybe they glitch through the floor...?