Yeah, you can destroy lights, but it takes ridiculous amounts of bullets. And explosion do not seem to hurt the lights at all. I tried putting a barrage of missiles into a streetlight - the buildings around it were destroyed, but the light remained.