As the title says, a AR-2 Darter can fly through unbroken windows, they just pass through them, that is only on windows that are destructible and a player can pass through them (for example the Office Building).
I haven't tested on other quad copters but it should still fly through windows.

Also, they can fly through broken and not broken windows.