I agree with this sentiment, but I think the solution is to make the hardest difficulty mode (in our case, Veteran) force first person only.
You can't expect the casual crowd or even some of the realism crowd to accept the difficulty of first person only.