I've GTX970 and the fps drop is huge.

What's is more interesting that having higher shadow view distance actually is much better than having it lower. AtoC is also one of the biggest fps dropper in that situation. Notice how the texture quality itself doesn't really make any difference in the performance.