This is a huge issue, and it should be changed so that everyone has the same amount of zoom no matter their FOV settings.

The "trade off" argument is very poor in this case, since you already have even trade offs with high and low FOV settings. Low FOV users see further and high FOV users have more peripheral vision.

Having same level of zoom for everyone would make the most even playing field for everyone.