Rebinding the move forward key from W to E as part of an ESDF layout makes the E key unable to move the character forward while aiming down sights.
For some reason it works with other keys, I briefly just checked F2 as forward button which works fine.