Very annoying issue.
But it don't do it with the M4 if you have the coupled 60 clips only, then only the Reload button works (R) and only after you fired a round or two, this how it should work for all mags.