I have the same issue, it is really annoying. Also if you change your graphics while in the server the issue is fixed for a couple of minutes then it comes back again.