This was a issue in the Alpha, 1 year ago.
Now with the newest PERF4, this has come back, we are 30-40 people and 3-4 of us have this problem with the newest PERF4, however, if we revert back, to older version there is no problem.
So whatever you introduced to the newest performance patch for the server, revert it before you put it to stable.