I solve the issue for me at least, I had some bean cans in my backpack with bad textures and when I removed them it stopped lagging. My friend had the same issue when he was near me but after I dumped the bad cans everything went back to normal but I guess it will start freezing again as soon as we encounter other players with the bad items.
Sooo check your equipment for flickering or white textures and if you or your friends has some bad items just dump them in the forest or in case of cans just open them with a can opener and the textures will reset.
Hope it helps