randomly
Reviewed, NormalPublic
Actions

Description

Hello,
since update 1.22 HOTFIX 1 our server started crashing sometimes. Its happen once per restart (once every 4h) and only when there were 60+ people on the server.
We did a simple test in the form of a deadmatch event to increase the frequency of kills, respawns, and logouts and the server started crashing every now and then. It always crashes after <LOAD EXISTING CHAR> or <RESPAWN NEW CHAR>, but not always for the same player, it's random.
Thank you very much for help, or at least information on what to look for, we haven't slept for 4 days and we don't know what to do, the server crashes sometimes.

15:32:45.658 Used memory: 5236518 KB
15:32:45.658 Players: 80 in total
15:32:46.580 [CE][VehicleRespawner] (PRIContaminatedArea) :: Initial random enabled for "StaticContaminatedArea" - Chosen nominal: 1
15:32:50.661 Average server FPS: 159.10 (measured interval: 5 s)
15:32:50.661 Used memory: 5236147 KB
15:32:50.661 Players: 80 in total
15:32:55.661 Average server FPS: 166.00 (measured interval: 5 s)
15:32:55.661 Used memory: 5233550 KB
15:32:55.661 Players: 80 in total
15:32:57.708 [StateMachine]: Player NeroCZTV (dpnid 34102405 uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=) Entering DBGetCharacterLoginState
15:32:57.724 [StateMachine]: Player NeroCZTV (dpnid 34102405 uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=) Entering CreateNetObjectsLoginState
15:32:57.739 [StateMachine]: Player NeroCZTV (dpnid 34102405 uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=) Entering PreloadCamLoginState
15:32:57.739 [StateMachine]: Player NeroCZTV (dpnid 34102405 uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=) Entering WaitPreloadCamLoginState
15:33:00.661 Average server FPS: 179.36 (measured interval: 5 s)
15:33:00.661 Used memory: 5232482 KB
15:33:00.661 Players: 80 in total
15:33:05.665 Average server FPS: 160.84 (measured interval: 5 s)
15:33:05.665 Used memory: 5235427 KB
15:33:05.665 Players: 80 in total
15:33:10.665 Average server FPS: 154.14 (measured interval: 5 s)
15:33:10.665 Used memory: 5235215 KB
15:33:10.665 Players: 80 in total
15:33:13.840 [StateMachine]: Player NeroCZTV (dpnid 34102405 uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=) Entering GetLoadedCharLoginState
15:33:13.887 <LOAD EXISTING CHAR>:
    charID 520
    playerID 520
    dpnid 34102405
    uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=
=======================================================
-------------------------------------------------------
Time: 15:33:13
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3
Allocator: system
graphics:  No
resolution:  160x120x32
Addons:

18:50:29.504 Players: 90 in total
18:50:30.192 [Disconnect]: Remove player info 806161295
18:50:30.207 [Disconnect]: Player destroy 806161295 
18:50:30.223 [LoginMachine]: Add player [CC]Comppa (37262329 88.212.43.249:2554)
18:50:30.223 [StateMachine]: Player [CC]Comppa (dpnid 37262329 uid ) Entering AuthPlayerLoginState
18:50:30.692 [StateMachine]: Player [CC]Comppa (dpnid 37262329 uid ) Entering WaitAuthPlayerLoginState
18:50:31.254 [Disconnect]: Finish script disconnect -1 (oKqmnXo6SI6T4-QCTGL5bpXZZxwVJv4iaxlYQ0sXxTg=)
18:50:33.102 Player [CC]Comppa connected (id=BwgK2d2gmk2PiYeNrKG7wdLDG4J-PV4Gfn42is0h3dI=).
18:50:33.102 Player "[CC]Comppa" is connected (steamID=76561198803227183)
18:50:33.102 [StateMachine]: Player [CC]Comppa (dpnid 37262329 uid ) Entering WaitPlayerAssignedLoginState
18:50:33.134 [CE][VehicleRespawner] (PRIContaminatedArea) :: Initial random enabled for "StaticContaminatedArea" - Chosen nominal: 0
18:50:34.221 [StateMachine]: Player [CC]Comppa (dpnid 37262329 uid BwgK2d2gmk2PiYeNrKG7wdLDG4J-PV4Gfn42is0h3dI=) Entering DBGetLoginTimeLoginState
18:50:34.221 [StateMachine]: Player [CC]Comppa (dpnid 37262329 uid BwgK2d2gmk2PiYeNrKG7wdLDG4J-PV4Gfn42is0h3dI=) Entering DBWaitLoginTimeLoginState
18:50:34.503 Average server FPS: 280.89 (measured interval: 5 s)
18:50:34.503 Used memory: 5268530 KB
18:50:34.503 Players: 90 in total
18:50:39.519 Average server FPS: 312.69 (measured interval: 5 s)
18:50:39.519 Used memory: 5269590 KB
18:50:39.519 Players: 90 in total
18:50:41.555 [StateMachine]: Player Nagato (dpnid 32929643 uid Zhd8265TsaA9BqkY_J9AKraehkfqSwLdnF67JR0-Jlo=) Entering GetLoadedCharLoginState
18:50:41.601 <LOAD EXISTING CHAR>:
    charID 617
    playerID 617
    dpnid 32929643
    uid Zhd8265TsaA9BqkY_J9AKraehkfqSwLdnF67JR0-Jlo=
=======================================================
-------------------------------------------------------
Time: 18:50:42
Exception code: C0000005 ACCESS_VIOLATION at D0E9D6C7
Allocator: system
graphics:  No
resolution:  160x120x32
Addons:

23:14:20.983 [CE][VehicleRespawner] (PRIContaminatedArea) :: Initial random enabled for "StaticContaminatedArea" - Chosen nominal: 0
23:14:21.899 Average server FPS: 500.00 (measured interval: 5 s)
23:14:21.899 Used memory: 5176764 KB
23:14:21.899 Players: 86 in total
23:14:26.905 Average server FPS: 469.11 (measured interval: 5 s)
23:14:26.905 Used memory: 5175878 KB
23:14:26.905 Players: 86 in total
23:14:31.901 Average server FPS: 515.40 (measured interval: 5 s)
23:14:31.901 Used memory: 5170179 KB
23:14:31.901 Players: 86 in total
23:14:36.908 Average server FPS: 453.04 (measured interval: 5 s)
23:14:36.908 Used memory: 5171507 KB
23:14:36.908 Players: 86 in total
23:14:41.906 Average server FPS: 483.00 (measured interval: 5 s)
23:14:41.906 Used memory: 5173516 KB
23:14:41.906 Players: 86 in total
23:14:46.910 Average server FPS: 525.89 (measured interval: 5 s)
23:14:46.910 Used memory: 5173073 KB
23:14:46.910 Players: 86 in total
23:14:51.907 Average server FPS: 470.00 (measured interval: 5 s)
23:14:51.907 Used memory: 5176133 KB
23:14:51.907 Players: 86 in total
23:14:54.632 [StateMachine]: Player Bazzy_CZ (dpnid 98620335 uid a_9Fp7rzFNeK9mEPPmFpirm0xzlYdn0-XyQQI8-VEtg=) Entering GetLoadedCharLoginState
23:14:54.710 <LOAD EXISTING CHAR>:
    charID 581
    playerID 581
    dpnid 98620335
    uid a_9Fp7rzFNeK9mEPPmFpirm0xzlYdn0-XyQQI8-VEtg=
=======================================================
-------------------------------------------------------
Time: 23:14:54
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3
Allocator: system
graphics:  No
resolution:  160x120x32
Addons:

there are many more logs, it's since the update 1.22 HOTFIX 1, but it's still the same thing, crash in <LOAD EXISTING CHAR> or <RESPAWN NEW CHAR>, so I won't spam all logs here

Details

Severity: Crash
Resolution: Open
Reproducibility: Random
Operating System: Windows 10 x64
Category: Server

Related Objects

Duplicates Merged Here: T178133: Crash with high online

Event Timeline

5treet created this task.Sep 12 2023, 7:11 PM

Hello 5treet.
Please upload the .mdmp files from the crash occurrences as we require these to analyse the cause of the problem.

Thank you so much for helping me, we are really helpless.
Here I send all .mdmp from all crashes.

DayZServer_x64_2023-09-11_16-00-13_2023-09-11_18-50-42.mdmp6 MBDownload

DayZServer_x64_2023-09-08_16-00-13_2023-09-08_19-10-38.mdmp6 MBDownload

DayZServer_x64_2023-09-09_16-00-12_2023-09-09_19-43-18.mdmp6 MBDownload

DayZServer_x64_2023-09-11_20-35-07_2023-09-11_20-51-18.mdmp6 MBDownload

DayZServer_x64_2023-09-09_20-00-12_2023-09-09_23-35-55.mdmp6 MBDownload

DayZServer_x64_2023-09-10_12-00-12_2023-09-10_15-33-13.mdmp6 MBDownload

DayZServer_x64_2023-09-11_20-51-31_2023-09-11_21-06-20.mdmp6 MBDownload

DayZServer_x64_2023-09-11_19-00-13_2023-09-11_20-34-56.mdmp6 MBDownload

DayZServer_x64_2023-09-08_20-00-12_2023-09-08_23-14-54.mdmp6 MBDownload

DayZServer_x64_2023-09-12_16-00-13_2023-09-12_18-51-12.mdmp6 MBDownload

DayZServer_x64_2023-09-12_19-00-14_2023-09-12_20-37-09.mdmp6 MBDownload

Every server crash always when loading a character or respawn (<LOAD EXISTING CHAR> or <RESPAWN NEW CHAR>), but completely random, and only after some time of these events, he doesn't do it all the time.
Those players who did it, after the crash normally connected, played, died, respawned completely without any other problem, no crash repeated for the same player.
Thank you very much for more information on what to look for.
Have a nice day.

19:10:37.386 Players: 70 in total
19:10:38.714 [StateMachine]: Player MarysCZE (dpnid 100367026 uid BkrvC2MeDCpmZZlKLy8-ExR1VDfML3DCa2MCnpwWDVw=) Entering GetLoadedCharLoginState
19:10:38.730 <LOAD EXISTING CHAR>:
    charID 277
    playerID 277
    dpnid 100367026
    uid BkrvC2MeDCpmZZlKLy8-ExR1VDfML3DCa2MCnpwWDVw=
=======================================================
-------------------------------------------------------
Time: 19:10:38
Exception code: C0000005 ACCESS_VIOLATION at D109105D

20:37:06.167 Players: 88 in total
20:37:09.26 [StateMachine]: Player Hekor (dpnid 632987655 uid ZJCDlYZROdlsxrwHcOuvYmlZ1I1VFfUu7ib4lSX873g=) Entering GetLoadedCharLoginState
20:37:09.73 <LOAD EXISTING CHAR>:
    charID 85
    playerID 85
    dpnid 632987655
    uid ZJCDlYZROdlsxrwHcOuvYmlZ1I1VFfUu7ib4lSX873g=
=======================================================
-------------------------------------------------------
Time: 20:37:09
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

18:51:11.419 Players: 76 in total
18:51:12.747 [StateMachine]: Player Jojin (dpnid 27825368 uid eVTGd-zzAl2WT9xTyrDvdl3fg1LOrPSPw9LUS9gjG6o=) Entering GetNewCharLoginState
18:51:12.778 <CREATE NEW CHAR>:
    charID 713
    playerID 713
    dpnid 27825368
    uid eVTGd-zzAl2WT9xTyrDvdl3fg1LOrPSPw9LUS9gjG6o=
=======================================================
-------------------------------------------------------
Time: 18:51:12
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

21:06:16.896 Players: 87 in total
21:06:17.646 [Disconnect]: Start script disconnect 451353811 (dbCharacterId 235 dbPlayerId 235) logoutTime 15
21:06:19.982 [StateMachine]: Player [bRn] pospekin0   (dpnid 918246373 uid ) Entering GetNewCharRespawnState
21:06:20.13 <RESPAWN NEW CHAR>:
    charID 28
    playerID 28
    dpnid 918246373
    uid uuwFSp708_DT0ayb_OVCmFteglEW-gLu8Llsm1_Afyo=
=======================================================
-------------------------------------------------------
Time: 21:06:20
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

20:51:17.839 Players: 89 in total
20:51:18.605 [StateMachine]: Player [bRn] SoulStealer (dpnid 20411462 uid ) Entering GetNewCharRespawnState
20:51:18.621 <RESPAWN NEW CHAR>:
    charID 6
    playerID 6
    dpnid 20411462
    uid oKqmnXo6SI6T4-QCTGL5bpXZZxwVJv4iaxlYQ0sXxTg=
=======================================================
-------------------------------------------------------
Time: 20:51:18
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

19:43:16.248 Players: 76 in total
19:43:17.541 [CE][VehicleRespawner] (PRIContaminatedArea) :: Initial random enabled for "StaticContaminatedArea" - Chosen nominal: 0
19:43:18.598 [StateMachine]: Player Sutr (dpnid 37022809 uid aFiqr_VDpMa1QR4ODJZLjWopm04U5ebLevdFjHBDmxo=) Entering GetLoadedCharLoginState
19:43:18.629 <LOAD EXISTING CHAR>:
    charID 209
    playerID 209
    dpnid 37022809
    uid aFiqr_VDpMa1QR4ODJZLjWopm04U5ebLevdFjHBDmxo=
=======================================================
-------------------------------------------------------
Time: 19:43:18
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

20:34:55.499 Players: 90 in total
20:34:56.548 [StateMachine]: Player janosik (dpnid 78678579 uid ) Entering GetNewCharRespawnState
20:34:56.579 <RESPAWN NEW CHAR>:
    charID 504
    playerID 504
    dpnid 78678579
    uid UmjCq0rMMAJ3bK84m2OlQzenGTQ_XBO-Bgl-zMplpOs=
=======================================================
-------------------------------------------------------
Time: 20:34:56
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

23:14:51.907 Players: 86 in total
23:14:54.632 [StateMachine]: Player Bazzy_CZ (dpnid 98620335 uid a_9Fp7rzFNeK9mEPPmFpirm0xzlYdn0-XyQQI8-VEtg=) Entering GetLoadedCharLoginState
23:14:54.710 <LOAD EXISTING CHAR>:
    charID 581
    playerID 581
    dpnid 98620335
    uid a_9Fp7rzFNeK9mEPPmFpirm0xzlYdn0-XyQQI8-VEtg=
=======================================================
-------------------------------------------------------
Time: 23:14:54
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

18:50:39.519 Players: 90 in total
18:50:41.555 [StateMachine]: Player Nagato (dpnid 32929643 uid Zhd8265TsaA9BqkY_J9AKraehkfqSwLdnF67JR0-Jlo=) Entering GetLoadedCharLoginState
18:50:41.601 <LOAD EXISTING CHAR>:
    charID 617
    playerID 617
    dpnid 32929643
    uid Zhd8265TsaA9BqkY_J9AKraehkfqSwLdnF67JR0-Jlo=
=======================================================
-------------------------------------------------------
Time: 18:50:42
Exception code: C0000005 ACCESS_VIOLATION at D0E9D6C7

15:33:10.665 Players: 80 in total
15:33:13.840 [StateMachine]: Player NeroCZTV (dpnid 34102405 uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=) Entering GetLoadedCharLoginState
15:33:13.887 <LOAD EXISTING CHAR>:
    charID 520
    playerID 520
    dpnid 34102405
    uid YM4Un8-_u90_R5Ic8-5sX5czCYUfkjUoJSHkKF3g_O8=
=======================================================
-------------------------------------------------------
Time: 15:33:13
Exception code: C0000005 ACCESS_VIOLATION at D0E9D5E3

23:35:50.565 Players: 68 in total
23:35:55.159 [StateMachine]: Player Krysak (dpnid 297834487 uid R1RsZ09BlGPW9Ta8JIjpeYptrqPSZn5Nq27QBXxn9S8=) Entering GetLoadedCharLoginState
23:35:55.223 <LOAD EXISTING CHAR>:
    charID 131
    playerID 131
    dpnid 297834487
    uid R1RsZ09BlGPW9Ta8JIjpeYptrqPSZn5Nq27QBXxn9S8=
=======================================================
-------------------------------------------------------
Time: 23:35:55
Exception code: C0000005 ACCESS_VIOLATION at D0E9D71B

Hello again.
This appears to be caused by some mod you are running. Unfortunately we cannot tell which mod is it besides that it crashes on HeadingModel.
The mod creator will have to fix the problem on their end.

Hello,
thank you for trying to find some leads.
Is it possible to at least give us a little more information about HeadingModel?
If it changed after the update to 1.22 or 1.22 HOTFIX 1 ?
Or something a little more specific so we know which mod to focus on, roughly what to remove, or who to contact next?
Any clue as to what HeadingModel is in charge of, or what it handles, anything we can pick up on further.

Thank you for your time and have a good day.

In T175429#2498878, @5treet wrote:

Hello,
thank you for trying to find some leads.
Is it possible to at least give us a little more information about HeadingModel?
If it changed after the update to 1.22 or 1.22 HOTFIX 1 ?
Or something a little more specific so we know which mod to focus on, roughly what to remove, or who to contact next?
Any clue as to what HeadingModel is in charge of, or what it handles, anything we can pick up on further.

Thank you for your time and have a good day.

Unfortunately this is all the available info we have at the moment.
Regards,
Geez

So is this some function or code in some mod and crashes the server when it runs this function?
I understand you don't have more information and thank you for that information as well, but we just need to know what HeadingModel is, if it is code in some mod that we could look for, or what it actually is.
Thank you for your time.

xscr33m added a subscriber: xscr33m.Sep 13 2023, 6:57 PM

I can tell this might but not must be releated to how items animations are registered in some mods. If they are registered in PlayerBase class - expect LOAD EXISTING CHAR crashes, because such registration was a workaround years ago and some modmakers here and there sometimes take this as a reference.

In T175429#2499255, @Moonny wrote:

I can tell this might but not must be releated to how items animations are registered in some mods. If they are registered in PlayerBase class - expect LOAD EXISTING CHAR crashes, because such registration was a workaround years ago and some modmakers here and there sometimes take this as a reference.

Hello,
I found a mod that registers the object animation in PlayerBase, as you mention, so is this a problem? Is it possible that the crashes are caused by this? We never had crashes in <LOAD EXISTING CHAR> <RESPAWN NEW CHAR> before 1.22 HOTFIX 1 from BI. And we use this item before 1.22, is possible to crash apear right now?

modded class PlayerBase extends ManBase
{
    override void Init()
    {
        if ( !GetGame().IsServer() || !GetGame().IsMultiplayer() )
        {
            DayzPlayerItemBehaviorCfg fireArmsItemBehaviour = new DayzPlayerItemBehaviorCfg;
            fireArmsItemBehaviour.SetFirearms();
			
	    DayzPlayerItemBehaviorCfg     toolsOneHanded = new DayzPlayerItemBehaviorCfg;
            toolsOneHanded.SetToolsOneHanded();

            DayzPlayerItemBehaviorCfg     twoHanded = new DayzPlayerItemBehaviorCfg;
            twoHanded.SetTwoHanded();

	    GetDayZPlayerType().AddItemInHandsProfileIK("Custom_Item_apple", "dz/anims/workspaces/player/player_main/player_main_1h.asi", toolsOneHanded, "dz/anims/anm/player/ik/gear/apple.anm");

	}
        super.Init();
    }
}

In T175429#2499276, @5treet wrote:
Hello,
I found a mod that registers the object animation in PlayerBase, as you mention, so is this a problem? Is it possible that the crashes are caused by this? We never had crashes in <LOAD EXISTING CHAR> <RESPAWN NEW CHAR> before 1.22 HOTFIX 1 from BI. And we use this item before 1.22, is possible to crash apear right now?
modded class PlayerBase extends ManBase
{
    override void Init()
    {
        if ( !GetGame().IsServer() || !GetGame().IsMultiplayer() )
        {
            DayzPlayerItemBehaviorCfg fireArmsItemBehaviour = new DayzPlayerItemBehaviorCfg;
            fireArmsItemBehaviour.SetFirearms();
			
	    DayzPlayerItemBehaviorCfg     toolsOneHanded = new DayzPlayerItemBehaviorCfg;
            toolsOneHanded.SetToolsOneHanded();

            DayzPlayerItemBehaviorCfg     twoHanded = new DayzPlayerItemBehaviorCfg;
            twoHanded.SetTwoHanded();

	    GetDayZPlayerType().AddItemInHandsProfileIK("Custom_Item_apple", "dz/anims/workspaces/player/player_main/player_main_1h.asi", toolsOneHanded, "dz/anims/anm/player/ik/gear/apple.anm");

	}
        super.Init();
    }
}

Yes, whenever you see anims being registered in PlayerBase - you can be sure it is done wrong.
If this is your mod you should change this to be registered via proper method (I am sure you'll easely find examples in other mods): JM's method or (suggested) a vanilla one.

If this is not your mod you can use PREFIX file to properly override content of the folder where the file is located (this will also override all subfolder so you would need to copypaste all content to your fixed mod) or you can try using delete preprocessor command in config.cpp to completly remove 4_World of that "broken" mod and reupload all of its content. There may be other ways of fixing this, but I've never even used mentioned ones so... Good luck with that and hope this will fix an issue.

Thank you very much sir, it's my mod so I've fixed it as follows (see below) and I'll keep track of the changes.
Anyway, we have had the mod on serever for half a year now and it has never been a problem.
Whether this will help the crashes or not, thanks for the message.
Have a nice day.

modded class ModItemRegisterCallbacks
{
	override void RegisterOneHanded(DayZPlayerType pType, DayzPlayerItemBehaviorCfg pBehavior)
	{
		super.RegisterOneHanded( pType, pBehavior );
		pType.AddItemInHandsProfileIK("Custom_Item_apple", "dz/anims/workspaces/player/player_main/player_main_1h.asi", pBehavior,"dz/anims/anm/player/ik/gear/apple.anm");
	}
};

Hello street im getting this issue

would you reach out to me on discord please i have a coiuple of quesitons for u

joby_.

Hello, i send you reguest for friend, solved for me, when i deleted mods with bad animation registration on playerbase.

Geez merged a task: T178133: Crash with high online.Jan 17 2024, 10:26 AM

Geez added a subscriber: daddy_bjorn.

Server crash in action <LOAD EXISTING CHAR> <RESPAWN NEW CHAR> randomlyReviewed, NormalPublicActions

Description

Details

Related Objects

Event Timeline

Server crash in action <LOAD EXISTING CHAR> <RESPAWN NEW CHAR> randomly
Reviewed, NormalPublic
Actions