I have two rifles when logging back in after having logged out with an extra gun in hand (in addition to one on my back) - the gun that was in hands when logging out appears in a separate slot (below the backpack slot) when you log back in. However if you start equipping/unequipping any items it will drop to ground.