Confirming this as well. The lantern works when you first pick it up but leaving and rejoining the server (or another) then causes it to stop working.

This is the same case with:
All sizes of gas canister,
Leaving the lantern on or off when leaving,
Having a gas canister connected or not when leaving.