Normally when you open the pause menu via ESC, the game changes focus to the open menu and disables all controls in the background.
Currently, that's not the case, as you can still move the character via mouse movement and keyboard input.