Once player has acquired a "heat buff" (1,2, or 3 "+"), it will then start to drop over time.
Provided the heat buff has not been totally lost (i.e. at least 1 "+), if the player then carries a lit torch, the temperature will increase back to whatever the maximum buff was originally.
This will also occur in the most inclement of weather (blizzards).