If its not obvious like holding a torch then it would be a setting/situation specific thing. Some ancestries would logically have higher or lower body temp. Of course activity might alter this. If the party had just trekked to the dungeon it would probably be the lowest CON character who is sweating the most.
Other than that I'd just roll to determine it.