Heya, the XP points are for the character’s level, not the skill level! With each character level you can upgrade one skill point. I can definitely see how the wording might be confusing - I will try to change that in the next update! Thank you!
