This may be just because I'm bad, but I think the game is straight up a luck based game on certain maps. If you happen to start on the wrong way, even with the guidance of the compas, you will just die.
Which leads me to think that it's because you can't go back to your starting point/camp to regain action points. There needs to be a way of gaining back points if you made a mistake outside of your control. That would be one way of solving it.
Next I think sometimes it's a bit unclear if a slope is going up or down. I know how to read a contour map and still sometimes I didn't quite understand if I would end up higher or lower due to me not beeing able to see the whole map. Maybe simply highlighting it with an arrow next to the steep cost would be helpful.
BTW It's weird that you highlight the game as beein turn-based when there are no enemies or any kind of events. I would just highlight it as beeing tile-based, not turn-based.
The game itself has potential though. You can add some things like snowstorms that you have to wait out, avalanches that move you around, key items that you need before you get to the temple, maps of the area, etc.