Will be good to be able to do fast travel always when you want it. Because that infinity runs annoying and boring.
If you talk whit Stela after some part of the game, you can go to the town whitout wasting the time of the day, she will talk you about it if you talk whit her