Hello, thanks for reporting! This should happen only on rare ocasions, as the search for a mill looks under a certain radius around the worker, so if the ideal mill is out of the radius, he might default to a "closer" one but requiring more walking. Increasing the radius degrades the overall performance of the game so I can't easily fix it unfortunately.