At first I used to think the same and after a certain point of qi, nothing you do with your body makes a notable difference and harmonized growth is a pretty good idle loop for wilderness hunting/ cultivation of affinities. Eventually you'll get lifespan increases from other sources to the point that the time lost from jumping to harmonized is just negligible vs the convinience it affords you.