Yeah, I noticed that when resizing the editor, things like the scale factor didn't actually seem to change... do you get different results in a build?
I may have to revisit how auto-quality is calculated. If the canvas were to be 2160p tall and the text size were to be 80, ideally, the quality should be set to 80 if there's no scaling going on. So if it were rendering at 1080p with the same settings, the text ideally should go down to 40 quality, to match the actual screen resolution. So maybe it should be a comparison between the canvas reference height and Screen.height...? We could give that a shot and see if it produces a result in-editor