I don't test on desktop browsers very often, because this means being on Windows, and I'm not on Windows very often :-) but I've always had pretty good luck with it! It may depend on specific hardware/software? I'm usually testing with Quest 2 or 3 via Quest Link or Steam Link. I know a number of people have reported issues, but I've never been super successful in reproducing them - unfortunately, it seems to usually just work for me
What hardware/software are you testing with?