Thanks so much for the comment! Yes, each player gets their own randomised sums, and the difficulty is tracked separately for each of you.
If you answer quickly and get it right first time, your sums gradually get harder. If you slip up or lose a heart, they ease off again. So a faster player does end up facing tougher sums than their opponent, which is on purpose: it keeps matches close, a bit like a handicap in golf. Long rallies also ramp things up for both players every 6 hits.
If a tricky sum does catch you out, that’s what passes are for. You start with one, and you earn another with a streak of 3, then 5, then 7. You can only hold one at a time, and you can’t use it while your paddle is locked, so save it wisely! :-)