Yeah, I used fast forward all the time. Is there a reason not to use it?
No reason (gameplay-wise), 2x is just animation speed — same math. Slow start is only so the first fight or two are readable. It should remember your choice though; that's fair.