The memory idea is a good one! Can think of a few ways you could start mixing it up to increase difficulty if/when games go on longer.
Flipping numbers upside down, adding -/+ modifiers, flashing up for even less time.
Yeah, neat idea. Would like to see more!