This is a really cool setup. and I gave it a fair shake, but I just don't think I have enough muscle memory using the Numpad buttons to react in time.
EDIT: Didn't realize you could leave the mine to upgrade.
I bought 3 time upgrades, but didn't fare much better.