Very cool and clever idea, but it gets tough quickly (especially with those modifiers that speed up time). It's very hard to figure out what should I switch with what, when everything is incredibly fast, maybe going backwards and I have 2 spaces that would hurt me :D
Don't get me wrong, I see that was the goal, to make it frantic and fast-paced. Maybe I'm just really bad at it :D