Really cool concept! It did take me a bit to figure out what was going on, and some improvements to the interactiveness of the game would go a long way to fixing that, but this is a solid mechanic and I'm curious to see where it could be taken with more development.