I think I will end up needing a walkthrough. So far I have the below 
(I also have some random boxes, not sure if they do anything. I read a sign behind a building but I have no idea where it is now or what it says),
This is really fascinating but a little difficult for me, so I have no idea what to do next. Aldo, I don't actually see this on the js13k game page list of entries... is that intentional ?