Ok, this is a different one here. Congratulations for the project. It´s always fantastic to see new perspectives. The ambience and the idea have a lot of potential, the colors leading the way, the music changes, the soud fx… The mechanics are also intriguing but can be polished a little bit more (for a 3 hours project is absolutely awesome, I couldn´t do that).
And… You don´t need to make a scary game. For me a pyscological horror game would work perfectly. You should reserved like 15 minutes of coding for introduce narrative. A story involving this little experience. Maybe paper notes? Maybe some pictures in the wall? Trying to tell us something in a subtextual or cryptic way?
As the story and lore can be written out of the time limit of the jam, then you only need to write quick the narrative quotes wherever is needed, or set up a pair of symbolical objects. The game would improve drastically. But… It´s my opinion ^^!!!