I think the "should not be that obvious" isn't achieved well. The door is pretty out-of-place, so a normal person would know there's something odd about the door. A bit more ruins (or something related) that could give a plausible explanation for the existence of the door would help.
I love the concept though!