interesting. i thought you used Normal maps, so i ended up making a small prototype with a tileset with normals and it worked similarly