And I mean restarting the game completely: exit and rerun. I went to the menu a few times without closing the game and then loaded back in and everything was alright, I think.
