You can change the palette in the middle of the game. As long as the new palette is still 4 colours its within the rules.
