Not a silly question at all! Yes, that's safe. Once the save folder is in the new version, start the game and check that Continue loads your save. If it does, you can uninstall and delete the old version.
To be extra safe, keep a copy of the save folder somewhere else too, like your Desktop. It's tiny, and then nothing can go wrong. ^^