Yes, it makes sense to develop a prototype. So you can have something to play and test your ideas early on.
BUT, you don't have to scrap your prototype. You can replace its simple graphics with polished art and add your sound tracks to turn your prototype into a final game. Ideally, you want to build a modular prototype where you can add or remove elements you want or don't want in the final game.