I know you need a badge and I have the jester badge but that one won't work and I can't find any other badges. Also I've already finished that part of the story if that helps someone answer my question.
Tavern of Spear v0.39f may contain content you must be 18+ to view.
The creator of this page has specified that it contains mature themes and content. Please enter your birthdate to verify you are 18 or older:
then you haven't gone back to the prison and checked properly... (if the fight down there does not start, visit asmund's room in the east wing of the main floor). that will get you the knight badge and also drop a key for a door in the west wing, which has one for the last locked door in the east wing, then the rest should all be explorable in the west wing for the prince badge.
ok, i tested the dungeon and figured out that watching asmund's scene (in the stop next to the bonfire) and then picking up his whistle in his room BUT finishing the dungeon without going down in the prison to blow the whistle will disable it forever.
it is a pretty specific sequence of actions, because not picking up the whistle at all will still allow you to do so after you finish the dungeon and go back in to explore more, and the event will work as intended. this also means you had at least 7 AGI to collect the jester badge in the top left section early.
i will report the bug on the discord, for now, you need to reload a save prior to defeating king harald (or restart the game)