If so, do we both click Join on the gamejam page? Or just one of us/whoever will be the one to upload?

Feel free to collaborate yeah! One of you upload the game then put the other as admin/co-creator in itch’s game settings.