Hmm, I had an .app folder and used the “Pack to ZIP” option on it. Maybe simply changing the extension of the folder containing all the files to .app will work for you?
I attempted to rename the zip itself, bit it didn't work
don't mind castle crashers