After playing for a while I realised I could hover over the enemies and it showed they had a large magical resistance so i replaced them with rangers which made it make a LOT more sense. I think a hint perhaps saying this would make that little tidbit of information easier to find and adapt your team to.
https://wburd.itch.io/stack-and-sigil is my link :)