Hi! Yes, spirits can be linked to specific allies, so you can make a spirit exclusive to one character or compatible with a selected group.
If you use evolutions, the evolved spirit's compatibility also matters: it is unequipped automatically if it is no longer compatible with that character.