The issue is non coders coding and non artists mimicking art with these tools. That's not efficiency, that's strangers coming to your turf to take away your craft and replacing it with a machine. A machine that might have been trained with your works.
Using ai is more accepted among coders, but they still use vibe coder as an insult.
And among visual artists, using ai would be something similar to tracing other people's work, or worse.
One does not delegate art as an artist. It is the thing that makes you an artist. If you outsource that, what are you? Not an artist. At least not in the craft you delegated. You reduce yourself from a writer to an editor, from a violinist to a conductor, from a painter to the person that selects which image to use after telling a box to draw some. Now, there is creativity in editorial work, and it is often very important, but it's just not the same.
In a paid work scenario where you need to deliver results, that might be seen different. But in that scenario the things you create might also not be considered art by yourself, but the things you create to be able to buy food.