Do I need to click a button before I can harvest the plants then?
Yep, the shovel
not unintuitive at all! I did click the shovel then try to click the vegetables, so something else must have been wrong. All good!
Sorry for the unintuitive UX