URL of study: https://onlinelibrary.wiley.com/doi/10.1002/jocb.70077
If anyone actually talked to users and did what they wanted, then software wouldn't suck.
Many firms are unable to accurately measure the quality of research work and so they will be duped by the alternative marketing. The market can correct for this on a long enough time horizon if a competitor takes the opposite bet on whether this job is automate-able that way, but in the meantime you are probably out of a job and your equity goes down.
Unfortunately, that's not how most people make decisions on what to purchase. It's all about bean counting; what is cheap, vs what is expensive. Don't believe me? Why is Trump currently putting tariffs on foreign countries? Because it is cheaper to manufacture there, are their products better than American ones? No, but they're cheap.
There's currently a bit of an 80/20 rule with AI where it does great automating 80% of an overlapping problem domain and chokes on it 20% of the time.
The idea of someone giving 100% of their work to Claude as in the examples is dumb. But so is someone doing 100% of the busywork themselves.
Don't waste your own time and your client's money for the sake of some nonsense purity ideal. Learn to thread the needle of changing times.
Cause they are gonna keep changing.