The article explains the general problem on the example of software development. But given that AI models are heavily promoted by billion-dollar US companies and important actors in that space are not at all friendly to the European Union, I think the relevance can be far larger.
Generally, the article explains that judging usefulness of AI models, specifically LLMs, by trying them out is very prone to the same psychlological traps like astrology, tarot cards or psychics - the so-called Barnum effect. This is specifically because these models are carefully engineered to produce plausible-sounding andwers! And even very intelligent but unaware people can easily fall prey to it.
Is actually have a good answer but in my case it’d be “I wanted to know what that one plant I saw was”. AI-based pattern matching to identify plant or animal species is pretty handy.
It’s also way more sensible than trying to use text generation for anything useful.
Fair, I was mostly talking about LLMs and other generative AI.