I will have more to write about this soon (ha!), but until the stars align for an extended writing session here is a good opinion piece from FT’s John Thornhill about why LLMs may not be all that great for lay people dabbling in, for example, medicine:

When the test scenarios were entered directly into the AI models, the chatbots correctly identified the conditions in 94.9 per cent of cases. However, the participants did far worse: they provided incomplete information and the chatbots often misinterpreted their prompts, resulting in the success rate dropping to just 34.5 per cent. The technological capabilities of these models did not change but the human inputs did, leading to very different outputs.

The emphasis is mine, because it is a neat summarization of what I wrote 2 years ago. Humans are unique not because of what’s inside our heads but because of how we interact with the environment. There will be no artificial general intelligence until that problem is solved.