AI Not Ready to Coach Health Future

Artificial intelligence (AI) programs such as ChatGPT could potentially be used to motivate people to make healthier choices, but currently veer away from best practice, new Flinders University research has found.

Using simulated patients, the researchers tested ChatGPT-4’s ability to deliver Motivational Interviewing, an evidence-based counselling method that helps people identify their own motivation to change behaviours.

“Rates of chronic diseases are increasing worldwide, putting pressure on our healthcare systems, yet those same systems lack the capacity to help address the issue,” said lead researcher Dr Candice Oster, from Flinders’ Caring Futures Institute.

“Artificial intelligence chatbots offer a potential accessible, cost-effective tool for supporting people to undertake health behaviour change to address lifestyle risk factors for chronic diseases, but very little evidence exists for their capability.”

The conversations were analysed using a popular tool for assessing Motivational Interviewing skills, which works through a four-step process starting with rapport building and understanding the desired goal, before moving on to evoking a person’s own motivation to change.

Initial analysis found that ChatGPT demonstrated some ability to deliver Motivational Interviewing, including complex reflections, affirmations, and seeking collaboration while avoiding confrontation.

But the AI eventually progressed to lengthy bouts of ‘telling’ and inappropriate interactions, including long bulleted lists of suggested actions and attempting to end conversations prematurely.

“We know that simply telling people what to do and how to change doesn’t work, they need to want to change first,” Dr Oster explained.