Is ChatGPT an Effective Tool for Providing Dietary Advice?

Valentina Ponzo,Ilaria Goitre,Enrica Favaro,Fabio Dario Merlo,Maria Vittoria Mancino,Sergio Riso,Simona Bo
DOI: https://doi.org/10.3390/nu16040469
IF: 5.9
2024-02-07
Nutrients
Abstract:The chatbot Chat Generative Pretrained Transformer (ChatGPT) is becoming increasingly popular among patients for searching health-related information. Prior studies have raised concerns regarding accuracy in offering nutritional advice. We investigated in November 2023 ChatGPT's potential as a tool for providing nutritional guidance in relation to different non-communicable diseases (NCDs). First, the dietary advice given by ChatGPT (version 3.5) for various NCDs was compared with guidelines; then, the chatbot's capacity to manage a complex case with several diseases was investigated. A panel of nutrition experts assessed ChatGPT's responses. Overall, ChatGPT offered clear advice, with appropriateness of responses ranging from 55.5% (sarcopenia) to 73.3% (NAFLD). Only two recommendations (one for obesity, one for non-alcoholic-fatty-liver disease) contradicted guidelines. A single suggestion for T2DM was found to be "unsupported", while many recommendations for various NCDs were deemed to be "not fully matched" to the guidelines despite not directly contradicting them. However, when the chatbot handled overlapping conditions, limitations emerged, resulting in some contradictory or inappropriate advice. In conclusion, although ChatGPT exhibited a reasonable accuracy in providing general dietary advice for NCDs, its efficacy decreased in complex situations necessitating customized strategies; therefore, the chatbot is currently unable to replace a healthcare professional's consultation.
nutrition & dietetics
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to evaluate the effectiveness and accuracy of ChatGPT in providing dietary advice, especially its performance in dealing with different non - communicable diseases (NCDs). Specifically, the researchers hope to evaluate whether ChatGPT can be used as a tool to replace registered dietitians to provide personalized dietary advice for patients with multiple NCDs by comparing the dietary advice provided by ChatGPT with the recommendations in international guidelines. ### Research Background Non - communicable diseases (NCDs) are the main cause of death globally, accounting for 74% of the global death toll. Among them, the incidences of diseases such as cardiovascular diseases, type 2 diabetes mellitus (T2DM), hypertension and non - alcoholic fatty liver disease (NAFLD) are increasing year by year. The phenomenon of searching for health information on the Internet is becoming more and more common. As an AI - based chatbot, ChatGPT has gradually become an important tool for people to obtain medical advice because of its personalized and interactive characteristics. However, current research on the accuracy and safety of ChatGPT in providing dietary advice is still insufficient. ### Research Purposes 1. **Evaluate whether the dietary advice provided by ChatGPT conforms to international guidelines**: By comparing ChatGPT's dietary advice for different types of NCDs with relevant international guidelines, evaluate its consistency and accuracy. 2. **Evaluate ChatGPT's performance in dealing with complex cases**: Explore whether ChatGPT can effectively integrate dietary advice for multiple NCDs and provide appropriate guidance for patients. ### Main Findings - **Performance in general cases**: ChatGPT performs well in providing general dietary advice, and the accuracy of its advice ranges from 55.5% (sarcopenia) to 73.3% (NAFLD). Most of the advice is in line with the guidelines, but there are slight differences in some cases. - **Limitations in complex cases**: When multiple co - existing NCDs are involved, ChatGPT's performance declines, and some contradictory or inappropriate advice appears. For example, when dealing with patients with T2DM, obesity and chronic kidney disease (CKD) at the same time, ChatGPT fails to well integrate the dietary advice for different diseases, resulting in some advice not being suitable for the specific situation of the patient. ### Conclusion Although ChatGPT has a certain degree of accuracy in providing general dietary advice, its ability in dealing with complex cases is limited and it cannot completely replace the personalized consultation of professional dietitians. Therefore, the researchers believe that although ChatGPT can be used as an auxiliary tool to help people obtain preliminary dietary advice, it cannot replace the diagnosis and treatment advice of professional medical personnel. ### Formula Example (if necessary) Since this article mainly involves dietary advice and clinical applications and does not involve specific mathematical, physical or chemical formulas. If there is a need to quote formulas, it will be presented strictly in Markdown format. For example: \[ E = mc^2 \] It is hoped that this information can help you better understand the research content and conclusion of this paper. If you have more questions, you are welcome to continue asking!