研究动态
Articles below are published ahead of final publication in an issue. Please cite articles in the following format: authors, (year), title, journal, DOI.

评估 ChatGPT 关于甲状腺癌的医疗反应的准确性和可靠性。

Assessing the accuracy and reliability of ChatGPT's medical responses about thyroid cancer.

发表日期:2024 Aug 13
作者: Burcak Cavnar Helvaci, Sema Hepsen, Burcu Candemir, Ogulcan Boz, Halil Durantas, Mehdi Houssein, Erman Cakal
来源: INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS

摘要:

ChatGPT 有潜力提供患者友好的支持。近年来,甲状腺癌变得越来越流行。本研究旨在评估 ChatGPT 在回答与甲状腺癌相关的信息、管理和情感支持问题方面的准确性和充分性。我们进行了一项三步研究。第一步,ChatGPT 回答了 30 个有关甲状腺癌的问题。第二步,我们介绍了三个不同的甲状腺癌患者病例,并向 ChatGPT 询问了他们的诊断、治疗管理和随访情况。第三步,我们询问患者及其家属的情感支持情况。三位内分泌专家根据 ATA 指南对这些反应进行了分级。我们发现 ChatGPT 重现了甲状腺癌的广泛知识(76.66% 正确),但只有一小部分(6.66%)被标记为混合了正确和不正确/过时的数据。然而,它对甲状腺癌临床病例的评估还不够。它在总体框架中提到了治疗和后续建议,而不是针对特定患者。此外,它还为患者和护理人员提供了有关下一步和适应新诊断的实用且多方面的情感支持建议。我们的研究是第一个评估 ChatGPT 在甲状腺癌中的能力和可靠性的研究。尽管 ChatGPT 在获取甲状腺癌信息方面具有中等能力,但尚未确定其在病例管理方面具有足够的能力和可靠性。已发现它可以有效地指导患者及其亲属进行情感支持。版权所有 © 2024 Elsevier B.V. 保留所有权利。
ChatGPT has the potential to offer patient-friendly support. Thyroid carcinoma has become increasingly prevalent in recent years. This study aimed to assess ChatGPT's accuracy and adequacy in answering questions about information, management, and emotional support related to thyroid cancer.We conducted a three-step study. In the first step, ChatGPT responded to 30 questions about thyroid cancer. In the second step, we presented three different cases of thyroid cancer patients and asked ChatGPT about their diagnosis, treatment management, and follow-up. In the third step, we inquired about emotional support for patients and their families. Three expert endocrinologists graded these responses according to ATA guidelines.We showed that ChatGPT regurgitated extensive knowledge of thyroid cancer (76.66% correct), but only small proportions (6.66%) were labeled as mixed with correct and incorrect/outdated data. However, it was inadequate in the evaluation of clinical cases of thyroid cancer. It mentioned treatment and follow-up recommendations in a general framework, not patient-specific. Also, it provided practical and multifaceted emotional support advice to patients and caregivers regarding the next steps and adjusting to a new diagnosis.Our study is the first to evaluate the competence and reliability of ChatGPT in thyroid cancer. Although ChatGPT is moderately competent in obtaining information about thyroid cancer, it has not yet been determined to be sufficiently competent and reliable in case management. It has been found effective in guiding patients and their relatives regarding emotional support.Copyright © 2024 Elsevier B.V. All rights reserved.