研究动态
Articles below are published ahead of final publication in an issue. Please cite articles in the following format: authors, (year), title, journal, DOI.

减少肺癌分类中的诊断错误:不确定性量化的多眼原则。

Mitigating Diagnostic Errors in Lung Cancer Classification: A Multi-Eyes Principle to Uncertainty Quantification.

发表日期:2024 Aug 20
作者: Rahimi Zahari, Julie Cox, Boguslaw Obara
来源: IEEE Journal of Biomedical and Health Informatics

摘要:

在放射学中,特别是在肺癌诊断中,诊断错误和认知偏差带来了巨大的挑战。这些问题,包括感知错误、解释错误以及锚定和过早闭合等认知偏差,往往被经验丰富的放射科医生忽视。为了应对这些挑战,我们提出了多眼原理方法,该方法利用多种深度学习模型来减少偏差并可能提高诊断准确性。受商业和网络安全中的四眼原理的启发,该方法采用各种 3D 和 2D(用于验证)深度学习架构和三种不确定性量化技术:Monte Carlo Dropout、Deep Ensemble 和 Ensemble Monte Carlo Dropout。每个模型都充当独立审阅者,类似于盲审。选择熵作为不确定性测量,对其进行平均,然后对预测进行整体平均。使用 LIDC-IDRI 肺癌分类数据集证明了该方法的有效性。对不确定性分布的统计分析表明,随着模型的增加,错误预测的不确定性变得更加峰值和左偏,这表明对不确定性水平的共识。即使使用性能最佳的模型,这也会提高准确性和 F1 分数,从而解决单模型系统中的过度自信问题。这些发现凸显了多眼原理显着提高计算机辅助诊断系统诊断性能的潜力。未来的研究可能会探索不同的不确定性量化方法和反馈机制以进一步推进。
In radiology, particularly in lung cancer diagnosis, diagnostic errors and cognitive biases pose substantial challenges. These issues, including perceptual errors, interpretive mistakes, and cognitive biases such as anchoring and premature closure, are often unnoticed by experienced radiologists. To address these challenges, we propose the Multi-Eyes principle approach, which utilises multiple deep learning models to reduce bias and potentially improve diagnostic accuracy. Inspired by the Four-Eyes principle in business and cybersecurity, this methodology employs various 3D and 2D (for validation) deep learning architectures and three uncertainty quantification techniques: Monte Carlo Dropout, Deep Ensemble, and Ensemble Monte Carlo Dropout. Each model functions as an independent reviewer, similar to blind reviews. With entropy selected as the uncertainty measurement, it is averaged, followed by ensemble averaging of predictions. The effectiveness of this approach was demonstrated using the LIDC-IDRI dataset for lung cancer classification. Statistical analysis of the uncertainty's distribution reveals that with more models, uncertainty in incorrect predictions becomes more peaked and left skewed, indicating consensus on uncertainty levels. This results in accuracy and F1 score improvements, even with the best performing model, addressing overconfidence in single-model systems. These findings highlight the potential of the Multi-Eyes principle to significantly improve diagnostic performance in computer-aided diagnostic systems. Future research may explore different uncertainty quantification methods and feedback mechanisms for further advancement.