研究动态
Articles below are published ahead of final publication in an issue. Please cite articles in the following format: authors, (year), title, journal, DOI.

临床实验室测试中基于机器学习的样本误识别错误检测:一项回顾性多中心研究。

Machine Learning-Based Sample Misidentification Error Detection in Clinical Laboratory Tests: A Retrospective Multicenter Study.

发表日期:2024 Aug 22
作者: Hyeon Seok Seok, Shinae Yu, Kyung-Hwa Shin, Woochang Lee, Sail Chun, Sollip Kim, Hangsik Shin
来源: CLINICAL CHEMISTRY

摘要:

在临床实验室中,自动验证技术的精确度和灵敏度对于确保可靠的诊断至关重要。传统方法的灵敏度和适用性有限,使得错误检测具有挑战性并降低了实验室效率。本研究引入了基于机器学习 (ML) 的自动验证技术来增强肿瘤标志物测试错误检测。通过分析 397 751 个用于模型训练和内部验证的大数据集以及 215 339 个用于外部验证的大数据集来评估各种 ML 模型的有效性。通过随机改组无错误测试结果来模拟样本错误识别,错误率为 1%,以达到真实世界的近似值。 ML 模型是通过贝叶斯优化进行调整而开发的。在基层机构内部和其他机构外部进行模型验证,将机器学习模型的性能与传统的 Delta 检查方法进行比较。深度神经网络和极端梯度提升实现了接收者操作特征曲线下面积 0.834 至 0.903,优于传统方法(0.705 至 0.816)。 3个独立实验室的外部验证表明,ML模型的平衡精度范围为0.760至0.836,优于传统模型0.670至0.773的平衡精度。这项研究解决了当前样本检测的Delta检查方法的灵敏度限制。错误识别错误,并提供通用模型来减轻小型实验室面临的操作挑战。我们的研究结果为更高效、更可靠的临床实验室检测提供了一条途径。© 诊断协会
In clinical laboratories, the precision and sensitivity of autoverification technologies are crucial for ensuring reliable diagnostics. Conventional methods have limited sensitivity and applicability, making error detection challenging and reducing laboratory efficiency. This study introduces a machine learning (ML)-based autoverification technology to enhance tumor marker test error detection.The effectiveness of various ML models was evaluated by analyzing a large data set of 397 751 for model training and internal validation and 215 339 for external validation. Sample misidentification was simulated by random shuffling error-free test results with a 1% error rate to achieve a real-world approximation. The ML models were developed with Bayesian optimization for tuning. Model validation was performed internally at the primary institution and externally at other institutions, comparing the ML models' performance with conventional delta check methods.Deep neural networks and extreme gradient boosting achieved an area under the receiver operating characteristic curve of 0.834 to 0.903, outperforming that of conventional methods (0.705 to 0.816). External validation by 3 independent laboratories showed that the balanced accuracy of the ML model ranged from 0.760 to 0.836, outperforming the balanced accuracy of 0.670 to 0.773 of the conventional models.This study addresses limitations regarding the sensitivity of current delta check methods for detection of sample misidentification errors and provides versatile models that mitigate the operational challenges faced by smaller laboratories. Our findings offer a pathway toward more efficient and reliable clinical laboratory testing.© Association for Diagnostics & Laboratory Medicine 2024.