1
|
Wee CK, Zhou X, Sun R, Gururajan R, Tao X, Li Y, Wee N. RETRACTED: Wee et al. Triaging Medical Referrals Based on Clinical Prioritisation Criteria Using Machine Learning Techniques. Int. J. Environ. Res. Public Health 2022, 19, 7384. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2025; 22:700. [PMID: 40304087 PMCID: PMC12042154 DOI: 10.3390/ijerph22050700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Subscribe] [Scholar Register] [Received: 04/18/2025] [Accepted: 04/23/2025] [Indexed: 05/02/2025]
Abstract
The journal retracts and remove the article Triaging Medical Referrals Based on Clinical Prioritisation Criteria Using Machine Learning Techniques [...].
Collapse
Affiliation(s)
- Chee Keong Wee
- School of Business, University of Southern Queensland, Toowoomba, QLD 4350, Australia; (C.K.W.); (R.G.)
- Digital Application Services, eHealth, Brisbane, QLD 4000, Australia;
| | - Xujuan Zhou
- School of Business, University of Southern Queensland, Toowoomba, QLD 4350, Australia; (C.K.W.); (R.G.)
| | - Ruiliang Sun
- Digital Application Services, eHealth, Brisbane, QLD 4000, Australia;
| | - Raj Gururajan
- School of Business, University of Southern Queensland, Toowoomba, QLD 4350, Australia; (C.K.W.); (R.G.)
| | - Xiaohui Tao
- School of Mathematics, Physics and Computing, University of Southern Queensland, Toowoomba, QLD 4350, Australia;
| | - Yuefeng Li
- School of Computer Science, Queensland University of Technology, Brisbane, QLD 4000, Australia;
| | - Nathan Wee
- Faculty of Science, University of Queensland, Brisbane, QLD 4072, Australia;
| |
Collapse
|
2
|
Siira E, Johansson H, Nygren J. Mapping and Summarizing the Research on AI Systems for Automating Medical History Taking and Triage: Scoping Review. J Med Internet Res 2025; 27:e53741. [PMID: 39913918 PMCID: PMC11843066 DOI: 10.2196/53741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 04/15/2024] [Accepted: 12/27/2024] [Indexed: 02/24/2025] Open
Abstract
BACKGROUND The integration of artificial intelligence (AI) systems for automating medical history taking and triage can significantly enhance patient flow in health care systems. Despite the promising performance of numerous AI studies, only a limited number of these systems have been successfully integrated into routine health care practice. To elucidate how AI systems can create value in this context, it is crucial to identify the current state of knowledge, including the readiness of these systems, the facilitators of and barriers to their implementation, and the perspectives of various stakeholders involved in their development and deployment. OBJECTIVE This study aims to map and summarize empirical research on AI systems designed for automating medical history taking and triage in health care settings. METHODS The study was conducted following the framework proposed by Arksey and O'Malley and adhered to the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) guidelines. A comprehensive search of 5 databases-PubMed, CINAHL, PsycINFO, Scopus, and Web of Science-was performed. A detailed protocol was established before the review to ensure methodological rigor. RESULTS A total of 1248 research publications were identified and screened. Of these, 86 (6.89%) met the eligibility criteria. Notably, most (n=63, 73%) studies were published between 2020 and 2022, with a significant concentration on emergency care (n=32, 37%). Other clinical contexts included radiology (n=12, 14%) and primary care (n=6, 7%). Many (n=15, 17%) studies did not specify a clinical context. Most (n=31, 36%) studies used retrospective designs, while others (n=34, 40%) did not specify their methodologies. The predominant type of AI system identified was the hybrid model (n=68, 79%), with forecasting (n=40, 47%) and recognition (n=36, 42%) being the most common tasks performed. While most (n=70, 81%) studies included patient populations, only 1 (1%) study investigated patients' views on AI-based medical history taking and triage, and 2 (2%) studies considered health care professionals' perspectives. Furthermore, only 6 (7%) studies validated or demonstrated AI systems in relevant clinical settings through real-time model testing, workflow implementation, clinical outcome evaluation, or integration into practice. Most (n=76, 88%) studies were concerned with the prototyping, development, or validation of AI systems. In total, 4 (5%) studies were reviews of several empirical studies conducted in different clinical settings. The facilitators and barriers to AI system implementation were categorized into 4 themes: technical aspects, contextual and cultural considerations, end-user engagement, and evaluation processes. CONCLUSIONS This review highlights current trends, stakeholder perspectives, stages of innovation development, and key influencing factors related to implementing AI systems in health care. The identified literature gaps regarding stakeholder perspectives and the limited research on AI systems for automating medical history taking and triage indicate significant opportunities for further investigation and development in this evolving field.
Collapse
Affiliation(s)
- Elin Siira
- School of Health and Welfare, Halmstad University, Halmstad, Sweden
| | - Hanna Johansson
- School of Health and Welfare, Halmstad University, Halmstad, Sweden
| | - Jens Nygren
- School of Health and Welfare, Halmstad University, Halmstad, Sweden
| |
Collapse
|
3
|
Zhang S, Zhang G, Wang M, Guo SB, Wang F, Li Y, Kadier K, Zhou Z, Zhang P, Chi H, Zhang C, Zhou Q, Lyu P, Zhao S, Yang S, Yuan W. Artificial Intelligence Hybrid Survival Assessment System for Robot-Assisted Proctectomy: A Retrospective Cohort Study. JCO Precis Oncol 2024; 8:e2400089. [PMID: 39432882 DOI: 10.1200/po.24.00089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 08/24/2024] [Accepted: 09/04/2024] [Indexed: 10/23/2024] Open
Abstract
PURPOSE Robotic-assisted proctectomy (RAP) has emerged as the predominant surgical approach for patients with rectal cancer in recent years; although good postoperative patient recovery with accurate prediction is a guarantee of adaptive surveillance management, there is still a lack of easy-to-use prognostic tools and risk scores designed specifically for those patients undergoing RAP. METHODS This study used the electronic health records of 506 RAP participants, including a National Specialist Center for da Vinci Robotic Colorectal Surgery (NSCVRCS) meta cohort, and an independent external validation Sun Yat-sen Memorial Hospital cohort. In the NSCVRCS meta cohort, patients were divided into a discovery cohort (70%, n = 268), where the best-fit model was applied to model our prediction system, RAP-AIscore. Subsequently, an internal validation process for RAP-AIscore was conducted using a replication cohort (30%, n = 116). The study designed and implemented a large-scale artificial intelligence (AI) hybrid framework to identify the best strategy for building a survival assessment system, the RAP-AIscore, from 132 potential modeling scenarios through a combination of iterative cross-validation, Monte Carlo cross-validation, and bootstrap resampling. The 10 variables most relevant to clinical interpretability were identified on the basis of the AI hybrid optimal model values, which helps provide reliable prognostic survival guidance for new patients. RESULTS The consistent evaluation of discrimination, calibration, generalization, and prognostic value across cohorts reaffirmed the accuracy and robust extrapolation capability of this system. The 10 feature variables most associated with clinical interpretability on the basis of Shapley values were identified, facilitating reliable prognostic survival guidance for new patients. CONCLUSION This study introduces a promising and informative tool, the RAP-AIscore, which can be explained through nomograms for interpreting clinical outcomes. It facilitates postoperative risk stratification management and enhances clinical management of prognosis for RAP patients.
Collapse
Affiliation(s)
- Shiqian Zhang
- Department of Colorectal Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Ge Zhang
- Department of Cardiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
- Henan Province Clinical Research Center for Cardiovascular Diseases, Zhengzhou, Henan, China
| | - Ming Wang
- Department of General Surgery, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China
| | - Song-Bin Guo
- Department of Medical Oncology, Sun Yat-sen University Cancer Center, Guangzhou, Guangdong, China
- State Key Laboratory of Oncology in South China, Collaborative Innovation Center of Cancer Medicine, Sun Yat-sen University Cancer Center, Guangzhou, Guangdong, China
| | - Fuqi Wang
- Department of Colorectal Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yun Li
- Department of Electrical and Electronic Engineering, The Hongkong Polytechnic University, Hong Kong, China
| | - Kaisaierjiang Kadier
- Department of Cardiology, The First Affiliated Hospital of Xinjiang Medical University, Ürümqi, Xinjiang, China
| | - Zhaokai Zhou
- Department of Urology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Pengpeng Zhang
- Department of Thoracic Surgery, The First Affiliated Hospital with Nanjing Medical University, Nanjing, Jiangsu, China
| | - Hao Chi
- Clinical Medical College, Southwest Medical University, Luzhou, Sichuan, China
| | - Chuchu Zhang
- Institute of Information on Traditional China Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Quanbo Zhou
- Department of Colorectal Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Pin Lyu
- Department of Colorectal Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Shuaiya Zhao
- Department of Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Shuaixi Yang
- Department of Colorectal Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Weitang Yuan
- Department of Colorectal Surgery, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| |
Collapse
|
4
|
Campion JR, O'Connor DB, Lahiff C. Human-artificial intelligence interaction in gastrointestinal endoscopy. World J Gastrointest Endosc 2024; 16:126-135. [PMID: 38577646 PMCID: PMC10989254 DOI: 10.4253/wjge.v16.i3.126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Revised: 01/18/2024] [Accepted: 02/23/2024] [Indexed: 03/14/2024] Open
Abstract
The number and variety of applications of artificial intelligence (AI) in gastrointestinal (GI) endoscopy is growing rapidly. New technologies based on machine learning (ML) and convolutional neural networks (CNNs) are at various stages of development and deployment to assist patients and endoscopists in preparing for endoscopic procedures, in detection, diagnosis and classification of pathology during endoscopy and in confirmation of key performance indicators. Platforms based on ML and CNNs require regulatory approval as medical devices. Interactions between humans and the technologies we use are complex and are influenced by design, behavioural and psychological elements. Due to the substantial differences between AI and prior technologies, important differences may be expected in how we interact with advice from AI technologies. Human–AI interaction (HAII) may be optimised by developing AI algorithms to minimise false positives and designing platform interfaces to maximise usability. Human factors influencing HAII may include automation bias, alarm fatigue, algorithm aversion, learning effect and deskilling. Each of these areas merits further study in the specific setting of AI applications in GI endoscopy and professional societies should engage to ensure that sufficient emphasis is placed on human-centred design in development of new AI technologies.
Collapse
Affiliation(s)
- John R Campion
- Department of Gastroenterology, Mater Misericordiae University Hospital, Dublin D07 AX57, Ireland
- School of Medicine, University College Dublin, Dublin D04 C7X2, Ireland
| | - Donal B O'Connor
- Department of Surgery, Trinity College Dublin, Dublin D02 R590, Ireland
| | - Conor Lahiff
- Department of Gastroenterology, Mater Misericordiae University Hospital, Dublin D07 AX57, Ireland
- School of Medicine, University College Dublin, Dublin D04 C7X2, Ireland
| |
Collapse
|
5
|
Abdel-Hafez A, Jones M, Ebrahimabadi M, Ryan C, Graham S, Slee N, Whitfield B. Artificial intelligence in medical referrals triage based on Clinical Prioritization Criteria. Front Digit Health 2023; 5:1192975. [PMID: 37964894 PMCID: PMC10642163 DOI: 10.3389/fdgth.2023.1192975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 10/03/2023] [Indexed: 11/16/2023] Open
Abstract
The clinical prioritisation criteria (CPC) are a clinical decision support tool that ensures patients referred for public specialist outpatient services to Queensland Health are assessed according to their clinical urgency. Medical referrals are manually triaged and prioritised into three categories by the associated health service before appointments are booked. We have developed a method using artificial intelligence to automate the process of categorizing medical referrals based on clinical prioritization criteria (CPC) guidelines. Using machine learning techniques, we have created a tool that can assist clinicians in sorting through the substantial number of referrals they receive each year, leading to more efficient use of clinical specialists' time and improved access to healthcare for patients. Our research included analyzing 17,378 ENT referrals from two hospitals in Queensland between 2019 and 2022. Our results show a level of agreement between referral categories and generated predictions of 53.8%.
Collapse
Affiliation(s)
- Ahmad Abdel-Hafez
- College of Computing & Information Technology, University of Doha for Science and Technology, Doha, Qatar
- Clinical and Business Intelligence (CBI), eHealth, Queensland Health, Brisbane, QLD, Australia
| | - Melanie Jones
- Clinical and Business Intelligence (CBI), eHealth, Queensland Health, Brisbane, QLD, Australia
| | - Maziiar Ebrahimabadi
- Clinical and Business Intelligence (CBI), eHealth, Queensland Health, Brisbane, QLD, Australia
| | - Cathi Ryan
- Clinical and Business Intelligence (CBI), eHealth, Queensland Health, Brisbane, QLD, Australia
| | - Steve Graham
- Clinical and Business Intelligence (CBI), eHealth, Queensland Health, Brisbane, QLD, Australia
| | - Nicola Slee
- Paediatric Otolaryngology Head and Neck Surgery, Queensland Children’s Hospital, Brisbane, QLD, Australia
- Medical School, University of Queensland, Brisbane, QLD, Australia
| | - Bernard Whitfield
- Department of Otolaryngology Head and Neck Surgery, Logan Hospital, Meadowbrook, QLD, Australia
- School of Medicine, Griffith University, Southport, QLD, Australia
| |
Collapse
|
6
|
Vântu A, Vasilescu A, Băicoianu A. Medical emergency department triage data processing using a machine-learning solution. Heliyon 2023; 9:e18402. [PMID: 37576318 PMCID: PMC10412878 DOI: 10.1016/j.heliyon.2023.e18402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 07/17/2023] [Accepted: 07/17/2023] [Indexed: 08/15/2023] Open
Abstract
Over the years, artificial intelligence has demonstrated its ability to overcome many challenges in our day-to-day life. The evolution of it inquired more studies about Machine Learning possible solutions for different domains, including health care. The increasing demand for artificial intelligence solutions has brought accessibility to loads of data, including clinical data. The availability of medical records facilitates new opportunities to explore Machine Learning models and their abilities to process a significant amount of data and to identify patterns with the purpose of solving a medical problem. Understanding the applicability of artificial intelligence on this type of data has to be a compelling aim for emergency medicine clinicians. This paper focuses on the general clinical problem of the complex correlation between medical records and later diagnosis and, especially, on the process of emergency department triage which uses the Emergency Severity Index (ESI) as triage protocol. This study presents a comparison between three different Machine Learning models, such as Logistic Regression, Random Forest Tree and NN-Sequentail, with the purpose of classifying patients with an emergency code. We conducted four experiments because of imbalanced data. A web-based application was developed to improve the triage process after our theoretical and exploratory results. Overall, in all experiments, the NN-Sequential model had better results, having, in the first experiment, a ROC-AUC score for each ESI emergency code of: 0.59%, 0.76%, 0.71%, 0.78% 0.64%. After applying methods to balance the data, the model yielded a ROC-AUC score for each emergency code of 0.72%, 0.75%, 0.69%, 0.74%, 0.78%. In the last experiment consisting of a three-class classification problem, the NN-Sequential and Random Forest Tree models had similar metric outcomes, and the NN-Sequential algorithm had a ROC-AUC score for each emergency code of: 0.76%, 0.72%, 0.84%. Without any doubt, our research results presented in this paper endorse this tremendous curiosity in Machine Learning applications to enrich aspects of emergency medical care by applying specific methods for processing both medical data and medical records.
Collapse
Affiliation(s)
- Andreea Vântu
- Faculty of Mathematics and Computer Science, Transilvania University of Braşov, Romania
| | - Anca Vasilescu
- Department of Mathematics and Computer Science, Transilvania University of Braşov, Romania
| | - Alexandra Băicoianu
- Department of Mathematics and Computer Science, Transilvania University of Braşov, Romania
| |
Collapse
|
7
|
Majeed AP, Alkubaisi N, Harikumar K, Al Mujalli H, Ali Shah A, Khan S, Sarip Socor S. Evaluation and Enhancement of Triaging Services Through Quality Improvement Tools at Primary Health Care Level: A Clinical Audit Study. J Prim Care Community Health 2023; 14:21501319231202204. [PMID: 37837373 PMCID: PMC10576912 DOI: 10.1177/21501319231202204] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 08/31/2023] [Accepted: 09/01/2023] [Indexed: 10/16/2023] Open
Abstract
BACKGROUND The effective and efficient operation of emergency services at healthcare depends on triage decisions. Successfully implementing a triage system improves patient care, communication, and self-assurance. METHODS A baseline audit was conducted by reviewing a sample of 554 triage health records in September 2021. Many gaps were identified in the practice, and action plans were developed for improving it. Following the implementation of the action plan, a re-audit was conducted in September 2022 with a sample of 470 medical records. RESULTS Evidence suggested that nurses had made progress in correctly allocating the medical emergency triage category from 63% at baseline to 90% at the reaudit. The over-triage decreased in accordance with this adjustment, from 37% to 10%. Compliance with the suggested time target of 5 minutes for physicians to attend medical emergencies has shown a small improvement from 48% at baseline to 55% in the re-audit. Similar improvements were demonstrated in the other triage categories. CONCLUSION A problem may have several causes, and since it is impossible to address every one of them, prioritizing the causes is usually the best course of action. Inadequate triage classification by nurses was one of the key reasons for the delay in physician appointment times in triage clinics. Triage nurses' abilities should be enhanced to make this triage judgment. The audit team suggested that nurses should be given problem-based training, which will enhance the entire triage procedure.
Collapse
|