1
|
Jayawardena T, Baysari M, Bamgboje-Ayodele A. Interface design features of clinical decision support systems for real-time detection of deterioration: A scoping review. Int J Med Inform 2025; 201:105946. [PMID: 40300487 DOI: 10.1016/j.ijmedinf.2025.105946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2025] [Revised: 04/16/2025] [Accepted: 04/21/2025] [Indexed: 05/01/2025]
Abstract
BACKGROUND Clinical decision support systems (CDSS) can support clinicians with the timely detection of patients' clinical deterioration, however, less than half of clinical decision support (CDS) systems implemented for clinical deterioration are used by clinicians. Poor design of CDS systems has emerged as a contributing factor. OBJECTIVE The aim of this study was to 1) identify interface design features that have been used in CDS systems for real-time detection of clinical deterioration; (2) determine which interface design features are preferred by clinicians; and (3) examine other design features (external to the interface) which influence CDS acceptance. METHODS Three databases (Medline, Scopus and CINAHL) were searched to identify relevant studies. All studies that met the eligibility criteria were included. A qualitative narrative synthesis was undertaken. RESULTS Of 24 eligible articles, 17 described CDS systems in the form of a dashboard and 7 described alerts. Of the 17 dashboards, graphs and tables were the most used interface design features to display vital signs. Colour was the most frequently used interface design feature to signal the presence of deterioration with half of colour-coded dashboards using a traffic light schema to classify patient risk level. Clinicians preferred dashboards that included both graphs and tables. Clinicians have expressed that they were disinclined to use CDS systems with manual recording of vital signs and high alert frequency. CONCLUSIONS This scoping review uncovered wide variability in design features across CDS systems for real-time detection of deterioration. Our research calls for better adherence to reporting checklists when reporting on interface designs, and the development of design guidelines to guide interface designs of CDS systems for detecting deterioration in real-time. Our scoping review may serve as a preliminary guide for the design of future CDS systems for detecting deterioration.
Collapse
Affiliation(s)
- Tamasha Jayawardena
- Sydney Nursing School, Faculty of Medicine and Health, The University of Sydney, Australia
| | - Melissa Baysari
- Sydney Nursing School, Faculty of Medicine and Health, The University of Sydney, Australia
| | - Adeola Bamgboje-Ayodele
- Sydney Nursing School, Faculty of Medicine and Health, The University of Sydney, Australia; Discipline of Design, School of Architecture, Design and Planning, The University of Sydney, Australia.
| |
Collapse
|
2
|
Tong F, Lederman R, D'Alfonso S. Clinical decision support systems in mental health: A scoping review of health professionals' experiences. Int J Med Inform 2025; 199:105881. [PMID: 40121768 DOI: 10.1016/j.ijmedinf.2025.105881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2024] [Revised: 03/04/2025] [Accepted: 03/17/2025] [Indexed: 03/25/2025]
Abstract
BACKGROUND Clinical decision support systems (CDSSs) have the potential to assist health professionals in making informed and cost-effective clinical decisions while reducing medical errors. However, compared to physical health, CDSSs have been less investigated within the mental health context. In particular, despite mental health professionals being the primary users of mental health CDSSs, few studies have explored their experiences and/or views on these systems. Furthermore, we are not aware of any reviews specifically focusing on this topic. To address this gap, we conducted a scoping review to map the state of the art in studies examining CDSSs from the perspectives of mental health professionals. METHOD In this review, following the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guideline, we systematically searched the relevant literature in two databases, PubMed and PsycINFO. FINDINGS We identified 23 articles describing 20 CDSSs Through the synthesis of qualitative findings, four key barriers and three facilitators to the adoption of CDSSs were identified. Although we did not synthesize quantitative findings due to the heterogeneity of the results and methodologies, we emphasize the issue of a lack of valid quantitative methods for evaluating CDSSs from the perspectives of mental health professionals. SIGNIFICANCE To the best of our knowledge, this is the first review examining mental health professionals' experiences and views on CDSSs. We identified facilitators and barriers to adopting CDSSs and highlighted the need for standardizing research methods to evaluate CDSSs in the mental health space.
Collapse
Affiliation(s)
- Fangziyun Tong
- School of Computing and Information Systems, University of Melbourne, Parkville 3010, Australia.
| | - Reeva Lederman
- School of Computing and Information Systems, University of Melbourne, Parkville 3010, Australia
| | - Simon D'Alfonso
- School of Computing and Information Systems, University of Melbourne, Parkville 3010, Australia
| |
Collapse
|
3
|
Kutler RB, He L, Green RW, Rameau A. Advancing laryngology through artificial intelligence: a comprehensive review of implementation frameworks and strategies. Curr Opin Otolaryngol Head Neck Surg 2025; 33:131-136. [PMID: 40036167 DOI: 10.1097/moo.0000000000001041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
PURPOSE OF REVIEW This review aims to explore the integration of artificial intelligence (AI) in laryngology, with specific focus on the barriers preventing translation from pilot studies into routine clinical practice and strategies for successful implementation. RECENT FINDINGS Laryngology has seen an increasing number of pilot and proof-of-concept studies demonstrating AI's ability to enhance diagnostics, treatment planning, and patient outcomes. Despite these advancements, few tools have been successfully adopted in clinical settings. Effective implementation requires the application of established implementation science frameworks early in the design phase. Additional factors required for the successful integration of AI applications include addressing specific clinical needs, fostering diverse and interdisciplinary teams, and ensuring scalability without compromising model performance. Governance, epistemic, and ethical considerations must also be continuously incorporated throughout the project lifecycle to ensure the safe, responsible, and equitable use of AI technologies. SUMMARY While AI hold significant promise for advancing laryngology, its implementation in clinical practice remains limited. Achieving meaningful integration will require a shift toward practical solutions that prioritize clinicians' and patients' needs, usability, sustainability, and alignment with clinical workflows.
Collapse
Affiliation(s)
- Rachel B Kutler
- Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medical College, New York
| | - Linh He
- Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medical College, New York
| | - Ross W Green
- Co-Founder, Chief Medical Officer and Chief Revenue Officer, Opollo Technologies, Buffalo, New York, USA
| | - Anaïs Rameau
- Sean Parker Institute for the Voice, Department of Otolaryngology-Head and Neck Surgery, Weill Cornell Medical College, New York
| |
Collapse
|
4
|
Mathioudakis N, Wolf R, Choudhary A, Davis G, Gallagher MP, Gupta M, Kamboj M, Rioles N, Ospelt E, Thapa S, Weinstock RS, Wright T, Ebekozien O. Implementation and Evaluation of a Best Practice Advisory to Reduce Inequities in Technology Use for People With Type 1 Diabetes: Protocol for a Mixed Methods, Nonrandomized Controlled Trial. JMIR Res Protoc 2025; 14:e71038. [PMID: 40434817 DOI: 10.2196/71038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2025] [Revised: 03/06/2025] [Accepted: 03/24/2025] [Indexed: 05/29/2025] Open
Abstract
BACKGROUND Continuous advancements in diabetes technologies have improved self-management for people with type 1 diabetes. Continuous glucose monitoring and automated insulin delivery systems have enhanced the quality of life and glycemic outcomes while reducing severe hypoglycemia and diabetes ketoacidosis hospitalizations. Despite these benefits, racial inequities in the use of advanced diabetes technology (ADT) persist. OBJECTIVE This study aims to develop and evaluate a best practice advisory (BPA) within the electronic medical record (EMR) to reduce racial and ethnic disparities in ADT use. We hypothesize that an EMR-based BPA designed to standardize the prescribing of ADTs will minimize racial and ethnic disparities in ADT adoption or progression in use among pediatric and adult people with type 1 diabetes. METHODS The Best Practice Advisories to Reduce Inequities in Technology Use (BPA-TECH) study will use a nonrandomized matched pair intervention design. Phase 1 will use qualitative methods to develop and refine the BPA, including focus groups and surveys of health care providers and people with type 1 diabetes or their caregivers. Phase 2 will evaluate the effectiveness of the BPA through a controlled before-after study of people with type 1 diabetes seen at 7 T1D Exchange Quality Improvement Collaborative (T1DX-QI) centers, with control people with type 1 diabetes matched from nonintervention T1DX-QI centers. The baseline and postintervention periods will be the 12 months before and 12 months after deployment of the BPA at the intervention centers, respectively. Eligibility criteria include people with type 1 diabetes aged ≥2 years with an EMR diagnosis of T1D during the baseline period. The primary outcome is the progression in ADT use from the baseline to postintervention periods. RESULTS This 3-year study began in July 2024, with data collection from key stakeholders for phase 1 qualitative research beginning in August 2024. For phase 2, we estimate approximately 3000 eligible non-Hispanic Black and Hispanic people with type 1 diabetes at the intervention centers and 15,000 matched controls. Data on ADT use, glycated hemoglobin (HbA1c), severe hypoglycemic events, and diabetes ketoacidosis events will be collected via the T1DX-QI coordinating center. The study is powered to detect a between-group difference of 15% in the proportion of patients in the intervention and control groups in meeting the primary endpoint. We anticipate the completion of this study by May 2027. CONCLUSIONS The BPA-TECH study aims to leverage health IT to address racial and ethnic disparities in ADT use among people with type 1 diabetes. By standardizing the approach to ADT prescribing for people with type 1 diabetes, the BPA-TECH has the potential to promote equity in diabetes management and improve clinical outcomes. The outcomes of this study will inform future efforts to reduce health care disparities. TRIAL REGISTRATION ClinicalTrials.gov NCT06931275; https://clinicaltrials.gov/search?term=NCT06931275. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/71038.
Collapse
Affiliation(s)
- Nestoras Mathioudakis
- Division of Endocrinology, Diabetes & Metabolism, Department of Medicine, Johns Hopkins University, Baltimore, MD, United States
| | - Risa Wolf
- Division of Pediatric Endocrinology, Department of Pediatrics, Johns Hopkins University, Baltimore, MD, United States
| | - Abha Choudhary
- Division of Endocrinology, Department of Pediatrics, The University of Texas Southwestern Medical Center, Dallas, TX, United States
| | - Georgia Davis
- Division of Endocrinology, Metabolism & Lipids, Department of Medicine, Emory University, Grady Memorial Hospital, Atlanta, GA, United States
| | | | - Meenal Gupta
- Seattle Children's Hospital, Seattle, WA, United States
| | - Manmohan Kamboj
- Division of Endocrinology, Department of Pediatrics at the Ohio State University, Nationwide Children's Hospital, Columbus, OH, United States
| | | | | | | | | | | | | |
Collapse
|
5
|
Teoh L, Biezen R, Taylor M, Sinnott RO, McCullough MJ. Acceptability and usability of Drugs4dent ®, a dental medicines decision tool - a pilot study. BMC Oral Health 2025; 25:766. [PMID: 40405197 PMCID: PMC12096631 DOI: 10.1186/s12903-025-06137-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Accepted: 05/08/2025] [Indexed: 05/24/2025] Open
Abstract
BACKGROUND While drugs have a limited role in the management of dental presentations, Australian dentists have high rates of inappropriate prescribing of antibiotics. There is also a lack of relevant drug resources for dentists in Australia. Our team developed Drugs4dent®, a medicines decision support tool, that provides dentists with relevant drug knowledge, assists with appropriate prescribing and provides safety checks to reduce prescribing errors. The aim of this pilot study was to improve Drugs4dent® with focus groups of dentists, and assess the acceptability, usability, and user experience, of Drugs4dent®. METHODS Focus groups of ten dentists were established to inform the improvement of Drugs4dent®. Acceptability and usability testing of Drugs4dent® was then undertaken with a further ten dentists using interviews and a survey. The survey was based on the Framework for Acceptability and System Usability Scale. Inductive thematic analysis was undertaken using Nvivo for the focus groups and interviews, and descriptive statistics for analysis of survey results. RESULTS Dentists from the focus group and interviews found the content of Drugs4dent® acceptable and useful for dentistry, recognising that similar drug information is currently not available. The majority agreed that Drugs4dent® would improve their ability to prescribe according to guidance. Participants reported Drugs4dent® was intuitive, and information was easy to locate. Most dentists preferred Drugs4dent® integrated with their dental practice software. In the absence of this functionality, they preferred Drugs4dent® as a standalone resource, without needing to input patient data. Drugs4dent® was subsequently commercialised with MIMS Australia, to create the decision support tool: MIMS Drugs4dent®. CONCLUSIONS Drugs4dent® is the first dental medicines decision tool in Australia. The high acceptability and usability of the tool, and subsequent commercialisation indicates that MIMS Drugs4dent® has substantial promise for the future, and can transform access to relevant drug information for Australian dentists.
Collapse
Affiliation(s)
- Leanne Teoh
- Melbourne Dental School, University of Melbourne, 720 Swanston Street, Carlton, VIC, Australia.
| | - Ruby Biezen
- Department of General Practice and Primary Care, University of Melbourne, Medical Building, Grattan Street, Melbourne, VIC, Australia
| | - Marietta Taylor
- Melbourne Dental School, University of Melbourne, 720 Swanston Street, Carlton, VIC, Australia
| | - Richard O Sinnott
- Melbourne eResearch Group, Faculty of Engineering and Information Technology, University of Melbourne, Level 5, Melbourne Connect, 700 Swanston Street, Melbourne, VIC, Australia
| | - Michael J McCullough
- Melbourne Dental School, University of Melbourne, 720 Swanston Street, Carlton, VIC, Australia
| |
Collapse
|
6
|
AlMahasis SO, Maurer MA. Development and implementation of a best practice alerting process for naloxone prescribing at rural community pharmacies in Wisconsin: A pilot study. J Am Pharm Assoc (2003) 2025; 65:102382. [PMID: 40023318 DOI: 10.1016/j.japh.2025.102382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2024] [Revised: 02/24/2025] [Accepted: 02/24/2025] [Indexed: 03/04/2025]
Abstract
BACKGROUND The opioid overdose epidemic continues to worsen in the United States, with opioid-related deaths increasing by 13 folds from 2000 to 2022 in Wisconsin. Naloxone, an opioid antagonist, can save lives by reversing opioid overdose in a matter of minutes. However, naloxone access and utilization remain suboptimal. OBJECTIVE This study examined the development and implementation of best practice alerting (BPA) processes within community pharmacies. This study assessed to what extent the BPA processes (1a) prompted pharmacists to discuss naloxone with high-risk patients; (1b) increased the number of naloxone prescriptions dispensed; and (2) evaluated the facilitators and barriers to implementing the BPA processes. METHODS A pilot study was conducted to develop and implement a BPA process in 3 rural community pharmacies in Wisconsin. The process involved staff identifying high-risk patients, initiating naloxone discussions, and offering naloxone prescriptions. Quantitative monthly data were recorded by pharmacies. Semi-structured interviews were conducted with one pharmacist from each pharmacy to assess the implementation process and outcomes. Descriptive statistics were used to analyze quantitative data. Interview transcripts were analyzed for key themes describing facilitators and barriers to the implementation process. RESULTS The naloxone alerting process resulted in a notable increase in naloxone discussions and naloxone prescriptions dispensed. Pharmacists reported that pharmacy staff buy-in and engagement, adequate staffing, developing meaningful partnerships, and using depersonalizing, destigmatizing, and normalizing approaches in discussing naloxone with patients were key facilitators. Key barriers included naloxone cost or co-payment and time constraints. CONCLUSION Implementing a BPA process in community pharmacies can notably increase naloxone prescribing for high-risk patients. Positive message framing, staffing, meaningful partnerships, and staff buy-in were key facilitators of implementation. Identified barriers were cost or co-payment and time constraints.
Collapse
|
7
|
Arnold P, Pinto Dos Santos D, Bamberg F, Kotter E. [FHIR - Overdue Standard for Radiology Data Warehouses.]. ROFO-FORTSCHR RONTG 2025; 197:518-525. [PMID: 39642924 DOI: 10.1055/a-2462-2351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/09/2024]
Abstract
In radiology, technological progress has led to an enormous increase in data volumes. To effectively use these data during diagnostics or subsequent clinical evaluations, they have to be aggregated at a central location and be meaningfully retrievable in context. Radiology data warehouses undertake this task: they integrate diverse data sources, enable patient-specific and examination-specific evaluations, and thus offer numerous benefits in patient care, education, and clinical research.The international standard Health Level 7 (HL7) Fast Healthcare Interoperability Resources (FHIR) is particularly suitable for the implementation of such a data warehouse. FHIR allows for easy and fast data access, supports modern web-based frontends, and offers high interoperability due to the integration of medical ontologies such as SNOMED-CT or RadLex. Furthermore, FHIR has a robust data security concept. Because of these properties, FHIR has been selected by the Medical Informatics Initiative (MII) as the data standard for the core data set and is intended to be promoted as an international standard in the European Health Data Space (EHDS).Implementing the FHIR standard in radiology data warehouses is therefore a logical and sensible step towards data-driven medicine. · A data warehouse is essential for data-driven medicine, clinical care, and research purposes.. · Data warehouses enable efficient integration of AI results and structured report templates.. · Fast Healthcare Interoperability Resources (FHIR) is a suitable standard for a data warehouse.. · FHIR provides an interoperable data standard, supported by proven web technologies.. · FHIR improves semantic consistency and facilitates secure data exchange.. · Arnold P, Pinto dos Santos D, Bamberg F et al. FHIR - Overdue Standard for Radiology Data Warehouses. Rofo 2025; 197: 518-524.
Collapse
Affiliation(s)
- Philipp Arnold
- Department of Radiology, Medical Center - University of Freiburg Department of Radiology, Freiburg, Germany
| | - Daniel Pinto Dos Santos
- Institute of Diagnostic and Interventional Radiology, University Hospital Cologne Institute of Diagnostic and Interventional Radiology, Cologne, Germany
- Department of Diagnostic and Interventional Radiology, University Medical Center of the Johannes Gutenberg University Mainz Department of Diagnostic and Interventional Radiology, Mainz, Germany
| | - Fabian Bamberg
- Department of Radiology, Medical Center - University of Freiburg Department of Radiology, Freiburg, Germany
| | - Elmar Kotter
- Department of Radiology, Medical Center - University of Freiburg Department of Radiology, Freiburg, Germany
| |
Collapse
|
8
|
Olomi GA, Manongi R, Makasi CE, Woodworth S, Mlay P, Yeates K, West N, Hirst JE, Mahande MJ, Mmbaga BT, Cansdale LG, Khashan AS. The mHealth clinical decision-making tools for maternal and perinatal health care in Sub-Saharan Africa: A systematic review. PLoS One 2025; 20:e0319510. [PMID: 40273054 PMCID: PMC12021198 DOI: 10.1371/journal.pone.0319510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 02/03/2025] [Indexed: 04/26/2025] Open
Abstract
INTRODUCTION mobile Health (mHealth) refers to use of mobile wireless technologies for health. The potential for mHealth to enhance healthcare delivery is supported by near-universal availability of mobile phones and their expanding coverage in low- and middle-income countries. This systematic review analyses the available evidence on mHealth clinical decision-making tools in maternal and perinatal health, and whether they lead to improved maternal and perinatal health outcomes in Sub-Saharan Africa (SSA). METHODS Eligibility criteria: Studies conducted in SSA describing mHealth tools piloted or used for clinical decision-making in maternal or perinatal healthcare. Exclusion criteria included mHealth tools used outside of maternal and perinatal healthcare, publications lacking sufficient detail (where information couldn't be obtained through contacting authors), articles where tools were used on a laptop or desktop computer, and articles not published in English. Data sources: PubMed, CINAHL, EMBASE, Global Health, and Web of Science were searched for relevant articles following a predetermined search strategy with no date restrictions. A limited grey literature search was conducted. Risk of bias: We assessed the quality of included studies using the Cochrane Risk of bias 2 tool, Newcastle- Ottawa scale and COREQ. This comprehensive approach ensured a rigorous evaluation of bias and validity in our systematic review. Data extraction and synthesis: Two independent reviewers screened articles and extracted data. RESULTS 1119 records were screened, and 36 articles met the inclusion criteria. Fifteen mHealth tools were identified across 11 SSA countries. CONCLUSION mHealth tools for clinical decision-making in maternal and perinatal care were found to be feasible, usable, and acceptable. They demonstrated adequate user satisfaction, and some demonstrated improvement of pregnancy outcomes. However, technologies lack scalability, with only one scaled up nationally, and few tools interacted with existing health information systems or had plans for sustainability. This review will help establish best practice for developing and scaling up mHealth clinical decision-making tools, helping to improve maternal and perinatal healthcare in SSA.
Collapse
Affiliation(s)
- Gaudensia A. Olomi
- School of Medicine, KCMC University, Moshi, Tanzania
- Health Department, Kilimanjaro Regional Adminstrative Secretary's Office, Moshi, Tanzania
- Kilimanjaro Clinical Research Institution, Moshi, Tanzania
| | | | - Charles E. Makasi
- School of Medicine, KCMC University, Moshi, Tanzania
- National Institute for Medical Research- Muhimbili Research Centre, Dar es Salaam, Tanzania,
| | - Simon Woodworth
- INFANT Research Centre, University College Cork, Cork, County Cork, Ireland
- Cork University Business School, University College Cork, Cork, County Cork, Ireland
| | - Pendo Mlay
- School of Medicine, KCMC University, Moshi, Tanzania
- Kilimanjaro Christian Medical Centre, Moshi, Tanzania
| | - Karen Yeates
- Department of Medicine, Queen’s University, Kingston, Ontario, Canada
| | - Nicola West
- Department of Medicine, Queen’s University, Kingston, Ontario, Canada
| | - Jane E. Hirst
- The George Institute for Global Health, Imperial College London, London, United Kingdom
- Nuffield Department of Women’s & Reproductive Health, University of Oxford, Oxford, United Kingdom
| | - Michael J. Mahande
- School of Medicine, KCMC University, Moshi, Tanzania
- Department of Epidemiology & Biostatistics, Kilimanjaro Christian Medical University College, Moshi, Tanzania
| | - Blandina T. Mmbaga
- School of Medicine, KCMC University, Moshi, Tanzania
- Kilimanjaro Clinical Research Institution, Moshi, Tanzania
- Kilimanjaro Christian Medical Centre, Moshi, Tanzania
| | | | - Ali S. Khashan
- INFANT Research Centre, University College Cork, Cork, County Cork, Ireland
- School of Public Health, University College Cork, Cork, County Cork, Ireland
| |
Collapse
|
9
|
Salatino A, Prével A, Caspar E, Bue SL. Influence of AI behavior on human moral decisions, agency, and responsibility. Sci Rep 2025; 15:12329. [PMID: 40210678 PMCID: PMC11986005 DOI: 10.1038/s41598-025-95587-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2024] [Accepted: 03/21/2025] [Indexed: 04/12/2025] Open
Abstract
There is a growing interest in understanding the effects of human-machine interaction on moral decision-making (Moral-DM) and sense of agency (SoA). Here, we investigated whether the "moral behavior" of an AI may affect both moral-DM and SoA in a military population, by using a task in which cadets played the role of drone operators on a battlefield. Participants had to decide whether or not to initiate an attack based on the presence of enemies and the risk of collateral damage. By combining three different types of trials (Moral vs. two No-Morals) in three blocks with three type of intelligent system support (No-AI support vs. Aggressive-AI vs. Conservative-AI), we showed that participants' decisions in the morally challenging situations were influenced by the inputs provided by the autonomous system. Furthermore, by measuring implicit and explicit agency, we found a significant increase in the SoA at the implicit level in the morally challenging situations, and a decrease in the explicit responsibility during the interaction with both AIs. These results suggest that the AI behavior influences human moral decision-making and alters the sense of agency and responsibility in ethical scenarios. These findings have implications for the design of AI-assisted decision-making processes in moral contexts.
Collapse
Affiliation(s)
- Adriana Salatino
- Department of Life Sciences, Royal Military Academy, Brussels, Belgium.
| | - Arthur Prével
- University of Lille, CNRS, UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, Lille, France
| | - Emilie Caspar
- The Moral & Social Brain Lab, Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Salvatore Lo Bue
- Department of Life Sciences, Royal Military Academy, Brussels, Belgium
| |
Collapse
|
10
|
Agarwal S, Chin WY, Vasudevan L, Henschke N, Tamrat T, Foss HS, Glenton C, Bergman H, Fønhus MS, Ratanaprayul N, Pandya S, Mehl GL, Lewin S. Digital tracking, provider decision support systems, and targeted client communication via mobile devices to improve primary health care. Cochrane Database Syst Rev 2025; 4:CD012925. [PMID: 40193137 PMCID: PMC11975193 DOI: 10.1002/14651858.cd012925.pub2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/09/2025]
Abstract
BACKGROUND Digital tracking on mobile devices, combined with clinical decision support systems and targeted client communication, can facilitate service delivery and potentially improve outcomes. OBJECTIVES To assess the effects of using a mobile device to track service use when combined with clinical decision support (Tracking + CDSS), with targeted client communications (Tracking + TCC), or both (Tracking + CDSS + TCC). SEARCH METHODS Cochrane CENTRAL, MEDLINE, Embase, Ovid Population Information Online (POPLINE), K4Health and WHO Global Health Library (2000 to November 2022). SELECTION CRITERIA Randomised and non-randomised trials in community/primary care settings. PARTICIPANTS primary care providers and clients Interventions: 1. Tracking + CDSS 2. Tracking + TCC 3. Tracking + CDSS + TCC Comparators: usual care (without digital tracking) DATA COLLECTION AND ANALYSIS: Two authors independently screened trials, extracted data and assessed risk of bias using the RoB 1 tool. We used a random-effects model to meta-analyse data producing risk differences (RD), risk ratios (RR), or odds ratios (OR) for dichotomous outcomes and mean differences (MD) for continuous outcomes. Evidence certainty was assessed using GRADE. MAIN RESULTS We identified 18 eligible studies (11 randomised, seven non-randomised) conducted in Bangladesh, China, Ethiopia, India, Kenya, Palestine, Uganda, and the USA. All non-randomised studies had a high risk of bias. These results are from randomised studies. 'Probably/may/uncertain' indicates 'moderate/low/very low' certainty evidence. Tracking + CDSS Relating to antenatal/ postnatal care: Providers' adherence to recommendations May slightly increase home visits in the week following delivery (2 studies, 4531 participants; RD 0.10 [0.07, 0.14]) May slightly increase counselling for initiating complementary feeding (2 studies, 4397 participants; RD 0.12 [0.08, 0.15]) May slightly increase the mean number of home visits in the month following delivery (1 study, 3023 participants; MD 0.75 [0.47, 1.03]) Uncertain effect on home visits within 24 hours of delivery Clients' health behaviours May slightly increase skin-to-skin care (1 study, 1544 participants; RD 0.05 [0.00, 0.10]) May slightly increase early breastfeeding (2 studies, 4540 participants; RD 0.08 [0.05, 0.12]) Uncertain effects on applying nothing to the umbilical cord, taking ≥ 90 iron-folate tablets during pregnancy, exclusively breastfeeding for six months, delaying the newborn's bath at least two days and Kangaroo Mother Care. Clients' health status May reduce low birthweight babies (1 study, 3023 participants; RR 0.53 [0.38, 0.73]) May increase infants with pneumonia or fever seeking care (1 study, 3470 participants; RR 1.13 [1.03, 1.24]) Uncertain effects on stillbirths, neonatal and infant deaths, or testing positive for HIV during antenatal testing Tracking + TCC Clients' health status In stroke patients over 12 months: May slightly increase blood pressure (BP) medication adherence (1 study, 1226 participants; RR 1.10 [1.00, 1.21]) May reduce deaths (1 study, 1226 participants; RR 0.52 [0.28, 0.96]) May slightly reduce systolic BP (1 study, 1226 participants; MD -2.80 mmHg [-4.90, -0.70]) May slightly improve EQ-5D scores (1 study, 1226 participants; MD 0.04 [0.02, 0.06]) May reduce stroke hospitalisations (1 study, 1226 participants; RR 0.45 [0.32, 0.64]). Tracking + CDSS + TCC Providers' adherence to recommendations Probably increases guideline adherence for antenatal screening and management of anaemia (1 study, 10,502 participants; OR 1.88 [1.52, 2.32]), diabetes (1 study, 8669 participants; OR 1.45 [1.14, 1.84}), hypertension (1 study, 15,555 participants; OR 1.62 [1.29, 2.04]) and probably leads to lower adherence for abnormal foetal growth (1 study, 1165 participants; OR 0.59 [0.37, 0.95]). May slightly increase nevirapine prophylaxis in infants of HIV+ve mothers (1 study, 609 participants; OR 1.75 [0.73, 4.19]) Data quality In pregnant women (1 study, 6367 participants), tracking + CDSS + TCC: Probably slightly reduces missing data for haemoglobin (RR 0.77 [0.71, 0.84]) but slightly more for BP at delivery (RR 1.16 [1.08, 1.24]) May have little or no effect on missing data on gestational age (RR 0.96 [0.81, 1.14]) or birthweight (RR 0.90 [0.77, 1.04]) Clients' health behaviour May have little or no effect on being on anti-retroviral therapy at delivery (1 study, 438 participants; OR 1.41 [0.81, 2.45]) or exclusive breastfeeding for six months (1 study, 695 participants; OR 1.74 [0.95, 3.17]) in HIV+ve mothers Uncertain effects on physical activity in high cardiovascular-risk adults Clients' health status May reduce the number of deaths in patients with hypertension and diabetes (1 study, 3698 participants; OR 0.61 [0.35, 1.06]) May reduce new cardiovascular events in high-cardiovascular risk adults over 6-18 months (1 study, 8642 participants; OR 0.58 [0.42, 0.80}) May slightly decrease in antenatal women severe hypertension, but the confidence interval includes both a decrease and increase (1 study, 6367 participants; OR 0.61 [0.27, 1.37]) In women receiving antenatal care (1 study, 6367 participants), tracking + CDSS + TCC maymake little or no difference to adverse pregnancy outcomes (OR 0.99 [0.87, 1.12]), moderate or severe anaemia (OR 0.82 [0.51, 1.31]), or large-for-gestational-age babies (OR 1.06 [0.90, 1.25]). In adults with hypertension or diabetes (1 study, 3324 participants), tracking + CDSS + TCC maymake little or no difference to HbA1c (MD 0.08 [-0.27, 0.43]), total cholesterol (MD -2.50 [-7.10, 2.10]), 10-year cardiovascular risk (MD -0.40 [-2.30, 1.50]), tobacco use (MD-0.05 [-0.47, 0.37]), alcohol use (MD 0.70 [-3.70, 5.10]), or PHQ-9 (MD -1.60 [-4.40, 1.20]). Uncertain effects on maternal or infant mortality before the baby reaches 18 months in HIV-positive mothers, patients who achieve optimal BP, BP controlled at five years, diastolic or systolic BP, body mass index, fasting glucose and quality of life in adults with hypertension or diabetes Client service utilisation May have little or no effect on missed early infant diagnosis visits (1 study, 1183 participants; OR 0.92 [0.63, 1.35]). Uncertain effects on linkage to care Client satisfaction Probably increases slightly the number of adults with hypertension or diabetes reporting "slightly/much better" change in the quality of care (1 study, 3324 participants; RR 1.02 [1.00, 1.03]). No studies evaluated time between presentation and appropriate management, timeliness of receiving/accessing care, provider acceptability/satisfaction, resource use, or unintended consequences. AUTHORS' CONCLUSIONS Digital tracking may improve primary care workers' ability to follow recommended antenatal and chronic disease practices, quality of patient records, patient health outcomes and service use. However, these interventions led to small or no outcome differences in most studies.
Collapse
Affiliation(s)
- Smisha Agarwal
- Center for Global Digital Health Innovation, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
| | - Weng Yee Chin
- Department of Family Medicine and Primary Care, The University of Hong Kong, Hong Kong, Hong Kong
| | - Lavanya Vasudevan
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, Georgia, USA
- Duke Global Health Institute, Duke University, Durham, North Carolina, USA
| | | | - Tigest Tamrat
- Department of Sexual and Reproductive Health and Research, which includes the UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), World Health Organization, Geneva , Switzerland
| | | | - Claire Glenton
- Western Norway University of Applied Sciences, Bergen, Norway
| | | | - Marita S Fønhus
- Norwegian National Advisory Unit on Learning and Mastery in Health, Oslo University Hospital, Oslo, Norway
| | - Natschja Ratanaprayul
- Department of Digital Health and Innovation, World Health Organization, Geneva, Switzerland
| | - Shivani Pandya
- Center for Global Digital Health Innovation, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
| | - Garrett L Mehl
- Department of Sexual and Reproductive Health, World Health Organization, Geneva , Switzerland
| | - Simon Lewin
- Department of Health Sciences Ålesund, Norwegian University of Science and Technology (NTNU), Ålesund, Norway
- Norwegian Institute of Public Health, Oslo, Norway
- Health Systems Research Unit, South African Medical Research Council , Cape Town, South Africa
| |
Collapse
|
11
|
Kandaswamy S, Yarahuan JKW, Dobler EA, Molloy MJ, Knake LA, Hernandez SM, Fallon AA, Hess LM, McCoy AB, Fortunov RM, Kirkendall ES, Muthu N, Orenstein EW, Dziorny AC, Chaparro JD. Alert design in the real world: a cross-sectional analysis of interruptive alerting at 9 academic pediatric health systems. J Am Med Inform Assoc 2025; 32:682-688. [PMID: 39903167 PMCID: PMC12005624 DOI: 10.1093/jamia/ocaf013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Revised: 01/07/2025] [Accepted: 01/13/2025] [Indexed: 02/06/2025] Open
Abstract
OBJECTIVE To assess the prevalence of recommended design elements in implemented electronic health record (EHR) interruptive alerts across pediatric care settings. MATERIALS AND METHODS We conducted a 3-phase mixed-methods cross-sectional study. Phase 1 involved developing a codebook for alert content classification. Phase 2 identified the most frequently interruptive alerts at participating sites. Phase 3 applied the codebook to classify alerts. Inter-rater reliability (IRR) for the codebook and descriptive statistics for alert design contents were reported. RESULTS We classified alert content on design elements such as the rationale for the alert's appearance, the hazard of ignoring it, directive versus informational content, administrative purpose, and whether it aligned with one of the Institute of Medicine's (IOM) domains of healthcare quality. Most design elements achieved an IRR above 0.7, with the exceptions for identifying directive content outside of an alert (IRR 0.58) and whether an alert was for administrative purposes only (IRR 0.36). IRR was poor for all IOM domains except equity. Institutions varied widely in the number of unique alerts and their designs. 78% of alerts stated their purpose, over half were directive, and 13% were informational. Only 2%-20% of alerts explained the consequences of inaction. DISCUSSION This study raises important questions about the optimal balance of alert functions and desirable features of alert representation. CONCLUSION Our study provides the first multi-center analysis of EHR alert design elements in pediatric care settings, revealing substantial variation in content and design. These findings underline the need for future research to experimentally explore EHR alert design best practices to improve efficiency and effectiveness.
Collapse
Affiliation(s)
- Swaminathan Kandaswamy
- Department of Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, United States
| | - Julia K W Yarahuan
- Department of Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, United States
- Division of Hospital Medicine, Children’s Healthcare of Atlanta, Atlanta, GA 30329, United States
| | - Elizabeth A Dobler
- Department of Clinical Informatics, Ann and Robert H Lurie Children's Hospital of Chicago, Chicago, IL 60611, United States
- Department of Pediatrics, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, United States
| | - Matthew J Molloy
- Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH 45221, United States
- Division of Hospital Medicine and Biomedical Informatics, Cincinnati Children’s Hospital Medical Center, Cincinnati, OH 45229, United States
| | - Lindsey A Knake
- Department of Pediatrics, Division of Neonatology, University of Iowa, Iowa City, IA 52242, United States
- Stead Family Children's Hospital, Iowa City, IA 52242, United States
| | - Sean M Hernandez
- Department of General Internal Medicine, Wake Forest School of Medicine, Winston-Salem, NC 27101, United States
- Primary Care, Miami Veteran’s Affairs, Miami, FL 33125, United States
| | - Anne A Fallon
- Division of Pediatric Hospital Medicine, Department of Pediatrics, University of Rochester Medical Center, Rochester, NY 14642, United States
| | - Lauren M Hess
- Department of Pediatrics, Baylor College of Medicine, Houston, TX 77030, United States
- Pediatric Hospital Medicine, Texas Children’s Hospital, Houston, TX 77030, United States
| | - Allison B McCoy
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37232, United States
| | - Regine M Fortunov
- Department of Pediatrics, Baylor College of Medicine, Houston, TX 77030, United States
- Division of Neonatology, Texas Children’s Hospital, Houston, TX 77030, United States
| | - Eric S Kirkendall
- Department of General Internal Medicine, Wake Forest School of Medicine, Winston-Salem, NC 27101, United States
- Department of Pediatrics, Wake Forest School of Medicine, Winston-Salem, NC 27101, United States
| | - Naveen Muthu
- Department of Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, United States
- Division of Hospital Medicine, Children’s Healthcare of Atlanta, Atlanta, GA 30329, United States
| | - Evan W Orenstein
- Department of Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, United States
- Division of Hospital Medicine, Children’s Healthcare of Atlanta, Atlanta, GA 30329, United States
| | - Adam C Dziorny
- Division of Pediatric Hospital Medicine, Department of Pediatrics, University of Rochester Medical Center, Rochester, NY 14642, United States
- Division of Critical Care Medicine, Golisano Children’s Hospital at Strong, Rochester, NY 14642, United States
| | - Juan D Chaparro
- Division of Clinical Informatics, Nationwide Children’s Hospital, Columbus, OH 43205, United States
- Department of Pediatrics, The Ohio State University College of Medicine, Columbus, OH 43210, United States
| |
Collapse
|
12
|
Ge J, Fontil V, Ackerman S, Pletcher MJ, Lai JC. Clinical decision support and electronic interventions to improve care quality in chronic liver diseases and cirrhosis. Hepatology 2025; 81:1353-1364. [PMID: 37611253 PMCID: PMC10998693 DOI: 10.1097/hep.0000000000000583] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Accepted: 07/17/2023] [Indexed: 08/25/2023]
Abstract
Significant quality gaps exist in the management of chronic liver diseases and cirrhosis. Clinical decision support systems-information-driven tools based in and launched from the electronic health record-are attractive and potentially scalable prospective interventions that could help standardize clinical care in hepatology. Yet, clinical decision support systems have had a mixed record in clinical medicine due to issues with interoperability and compatibility with clinical workflows. In this review, we discuss the conceptual origins of clinical decision support systems, existing applications in liver diseases, issues and challenges with implementation, and emerging strategies to improve their integration in hepatology care.
Collapse
Affiliation(s)
- Jin Ge
- Department of Medicine, Division of Gastroenterology and Hepatology, University of California – San Francisco, San Francisco, California, USA
| | - Valy Fontil
- Department of Medicine, NYU Grossman School of Medicine and Family Health Centers at NYU-Langone Medical Center, Brooklyn, New York, USA
| | - Sara Ackerman
- Department of Social and Behavioral Sciences, University of California – San Francisco, San Francisco, California, USA
| | - Mark J. Pletcher
- Department of Epidemiology and Biostatistics, University of California – San Francisco, San Francisco, California, USA
| | - Jennifer C. Lai
- Department of Medicine, Division of Gastroenterology and Hepatology, University of California – San Francisco, San Francisco, California, USA
| |
Collapse
|
13
|
Nkangu M, Tangang B, Pessa A, Weledji D, Obegu P, Kasonde M, Ngo NV, Wanda F, Gobina RM, Kibu O, Shiroya V, Foretia D, Jacobs C, Tassegning A, Fantaye AW, Nkengfac F, Muliokela RK, Tamrat T, Ratanaprayul N, Tabebot A, Yaya S. Integrating WHO's digital adaptation kit for antenatal care into BornFyne-PNMS: insights from Cameroon. Front Pharmacol 2025; 16:1474999. [PMID: 40206062 PMCID: PMC11978650 DOI: 10.3389/fphar.2025.1474999] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2024] [Accepted: 02/10/2025] [Indexed: 04/11/2025] Open
Abstract
Background Digital health innovations represent unique opportunities to address maternal, newborn, and child health challenges in Sub-Saharan Africa. In 2021, the World Health Organization (WHO) launched the Digital Adaptation Kits (DAKs) for antenatal care (ANC) as part of its Standards-Based, Machine-Readable, Adaptive, Requirements-Based, and Testable (SMART) guidelines approach. DAKs are operational and software-neutral mechanisms that convert WHO guidelines into standardized formats that can be easily integrated into digital systems by various countries. This article outlines the methodology for updating and integrating WHO DAK content into the BornFyne-prenatal management system (PNMS) version 2.0. Methods This study, which employs a participatory action research approach, is part of a larger research study for the BornFyne-PNMS project. A review of the ANC DAK operational document and data dictionaries was conducted to identify elements that were present in BornFyne-PNMS version 1.0. This was followed by a series of consultations and stakeholder meetings. Results Five stakeholder meetings were held to engage stakeholders across Cameroon. Some of the registration elements, among other DAK aspects of ANC service provision, were identified in BornFyne version 1.0 but required reorganizing, remodeling, and reanalyzing to align with the International Classification of Diseases codes and DAK data content as part of the expansion for BornFyne version 2.0. Up to 40% of the DAK dictionary data content existed within the BornFyne-PNMS version 1.0, including additional DAK content adapted to update BornFyne-PNMS version 2.0. The digital health ecosystem in Cameroon is in an emerging phase with an increasing demand for digital health technologies, especially in the areas of reproductive, maternal, newborn, child, and adolescent health. Conclusion The digital health ecosystem in Cameroon is in an emerging phase with an increasing demand for digital health technologies, especially in the area of reproductive, maternal, newborn, child, and adolescent health. This article describes and documents the steps in operationalization of the ANC DAK content into the BornFyne-PNMS content, highlighting the DAK as an important tool for guiding and facilitating software engineers in developing and integrating recommended ANC guidelines into digital platforms to facilitate interoperability, going by the structure of the document, its workflow processes, and content mapping elements.
Collapse
Affiliation(s)
- Miriam Nkangu
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, ON, Canada
- Bruyere Health Research Institute, Ottawa, ON, Canada
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
| | - Brice Tangang
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
| | - Arthur Pessa
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
| | | | - Pamela Obegu
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
| | - Mwenya Kasonde
- Liverpool School of Tropical Medicine, Liverpool, United Kingdom
| | - Ngo V. Ngo
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
- Nkafu Policy Institute of the Denis and Lenora Foretia Foundation Cameroon, Yaounde, Cameroon
| | - Franck Wanda
- The International Center for Research and Care (CIRES), Akonolinga, Cameroon
| | - Ronald M. Gobina
- Nkafu Policy Institute of the Denis and Lenora Foretia Foundation Cameroon, Yaounde, Cameroon
| | - Odette Kibu
- Nkafu Policy Institute of the Denis and Lenora Foretia Foundation Cameroon, Yaounde, Cameroon
| | - Veronica Shiroya
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
- Centre for Prevention and Digital Health, Medical Faculty Mannheim of Heidelberg University, Heidelberg, Germany
- Heidelberg Institute of Global Health, Heidelberg University Hospital, Heidelberg, Germany
- Alliance for Health Promotion, Geneva, Switzerland
| | - Denis Foretia
- Nkafu Policy Institute of the Denis and Lenora Foretia Foundation Cameroon, Yaounde, Cameroon
| | - Choolwe Jacobs
- School of Epidemiology and Public Health University of Zambia, Lusaka, Zambia
| | - Armel Tassegning
- Health Promotion Alliance Cameroon (HPAC), Yaounde, Cameroon
- The International Center for Research and Care (CIRES), Akonolinga, Cameroon
| | | | | | - Rosemary K. Muliokela
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Tigest Tamrat
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Natschja Ratanaprayul
- Department of Digital Health and Innovation, World Health Organization, Geneva, Switzerland
| | - Alice Tabebot
- Ministry of Public Health Cameroon, Yaounde, Cameroon
| | - Sanni Yaya
- The George Institute for Global Health, Imperial College London, London, United Kingdom
| |
Collapse
|
14
|
Yung KKY, Wu PPY, aus der Fünten K, Hecksteden A, Meyer T. Using a Bayesian network to classify time to return to sport based on football injury epidemiological data. PLoS One 2025; 20:e0314184. [PMID: 40112251 PMCID: PMC11925455 DOI: 10.1371/journal.pone.0314184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2024] [Accepted: 02/13/2025] [Indexed: 03/22/2025] Open
Abstract
The return-to-sport (RTS) process is multifaceted and complex, as multiple variables may interact and influence the time to RTS. These variables include intrinsic factors related the player, such as anthropometrics and playing position, or extrinsic factors, such as competitive pressure. Providing an individualised estimation of time to return to play is often challenging, and clinical decision support tools are not common in sports medicine. This study uses epidemiological data to demonstrate a Bayesian Network (BN). We applied a BN that integrated clinical, non-clinical factors, and expert knowledge to classify time day to RTS and injury severity (minimal, mild, moderate and severe) for individual players. Retrospective injury data of 3374 player seasons and 6143 time-loss injuries from seven seasons of the professional German football league (Bundesliga, 2014/2015 through 2020/2021) were collected from public databases and media resources. A total of twelve variables from three categories (player's characteristics and anthropometrics, match information and injury information) were included. The response variables were 1) days to RTS (1-3, 4-7, 8-14, 15-28, 29-60, > 60, and 2) injury severity (minimal, mild, moderate, and severe). The sensitivity of the model for days to RTS was 0.24-0.97, while for severity categories it was 0.73-1.00. The user's accuracy of the model for days to RTS was 0.52-0.83, while for severity categories, it was 0.67-1.00. The BN can help to integrate different data types to model the probability of an outcome, such as days to return to sport. In our study, the BN may support coaches and players in 1) predicting days to RTS given an injury, 2) team planning via assessment of scenarios based on players' characteristics and injury risk, and 3) understanding the relationships between injury risk factors and RTS. This study demonstrates the how a Bayesian network may aid clinical decision making for RTS.
Collapse
Affiliation(s)
- Kate K. Y. Yung
- Department of Orthopaedics and Traumatology, Faculty of Medicine, The Chinese University of Hong Kong, Shatin, Hong Kong
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
- Centre for Data Science, Queensland University of Technology, Brisbane, Queensland, Australia
- Institute of Sports and Preventive Medicine, Saarland University, Saarbrücken, Germany
| | - Paul P. Y. Wu
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland, Australia
- Centre for Data Science, Queensland University of Technology, Brisbane, Queensland, Australia
| | - Karen aus der Fünten
- Institute of Sports and Preventive Medicine, Saarland University, Saarbrücken, Germany
| | - Anne Hecksteden
- Institute of Sports Science, University of Innsbruck, Innsbruck, Austria
- Institute of Physiology, Medical University of Innsbruck, Innsbruck, Austria
| | - Tim Meyer
- Institute of Sports and Preventive Medicine, Saarland University, Saarbrücken, Germany
| |
Collapse
|
15
|
Chen X, Yu B, Zhang Y, Wang X, Huang D, Gong S, Hu W. A machine learning model based on emergency clinical data predicting 3-day in-hospital mortality for stroke and trauma patients. Front Neurol 2025; 16:1512297. [PMID: 40183016 PMCID: PMC11966482 DOI: 10.3389/fneur.2025.1512297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Accepted: 03/05/2025] [Indexed: 04/05/2025] Open
Abstract
Background Accurately predicting the short-term in-hospital mortality risk for patients with stroke and TBI (Traumatic Brain Injury) is crucial for improving the quality of emergency medical care. Method This study analyzed data from 2,125 emergency admission patients with stroke and traumatic brain injury at two Grade a hospitals in China from January 2021 to March 2024. LASSO regression was used for feature selection, and the predictive performance of logistic regression was compared with six machine learning algorithms. A 70:30 ratio was applied for cross-validation, and confidence intervals were calculated using the bootstrap method. Temporal validation was performed on the best-performing model. SHAP values were employed to assess variable importance. Results The random forest algorithm excelled in predicting in-hospital 3-day mortality, achieving an AUC of 0.978 (95% CI: 0.966-0.986). Time series validation demonstrated the model's strong generalization capability, with an AUC of 0.975 (95% CI: 0.963-0.986). Key predictive factors in the final model included metabolic syndrome, NEWS2 score, Glasgow Coma Scale (GCS), whether surgery was performed, bowel movement status, potassium level (K), aspartate transaminase (AST) level, and temporal factors. SHAP value analysis further confirmed the significant contributions of these variables to the predictive outcomes. The random forest model developed in this study demonstrates good accuracy in predicting short-term in-hospital mortality rates for stroke and traumatic brain injury patients. The model integrates emergency scores, clinical signs, and key biochemical indicators, providing a comprehensive perspective for risk assessment. This approach, which incorporates emergency data, holds promise for assisting decision-making in clinical practice, thereby improving patient outcomes.
Collapse
Affiliation(s)
- Xu Chen
- Shangrao People's Hospital, Shangrao, China
| | - Bin Yu
- Shangrao People's Hospital, Shangrao, China
| | | | - Xin Wang
- Huaian Hospital of Huaian City, Huai'an, China
| | | | | | - Wei Hu
- School of Nursing, Jinzhou Medical University, Jinzhou, China
| |
Collapse
|
16
|
Schuler K, Jung IC, Zerlik M, Hahn W, Sedlmayr M, Sedlmayr B. Context factors in clinical decision-making: a scoping review. BMC Med Inform Decis Mak 2025; 25:133. [PMID: 40098142 PMCID: PMC11912758 DOI: 10.1186/s12911-025-02965-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Accepted: 03/10/2025] [Indexed: 03/19/2025] Open
Abstract
BACKGROUND Clinical decision support systems (CDSS) frequently exhibit insufficient contextual adaptation, diminishing user engagement. To enhance the sensitivity of CDSS to contextual conditions, it is crucial first to develop a comprehensive understanding of the context factors influencing the clinical decision-making process. Therefore, this study aims to systematically identify and provide an extensive overview of contextual factors affecting clinical decision-making from the literature, enabling their consideration in the future implementation of CDSS. METHODS A scoping review was conducted following the PRISMA-ScR guidelines to identify context factors in the clinical decision-making process. Searches were performed across nine databases: PubMed, APA PsycInfo, APA PsyArticles, PSYINDEX, CINAHL, Scopus, Embase, Web of Science, and LIVIVO. The search strategy focused on combined terms related to contextual factors and clinical decision-making. Included articles were original research articles written in English or German that involved empirical investigations related to clinical decision-making. The identified context factors were categorized using the card sorting method to ensure accurate classification. RESULTS The data synthesis included 84 publications, from which 946 context factors were extracted. These factors were assigned to six primary entities through card sorting: patient, physician, patient's family, institution, colleagues, and disease treatment. The majority of the identified context factors pertained to individual characteristics of the patient, such as health status and demographic attributes, as well as individual characteristics of the physician, including demographic data, skills, and knowledge. CONCLUSION This study provides a comprehensive overview of context factors in clinical decision-making previously investigated in the literature, highlighting the complexity and diversity of contextual influences on the decision-making process. By offering a detailed foundation of identified context factors, this study paves the way for future research to develop more effective, context-sensitive CDSS, enhancing personalized medicine and optimizing clinical outcomes with implications for practice and policy.
Collapse
Affiliation(s)
- Katharina Schuler
- Institute for Medical Informatics and Biometry, Faculty of Medicine, University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany.
| | - Ian-C Jung
- Institute for Medical Informatics and Biometry, Faculty of Medicine, University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
| | - Maria Zerlik
- Institute for Medical Informatics and Biometry, Faculty of Medicine, University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
| | - Waldemar Hahn
- Institute for Medical Informatics and Biometry, Faculty of Medicine, University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
- Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), Dresden/Leipzig, Dresden, Germany
| | - Martin Sedlmayr
- Institute for Medical Informatics and Biometry, Faculty of Medicine, University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Faculty of Medicine, University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
| |
Collapse
|
17
|
Bosserman LD, Lin Y, Shayani S, Moore B, Morse D, Enwere E, Trisal V, Samara W. Teams, Tools, Processes and Resources to Manage Oncologic Clinical Decision Support: Lessons Learned from City of Hope's Multistate, Academic, and Community Oncology Enterprise. J Clin Med 2025; 14:2048. [PMID: 40142855 PMCID: PMC11943330 DOI: 10.3390/jcm14062048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2024] [Revised: 02/19/2025] [Accepted: 03/10/2025] [Indexed: 03/28/2025] Open
Abstract
Background/Objectives: Clinical decision support systems (CDSSs) consisting of Computerized Physician Order Entry (CPOE) and oncology pathways serve as the foundation of high-quality cancer care. However, the resources needed to develop and maintain these systems have not been characterized for oncology enterprises. Methods: Executive leadership appointed a medical director and clinical pharmacist to develop and lead a Pathways and Protocols Program for the City of Hope (COH) enterprise. This involved developing a program charter and governance committee and a business case for resources to support CPOE in our Epic Beacon treatment orders. Missing CPOEs for oncology treatments were identified for treatments in COH's Elsevier ClinicalPath treatment pathways and for those few diseases not in the pathways for medical oncology and hematology. New FDA oncology drug approvals were used to estimate ongoing CPOE build needs. Time estimates for Beacon analysts to build Beacon protocols were developed from a prior CPOE catch-up project, from informal surveys of our clinical pharmacists and Beacon leads, and surveys of staff leads at two other large, multisite cancer programs using Epic. Informal surveys of oncology clinicians and pharmacists were carried out to understand the time they were using to build Beacon orders that were not in the COH system. This information was used to build a business case for additional project management and staffing to catch up on building 400 missing Beacon orders, to maintain Beacon orders as new therapies and regimens are needed, and to provide required regulatory oversight of Beacon orders. Given these standards had not been shared by others, this work was gathered into a manuscript to help others evaluate and support needed resources to manage oncology pathway programs and CPOE to improve efficiencies, safety, and quality of care for medical oncology and hematology programs. Results: A Pathways and Protocols program was developed with a governance committee, a program charter, and a charge for disease committees to prioritize, approve, and oversee the regulation of COH's Beacon treatment orders. CPOE resources to catch up and maintain COH's Beacon treatment orders were developed and shared with COH's executive leadership. Informal surveys were completed to benchmark Beacon resources with COH and two other Beacon enterprises as well as to estimate the time used by COH clinicians to build Beacon orders for orders not in the system. Conclusions: The resources for managing clinical oncology pathways and CPOE for an enterprise have not previously been published. Work components identified from our work at COH are shared so that other oncology leaders might have a starting framework to evaluate their own CDSS needs for oncology pathways and CPOE.
Collapse
Affiliation(s)
- Linda D. Bosserman
- Department of Medical Oncology and Research Therapeutics, City of Hope, Duarte, CA 91010, USA
| | - YiHsuan Lin
- Department of Pharmacy, City of Hope, Duarte, CA 91010, USA; (Y.L.); (S.S.); (W.S.)
| | - Sepideh Shayani
- Department of Pharmacy, City of Hope, Duarte, CA 91010, USA; (Y.L.); (S.S.); (W.S.)
| | - Brian Moore
- Department of Physician Services, City of Hope, Duarte, CA 91010, USA;
| | - Denise Morse
- Department of Quality, City of Hope, Duarte, CA 91010, USA;
| | - Emmanuel Enwere
- Department of IT Pharmacy Oncology Systems, City of Hope, Duarte, CA 91010, USA;
| | - Vijay Trisal
- Department of Surgery, City of Hope, Duarte, CA 91010, USA;
| | - Wafa Samara
- Department of Pharmacy, City of Hope, Duarte, CA 91010, USA; (Y.L.); (S.S.); (W.S.)
| |
Collapse
|
18
|
Düvel JA, Lampe D, Kirchner M, Elkenkamp S, Cimiano P, Düsing C, Marchi H, Schmiegel S, Fuchs C, Claßen S, Meier KL, Borgstedt R, Rehberg S, Greiner W. An AI-Based Clinical Decision Support System for Antibiotic Therapy in Sepsis (KINBIOTICS): Use Case Analysis. JMIR Hum Factors 2025; 12:e66699. [PMID: 40036494 PMCID: PMC11896086 DOI: 10.2196/66699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Revised: 11/22/2024] [Accepted: 12/31/2024] [Indexed: 03/06/2025] Open
Abstract
Background Antimicrobial resistances pose significant challenges in health care systems. Clinical decision support systems (CDSSs) represent a potential strategy for promoting a more targeted and guideline-based use of antibiotics. The integration of artificial intelligence (AI) into these systems has the potential to support physicians in selecting the most effective drug therapy for a given patient. Objective This study aimed to analyze the feasibility of an AI-based CDSS pilot version for antibiotic therapy in sepsis patients and identify facilitating and inhibiting conditions for its implementation in intensive care medicine. Methods The evaluation was conducted in 2 steps, using a qualitative methodology. Initially, expert interviews were conducted, in which intensive care physicians were asked to assess the AI-based recommendations for antibiotic therapy in terms of plausibility, layout, and design. Subsequently, focus group interviews were conducted to examine the technology acceptance of the AI-based CDSS. The interviews were anonymized and evaluated using content analysis. Results In terms of the feasibility, barriers included variability in previous antibiotic administration practices, which affected the predictive ability of AI recommendations, and the increased effort required to justify deviations from these recommendations. Physicians' confidence in accepting or rejecting recommendations depended on their level of professional experience. The ability to re-evaluate CDSS recommendations and an intuitive, user-friendly system design were identified as factors that enhanced acceptance and usability. Overall, barriers included low levels of digitization in clinical practice, limited availability of cross-sectoral data, and negative previous experiences with CDSSs. Conversely, facilitators to CDSS implementation were potential time savings, physicians' openness to adopting new technologies, and positive previous experiences. Conclusions Early integration of users is beneficial for both the identification of relevant context factors and the further development of an effective CDSS. Overall, the potential of AI-based CDSSs is offset by inhibiting contextual conditions that impede its acceptance and implementation. The advancement of AI-based CDSSs and the mitigation of these inhibiting conditions are crucial for the realization of its full potential.
Collapse
Affiliation(s)
- Juliane Andrea Düvel
- Centre for electronic Public Health Research (CePHR), School of Public Health, Bielefeld University, P.O. Box 10 01 31, Bielefeld, D-33501, Germany, 49 521-106-2648
| | - David Lampe
- AG 5 - Health Economics and Health Care Management, School of Public Health, Bielefeld University, Bielefeld, Germany
| | - Maren Kirchner
- AG 5 - Health Economics and Health Care Management, School of Public Health, Bielefeld University, Bielefeld, Germany
| | - Svenja Elkenkamp
- AG 5 - Health Economics and Health Care Management, School of Public Health, Bielefeld University, Bielefeld, Germany
| | - Philipp Cimiano
- AG Semantic Computing, Technical Faculty, Bielefeld University, Bielefeld, Germany
| | - Christoph Düsing
- AG Semantic Computing, Technical Faculty, Bielefeld University, Bielefeld, Germany
| | - Hannah Marchi
- Data Science Group, Faculty of Business Administration and Economics, Bielefeld University, Bielefeld, Germany
| | - Sophie Schmiegel
- Data Science Group, Faculty of Business Administration and Economics, Bielefeld University, Bielefeld, Germany
| | - Christiane Fuchs
- Data Science Group, Faculty of Business Administration and Economics, Bielefeld University, Bielefeld, Germany
| | - Simon Claßen
- Department of Anaesthesiology, Surgical Intensive Care, Emergency Medicine, and Pain Therapy, Hospital Bielefeld, University Hospital Bielefeld, Bielefeld, Germany
| | - Kirsten-Laura Meier
- Department of Anaesthesiology, Surgical Intensive Care, Emergency Medicine, and Pain Therapy, Hospital Bielefeld, University Hospital Bielefeld, Bielefeld, Germany
| | - Rainer Borgstedt
- Department of Anaesthesiology, Intensive Care, Emergency Medicine, Transfusion Medicine and Pain Therapy, Campus Bielefeld-Bethel, University Hospital Bielefeld, Bielefeld, Germany
| | - Sebastian Rehberg
- Department of Anaesthesiology, Intensive Care, Emergency Medicine, Transfusion Medicine and Pain Therapy, Campus Bielefeld-Bethel, University Hospital Bielefeld, Bielefeld, Germany
| | - Wolfgang Greiner
- AG 5 - Health Economics and Health Care Management, School of Public Health, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
19
|
Wang C, Liu X, Zhang C, Yan R, Li Y, Peng X. The challenges for developing prognostic prediction models for acute kidney injury in hospitalized children: A systematic review. Pediatr Investig 2025; 9:70-81. [PMID: 40241889 PMCID: PMC11998178 DOI: 10.1002/ped4.12458] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Accepted: 09/25/2024] [Indexed: 04/18/2025] Open
Abstract
Importance Acute kidney injury (AKI) is common in hospitalized children which could rapidly progress into chronic kidney disease if not timely diagnosed. Prognostic prediction models for AKI were established to identify AKI early and improve children's prognosis. Objective To appraise prognostic prediction models for pediatric AKI. Methods Four English and four Chinese databases were systematically searched from January 1, 2010, to June 6, 2022. Articles describing prognostic prediction models for pediatric AKI were included. The data extraction was based on the CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies checklist. The risk of bias (ROB) was assessed according to the Prediction model Risk of Bias Assessment Tool guideline. The quantitative synthesis of the models was not performed due to the lack of methods regarding the meta-analysis of prediction models. Results Eight studies with 16 models were included. There were significant deficiencies in reporting and all models were considered at high ROB. The area under the receiver operating characteristic curve to predict AKI ranged from 0.69 to 0.95. However, only about one-third of models have completed internal or external validation. The calibration was provided only in four models. Three models allowed easy bedside calculation or electronic automation, and two models were evaluated for their impacts on clinical practice. Interpretation Besides the modeling algorithm, the challenges for developing prediction models for pediatric AKI reflected by the reporting deficiencies included ways of handling baseline serum creatinine and age-dependent blood biochemical indexes. Moreover, few prediction models for pediatric AKI were performed for external validation, let alone the transformation in clinical practice. Further investigation should focus on the combination of prediction models and electronic automatic alerts.
Collapse
Affiliation(s)
- Chen Wang
- Center for Clinical Epidemiology and Evidence‐based MedicineBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
- Outpatient DepartmentBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| | - Xiaohang Liu
- Center for Clinical Epidemiology and Evidence‐based MedicineBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| | - Chao Zhang
- Center for Clinical Epidemiology and Evidence‐based MedicineBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| | - Ruohua Yan
- Center for Clinical Epidemiology and Evidence‐based MedicineBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| | - Yuchuan Li
- Outpatient DepartmentBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| | - Xiaoxia Peng
- Center for Clinical Epidemiology and Evidence‐based MedicineBeijing Children's Hospital, Capital Medical University, National Center for Children's HealthBeijingChina
| |
Collapse
|
20
|
Schmidt SK, Dexheimer JW, Zorc JJ, Palmer CA, Casper TC, Stukus KS, Pickett ML, Mollen CJ, Elsholz CL, Cruz AT, Augustine EM, Goyal MK, Reed JL. Multisite Implementation of a Sexual Health Survey and Clinical Decision Support to Promote Adolescent Sexually Transmitted Infection Screening. Appl Clin Inform 2025; 16:283-294. [PMID: 39572251 PMCID: PMC11964718 DOI: 10.1055/a-2480-4628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2024] [Accepted: 11/20/2024] [Indexed: 04/04/2025] Open
Abstract
BACKGROUND Adolescents are at high risk for sexually transmitted infections (STIs) and frequently present to emergency departments (EDs) for care. Screening for STIs using confidential patient-reported outcomes represents an ideal use of electronic screening methodology. OBJECTIVES The objectives of this study were to implement a patient-facing, confidential electronic survey to assess adolescent risk for STIs and consent for testing with integrated provider-facing electronic clinical decision support (CDS) across six geographically dispersed pediatric EDs and evaluate implementation based on survey and CDS usage metrics. METHODS A pilot site provided code for the electronic survey, data query, and CDS templates to six EDs. Institutions identified necessary information technology (IT) personnel, completed the local build, and made modifications to suit individual site workflow variations with all sites successfully deploying the electronic survey with electronic health record (EHR)-embedded CDS. RESULTS Out of 79,780 eligible adolescents, 6,165 adolescents completed the confidential health survey between April 12, 2021 and September 25, 2022. The CDS was triggered indicating the patient was at risk or consented to STI testing across all six sites 2,058 times. The average percentage of time the CDS was acknowledged by a provider was 81.6% (range 45.7-97.6%). The median number of providers who acknowledged each instance of the CDS was 2.0. STI testing was ordered from the CDS on average 47.3% of the time. CDS acknowledged selection of "other" and "[testing] already ordered" was the most frequent indication STI testing was not ordered from the CDS. CONCLUSION Successful deployment of patient-facing screeners with integrated electronic CDS across multiple healthcare institutions is feasible. A combination of different types of IT and informatics expertise with local knowledge of clinical workflows is essential to success.
Collapse
Affiliation(s)
- Sarah K. Schmidt
- Division of Emergency Medicine, Department of Pediatrics, Children's Hospital Colorado, University of Colorado School of Medicine, Aurora, Colorado, United States
| | - Judith W. Dexheimer
- Divisions of Emergency Medicine and Biomedical Informatics, Cincinnati Children's Hospital Medical Center; Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States
| | - Joseph J. Zorc
- Division of Emergency Medicine, Department of Pediatrics, Children's Hospital of Philadelphia, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Chella A. Palmer
- University of Utah School of Medicine, Salt Lake City, Utah, United States
| | - T Charles Casper
- University of Utah School of Medicine, Salt Lake City, Utah, United States
| | - Kristin S. Stukus
- Division of Emergency Medicine, Nationwide Children's Hospital, Ohio State University College of Medicine, Columbus, Ohio, United States
| | - Michelle L. Pickett
- Division of Pediatric Emergency Medicine, Medical College of Wisconsin, Milwaukee, Wisconsin, United States
| | - Cynthia J. Mollen
- Division of Emergency Medicine, Department of Pediatrics, Children's Hospital of Philadelphia, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Cara L. Elsholz
- University of Utah School of Medicine, Salt Lake City, Utah, United States
| | - Andrea T. Cruz
- Divisions of Pediatric Emergency Medicine and Pediatric Infectious Diseases, Department of Pediatrics, Baylor College of Medicine, Houston, Texas, United States
| | - Erin M. Augustine
- Division of Emergency Medicine, Department of Pediatrics, Ann & Robert H. Lurie Children's Hospital, Northwestern University Feinberg School of Medicine, Chicago, Illinois, United States
| | - Monika K. Goyal
- Division of Emergency Medicine, Department of Pediatrics, Children's National Hospital, George Washington University, Washington, District of Columbia, United States
| | - Jennifer L. Reed
- Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center; Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States
| |
Collapse
|
21
|
Block SJ, Sisson LN, Taban Y, Triece T, Sherman SG, Schneider KE, Owczarzak J. "We can't change that while they're in the hospital": Unveiling the manifestations of infrastructural violence and wound care for people who inject drugs. THE INTERNATIONAL JOURNAL OF DRUG POLICY 2025; 137:104716. [PMID: 39842393 DOI: 10.1016/j.drugpo.2025.104716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Revised: 12/04/2024] [Accepted: 01/15/2025] [Indexed: 01/24/2025]
Abstract
Healthcare avoidance or delays for wounds and related skin- and soft-tissue infections are often attributed to negative interactions with medical providers. An infrastructural violence framework posits that healthcare infrastructure serves as a material channel for structural violence, maintaining inequities in healthcare experiences and outcomes. Infrastructural violence ensues when infrastructure is designed for some members or groups within a society while perpetuating violence among others. This study draws on the concept to understand how healthcare infrastructure creates and perpetuates inequities within the healthcare system for people who inject drugs for their wound care-related needs. Between January and September 2023, semi-structured interviews were conducted with 12 medical providers in Maryland. An abductive thematic analysis approach was followed. Healthcare infrastructure mediated the relationship between structural factors, such as policies on prescribing privileges of medications for opioid use disorder and subsequent individual health experiences. Medical providers also described how their access to training, protocols, and other resources was insufficient to meet the needs of people who inject drugs presenting to healthcare settings for wound care. A new conceptual grounding provides recommendations on extending beyond medical provider behavior change interventions in healthcare settings to create supportive infrastructure, which includes readily available and accessible policies, protocols, and resources to care for this patient population.
Collapse
Affiliation(s)
- Suzanne J Block
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States.
| | - Laura N Sisson
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States
| | - Yasemin Taban
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States
| | - Tricia Triece
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States
| | - Susan G Sherman
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States
| | - Kristin E Schneider
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States
| | - Jill Owczarzak
- Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, 615 N Wolfe Street, Baltimore, MD 21205, United States
| |
Collapse
|
22
|
Rudin RS, Herman PM, Vining R. Addressing the "Black Hole" of Low Back Pain Care With Clinical Decision Support: User-Centered Design and Initial Usability Study. JMIR Form Res 2025; 9:e66666. [PMID: 39903908 PMCID: PMC11813196 DOI: 10.2196/66666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2024] [Revised: 12/02/2024] [Accepted: 12/03/2024] [Indexed: 02/06/2025] Open
Abstract
Background Low back pain (LBP) is a highly prevalent problem causing substantial personal and societal burden. Although there are specific types of LBP, each with evidence-based treatment recommendations, most patients receive a nonspecific diagnosis that does not facilitate evidence-based and individualized care. objectives We designed, developed, and initially tested the usability of a LBP diagnosis and treatment decision support tool based on the available evidence for use by clinicians who treat LBP, with an initial focus on chiropractic care. Methods Our 3-step user-centered design approach consisted of identifying clinical requirements through the analysis of evidence reviews, iteratively identifying task-based user requirements and developing a working web-based prototype, and evaluating usability through scenario-based interviews and the System Usability Scale. Results The 5 participating users had an average of 18.5 years of practicing chiropractic medicine. Clinical requirements included 44 patient interview and examination items. Of these, 13 interview items were enabled for all patients and 13 were enabled conditional on other input items. One examination item was enabled for all patients and 16 were enabled conditional on other items. One item was a synthesis of interview and examination items. These items provided evidence of 12 possible working diagnoses of which 3 were macrodiagnoses and 9 were microdiagnoses. Each diagnosis had relevant treatment recommendations and corresponding patient educational materials. User requirements focused on tasks related to inputting data, and reviewing and selecting working diagnoses, treatments, and patient education. User input led to key refinements in the design, such as organizing the input questions by microdiagnosis, adding a patient summary screen that persists during data input and when reviewing output, adding more information buttons and graphics to input questions, and providing traceability by highlighting the input items used by the clinical logic to suggest a working diagnosis. Users believed that it would be important to have the tool accessible from within an electronic health record for adoption within their workflows. The System Usability Scale score for the prototype was 84.75 (range: 67.5-95), considered as the top 10th percentile. Users believed that the tool was easy to use although it would require training and practice on the clinical content to use it effectively. With such training and practice, users believed that it would improve care and shed light on the "black hole" of LBP diagnosis and treatment. Conclusions Our systematic process of defining clinical requirements and eliciting user requirements to inform a clinician-facing decision support tool produced a prototype application that was viewed positively and with enthusiasm by clinical users. With further planned development, this tool has the potential to guide clinical evaluation, inform more specific diagnosis, and encourage patient education and individualized treatment planning for patients with LBP through the application of evidence at the point of care.
Collapse
Affiliation(s)
- Robert S Rudin
- RAND, 20 Park Plaza, Suite 910, Boston, MA, 02116, United States, 1 6173382059 ext 8636, 1 6173577470
| | | | - Robert Vining
- Palmer Center for Chiropractic Research, Palmer College of Chiropractic, Davenport, IA, United States
| |
Collapse
|
23
|
Baker H, Fine R, Suter F, Allore H, Hsiao B, Chowdhary V, Lavelle E, Chen P, Hintz R, Suter LG, Danve A. Implementation of a Best Practice Advisory to Improve Infection Screening Prior to New Prescriptions of Biologics and Targeted Synthetic Drugs. Arthritis Care Res (Hoboken) 2025; 77:273-281. [PMID: 37382043 DOI: 10.1002/acr.25181] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 06/07/2023] [Accepted: 06/27/2023] [Indexed: 06/30/2023]
Abstract
OBJECTIVE Use of biologic and targeted synthetic disease-modifying antirheumatic drugs (b/tsDMARDs) in patients with preexisting tuberculosis (TB), hepatitis B virus (HBV), or hepatitis C virus (HCV) infection can have serious consequences. Although various society guidelines recommend routine screening for these infections before initiating certain b/tsDMARDs, adherence to these recommendations varies widely. This quality improvement initiative evaluated local compliance with screening and assessed whether an automated computerized decision support system in the form of a best practice advisory (BPA) in the electronic health record could improve patient screening. METHODS Established patients with autoimmune rheumatic disease (ARD) aged 18 years or older with at least one visit to our rheumatology practice between October 1, 2017, and March 3, 2022, were included. When prescribing a new b/tsDMARD, clinicians were alerted via a BPA that showed the most recent results for TB, HBV, and HCV. Screening proportions for TB, HBV, and HCV before BPA initiation were compared with those of eligible patients after the BPA implementation. RESULTS A total of 711 patients pre-BPA and 257 patients post-BPA implementation were included in the study. The BPA implementation was associated with statistically significant improvement in screening for TB from 66% to 82% (P ≤ 0.001), HCV from 60% to 79% (P ≤ 0.001), hepatitis B core antibody 32% to 51% (P ≤ 0.001), and hepatitis B surface antigen from 51% to 70% (P ≤ 0.001). CONCLUSION Implementation of a BPA can improve infectious disease screening for patients with ARD who are started on b/tsDMARDs and has potential to improve patient safety.
Collapse
Affiliation(s)
- Hailey Baker
- Yale New Haven Health System, New Haven, Connecticut
| | - Rebecca Fine
- Yale New Haven Health System, New Haven, Connecticut
| | | | | | | | | | | | - Ping Chen
- Yale New Haven Hospital, New Haven, Connecticut
| | | | - Lisa G Suter
- Yale University and West Haven Veterans Affairs Medical Center, New Haven, Connecticut
| | | |
Collapse
|
24
|
Luxenburg O, Vaknin S, Wilf-Miron R, Saban M. Evaluating the Accuracy and Impact of the ESR-iGuide Decision Support Tool in Optimizing CT Imaging Referral Appropriateness. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2025; 38:357-367. [PMID: 39028357 PMCID: PMC11811312 DOI: 10.1007/s10278-024-01197-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2024] [Revised: 07/01/2024] [Accepted: 07/02/2024] [Indexed: 07/20/2024]
Abstract
Radiology referral quality impacts patient care, yet factors influencing quality are poorly understood. This study assessed the quality of computed tomography (CT) referrals, identified associated characteristics, and evaluated the ESR-iGuide clinical decision support tool's ability to optimize referrals. A retrospective review analyzed 300 consecutive CT referrals from an acute care hospital. Referral quality was evaluated on a 5-point scale by three expert reviewers (inter-rater reliability κ = 0.763-0.97). The ESR-iGuide tool provided appropriateness scores and estimated radiation exposure levels for the actual referred exams and recommended exams. Scores were compared between actual and recommended exams. Associations between ESR-iGuide scores and referral characteristics, including the specialty of the ordering physician (surgical vs. non-surgical), were explored. Of the referrals, 67.1% were rated as appropriate. The most common exams were head and abdomen/pelvis CTs. The ESR-iGuide deemed 70% of the actual referrals "usually appropriate" and found that the recommended exams had lower estimated radiation exposure compared to the actual exams. Logistic regression analysis showed that non-surgical physicians were more likely to order inappropriate exams compared to surgical physicians. Over one-third of the referrals showed suboptimal quality in the unstructured system. The ESR-iGuide clinical decision support tool identified opportunities to optimize appropriateness and reduce radiation exposure. Implementation of such a tool warrants consideration to improve communication and maximize patient care quality.
Collapse
Affiliation(s)
- Osnat Luxenburg
- Medical Technology, Health Information and Research Directorate, Ministry of Health, Jerusalem, Israel
| | - Sharona Vaknin
- The Gertner Institute for Health Policy and Epidemiology, Ramat-Gan, Israel
| | - Rachel Wilf-Miron
- Department of Health Promotion, School of Public Health, Faculty of Medical & Health Sciences, Tel Aviv University, Tel Aviv, Israel
| | - Mor Saban
- School of Health Professions, Faculty of Medical & Health Sciences, Tel-Aviv University, Tel-Aviv-Yafo, Israel.
| |
Collapse
|
25
|
Fakih A. The Effect of Clinical Decision Support Tools on Physicians' Practices. THE JOURNAL OF THE ASSOCIATION OF PHYSICIANS OF INDIA 2025; 73:26-30. [PMID: 39927994 DOI: 10.59556/japi.73.0706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/11/2025]
Abstract
OBJECTIVE The objective of this research is to assess the impact of clinical decision support (CDS) tools on the practices of Indian physicians. METHODS Descriptive statistics and frequency distributions are used to assess the data. RESULTS Through a primary survey, it was found that about 69% of the physicians frequently use clinical decision tools in their practice. The author found that the clinical decision tools affect 1-5 decisions every week (for about 54% of the sample). Nonetheless, a great many (31%) stated that they do not use the tools frequently; therefore, none of their decisions are affected by the technology on a usual basis. There is a slight improvement in diagnosis post the use of the app. Although 46% of doctors stated that they have made zero errors in decision making post the use of the application, 54% admitted making errors in 1-5 decisions per week. This shows that the tool has not been able to address all the needs of the doctors. A great many agreed that the tool helped in reducing diagnostic tests. Although a majority of doctors stated that they order fewer than five diagnostic tests post the use of the application, a great many doctors agreed that they order >10 tests after using the application. This could be due to less faith in the technology or could be an attribute of a small sample. The author intended to assess whether clinical decision tools are cost-effective. The author found that not all decision tools are cost-effective. The variation could be due to differences in comprehensiveness of information, product features, and area of practice. CONCLUSION This study exhibits that there is less faith in the technology and the application is favored by younger doctors. By and large, doctors agreed that the tool provides quicker diagnosis and is user-friendly.
Collapse
Affiliation(s)
- Amrin Fakih
- Research Scholar, Department of Centre for Research in Urban Affairs, Institute for Social and Economic Change, Bengaluru, Karnataka, India, Corresponding Author
| |
Collapse
|
26
|
Graber J, Hinrichs-Kinney LA, Churchill L, Matlock DD, Kittelson A, Lutz A, Bade M, Stevens-Lapsley J. Implementation of a "People-Like-Me" Tool for Personalized Rehabilitation After Total Knee Arthroplasty: A Mixed Methods Pilot Study. J Eval Clin Pract 2025; 31:e70028. [PMID: 39987567 DOI: 10.1111/jep.70028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Revised: 12/24/2024] [Accepted: 02/02/2025] [Indexed: 02/25/2025]
Abstract
RATIONALE While there are numerous tools available to inform if and when to use total knee arthroplasty (TKA), very few tools exist to help guide the recovery period after surgery. AIMS AND OBJECTIVES We piloted a decision support tool that promotes a "people-like-me" (PLM) approach to rehabilitation after total knee arthroplasty (TKA). The PLM approach encourages person-centered care by "using historical outcomes data from similar (past) patients as a template of what to expect for a new patient". In this study, we evaluated how successfully the PLM tool was implemented and examined contextual factors that may have influenced its implementation. METHODS Two outpatient physical therapy clinics (Clinics A and B) piloted the PLM tool from September 2020 - December 2022. We gathered data related to its implementation from multiple sources including the electronic health record (EHR), the tool itself, and surveys and interviews with patients and clinicians. We used an explanatory sequential mixed methods design to analyze the data overall and separately by each clinic. RESULTS Overall, the clinics met most pre-specified implementation targets, but did not use the tool as frequently as intended. Both clinics identified time, technology, and scheduling barriers to using the tool, but Clinic A scored higher in nearly every implementation outcome. Clinic A's success may have been related to its clinicians' higher level of experience, more positive attitudes towards the tool, and more active approach to implementation compared to Clinic B. CONCLUSIONS The clinics met most of our implementation targets, but Clinic A experienced more success than Clinic B. Future efforts to implement this PLM tool should (1) engage clinicians as active participants in the implementation process, (2) explore whether incorporating treatment recommendations into the PLM tool and/or using alternative training strategies can enhance its ability to alter clinician behavior, (3) integrate the tool within the EHR to complement existing workflows and mitigate implementation barriers, and (4) include randomized controlled trials that evaluate the tool's effectiveness and scalability across diverse clinical settings.
Collapse
Affiliation(s)
- Jeremy Graber
- Eastern Colorado VA Health Care System, Geriatric Research Education and Clinical Center (GRECC), Aurora, Colorado, USA
- Physical Therapy Program, Department of Physical Medicine and Rehabilitation, University of Colorado, Aurora, Colorado, USA
| | - Lauren A Hinrichs-Kinney
- Eastern Colorado VA Health Care System, Geriatric Research Education and Clinical Center (GRECC), Aurora, Colorado, USA
- Physical Therapy Program, Department of Physical Medicine and Rehabilitation, University of Colorado, Aurora, Colorado, USA
| | - Laura Churchill
- Physical Therapy Program, Department of Physical Medicine and Rehabilitation, University of Colorado, Aurora, Colorado, USA
- Active Aging Research Team, The University of British Columbia, Vancouver, British Columbia, CA
- Department of Family Practice, Faculty of Medicine, The University of British Columbia, Vancouver, British Columbia, CA
| | - Daniel D Matlock
- Eastern Colorado VA Health Care System, Geriatric Research Education and Clinical Center (GRECC), Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
- Division of Geriatric Medicine, Department of Medicine, University of Colorado School of Medicine, Aurora, Colorado, USA
| | - Andrew Kittelson
- School of Physical Therapy and Rehabilitation Science, University of Montana, Missoula, Montana, USA
| | - Adam Lutz
- ATI Physical Therapy, Greenville, South Carolina, USA
- Institute for Musculoskeletal Advancement, Bolingbrook, Illinois, USA
| | - Michael Bade
- Eastern Colorado VA Health Care System, Geriatric Research Education and Clinical Center (GRECC), Aurora, Colorado, USA
- Physical Therapy Program, Department of Physical Medicine and Rehabilitation, University of Colorado, Aurora, Colorado, USA
| | - Jennifer Stevens-Lapsley
- Eastern Colorado VA Health Care System, Geriatric Research Education and Clinical Center (GRECC), Aurora, Colorado, USA
- Physical Therapy Program, Department of Physical Medicine and Rehabilitation, University of Colorado, Aurora, Colorado, USA
| |
Collapse
|
27
|
Bai E, Zhang Z, Xu Y, Luo X, Adelgais K. Enhancing prehospital decision-making: exploring user needs and design considerations for clinical decision support systems. BMC Med Inform Decis Mak 2025; 25:31. [PMID: 39825293 PMCID: PMC11742207 DOI: 10.1186/s12911-024-02844-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Accepted: 12/27/2024] [Indexed: 01/20/2025] Open
Abstract
BACKGROUND In prehospital emergency care, providers face significant challenges in making informed decisions due to factors such as limited cognitive support, high-stress environments, and lack of experience with certain patient conditions. Effective Clinical Decision Support Systems (CDSS) have great potential to alleviate these challenges. However, such systems have not yet been widely adopted in real-world practice and have been found to cause workflow disruptions and usability issues. Therefore, it is critical to investigate how to design CDSS that meet the needs of prehospital providers while accounting for the unique characteristics of prehospital workflows. METHODS We conducted semi-structured interviews with 20 prehospital providers recruited from four Emergency Medical Services (EMS) agencies in an urban area in the northeastern U.S. The interviews focused on the decision-making challenges faced by prehospital providers, their technological needs for decision support, and key considerations for the design and implementation of a CDSS that can seamlessly integrate into prehospital care workflows. The data were analyzed using content analysis to identify common themes. RESULTS Our qualitative study identified several challenges in prehospital decision-making, including limited access to diagnostic tools, insufficient experience with certain critical patient conditions, and a lack of cognitive support. Participants highlighted several desired features to make CDSS more effective in the dynamic, hands-busy, and cognitively demanding prehospital context, such as automatic prompts for possible patient conditions and treatment options, alerts for critical patient safety events, AI-powered medication identification, and easy retrieval of protocols using hands-free methods (e.g., voice commands). Key considerations for successful CDSS adoption included balancing the frequency and urgency of alerts to reduce alarm fatigue and workflow disruptions, facilitating real-time data collection and documentation to enable decision generation, and ensuring trust and accountability while preventing over-reliance when using CDSS. CONCLUSION This study provides empirical insights into the challenges and user needs in prehospital decision-making and offers practical and system design implications for addressing these issues.
Collapse
Affiliation(s)
- Enze Bai
- School of Computer Science and Information Systems, Pace University, New York City, NY, USA
| | - Zhan Zhang
- School of Computer Science and Information Systems, Pace University, New York City, NY, USA.
| | - Yincao Xu
- School of Computer Science and Information Systems, Pace University, New York City, NY, USA
| | - Xiao Luo
- School of Business, Oklahoma State University, Stillwater, OK, USA
- School of Medicine, Indiana University, Indianapolis, IN, USA
| | | |
Collapse
|
28
|
Karmacharya BM, Das S, Shrestha A, Shrestha A, Karki S, Shakya R, Radovich E, Penn-Kekana L, Calvert C, Campell OMR, McCarthy OL. A Novel Approach to Assessing the Potential of Electronic Decision Support Systems to Improve the Quality of Antenatal Care in Nepal. GLOBAL HEALTH, SCIENCE AND PRACTICE 2025:GHSP-D-23-00370. [PMID: 39788635 DOI: 10.9745/ghsp-d-23-00370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2023] [Accepted: 12/05/2024] [Indexed: 01/12/2025]
Abstract
INTRODUCTION Electronic decision-support systems (EDSSs) aim to improve the quality of antenatal care (ANC) through adherence to evidence-based guidelines. We assessed the potential of the mHealth integrated model of hypertension, diabetes, and ANC EDSS and the World Health Organization EDSS to improve the quality of ANC in primary-level health care facilities in Nepal. METHODS From December 2021 to January 2023, we conducted a mixed-methods evaluation in 19 primary-level ANC facilities in Bagmati Province, Nepal. Implementation was from March 2022 to August 2022. We conducted a health facility survey, ANC clinical observations, longitudinal case studies and validation workshop, in-depth interviews, monitoring visits, research team debriefing meetings, health care provider attitude survey, and stakeholder engagement and feedback meetings. Results were integrated using concurrent triangulation to develop explanations about the EDSS implementation process and the effects observed. RESULTS We identified 9 themes on implementation challenges that hindered the EDSS from generating the desired improvements to ANC quality. Facility readiness and provider confidence in using the EDSS were mixed. It was not always used or used as intended, and the approach to ANC provision did not change. EDSS inflexibility did not reflect how staff made decisions about pregnant women's needs or ensure that tests were done at the right time. There was mixed evidence that ANC staff believed that the EDSS benefited their work. The EDSS did not become fully integrated into existing health systems. Engagement of essential stakeholders fell short. CONCLUSION Different understandings of and inconsistent use of the EDSS highlighted the need for increased training and support periods, greater stakeholder engagement, and further integration into existing health systems. Our novel approach to integrating findings from multiple substudies offers uniquely valuable insights into the many factors needed for the successful implementation of an EDSS to improve the quality of ANC in Nepal.
Collapse
Affiliation(s)
- Biraj Man Karmacharya
- Department of Public Health and Community Programs, Kathmandu University School of Medical Sciences, Dhulikhel, Nepal
| | - Seema Das
- Research and Development Division, Dhulikhel Hospital Kathmandu University Hospital, Dhulikhel, Nepal
| | - Abha Shrestha
- Department of Obstetrics and Gynecology, Kathmandu University School of Medical Sciences, Dhulikhel, Nepal
| | - Abha Shrestha
- Department of Community Medicine, Kathmandu University School of Medical Sciences, Dhulikhel, Nepal
| | - Sulata Karki
- Research and Development Division, Dhulikhel Hospital Kathmandu University Hospital, Dhulikhel, Nepal
| | - Rajani Shakya
- Research and Development Division, Dhulikhel Hospital Kathmandu University Hospital, Dhulikhel, Nepal
| | - Emma Radovich
- Faculty of Epidemiology and Population Health, London School of Hygiene & Tropical Medicine, London, United Kingdom
| | - Loveday Penn-Kekana
- Faculty of Epidemiology and Population Health, London School of Hygiene & Tropical Medicine, London, United Kingdom
| | | | - Oona M R Campell
- Faculty of Epidemiology and Population Health, London School of Hygiene & Tropical Medicine, London, United Kingdom
| | - Ona L McCarthy
- Faculty of Epidemiology and Population Health, London School of Hygiene & Tropical Medicine, London, United Kingdom.
| |
Collapse
|
29
|
Josephson CB, Aronica E, Beniczky S, Boyce D, Cavalleri G, Denaxas S, French J, Jehi L, Koh H, Kwan P, McDonald C, Mitchell JW, Rampp S, Sadleir L, Sisodiya SM, Wang I, Wiebe S, Yasuda C, Youngerman B, the ILAE Big Data Commission. Big data research is everyone's research-Making epilepsy data science accessible to the global community: Report of the ILAE big data commission. Epileptic Disord 2024; 26:733-752. [PMID: 39446076 PMCID: PMC11651381 DOI: 10.1002/epd2.20288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 07/24/2024] [Accepted: 09/04/2024] [Indexed: 10/25/2024]
Abstract
Epilepsy care generates multiple sources of high-dimensional data, including clinical, imaging, electroencephalographic, genomic, and neuropsychological information, that are collected routinely to establish the diagnosis and guide management. Thanks to high-performance computing, sophisticated graphics processing units, and advanced analytics, we are now on the cusp of being able to use these data to significantly improve individualized care for people with epilepsy. Despite this, many clinicians, health care providers, and people with epilepsy are apprehensive about implementing Big Data and accompanying technologies such as artificial intelligence (AI). Practical, ethical, privacy, and climate issues represent real and enduring concerns that have yet to be completely resolved. Similarly, Big Data and AI-related biases have the potential to exacerbate local and global disparities. These are highly germane concerns to the field of epilepsy, given its high burden in developing nations and areas of socioeconomic deprivation. This educational paper from the International League Against Epilepsy's (ILAE) Big Data Commission aims to help clinicians caring for people with epilepsy become familiar with how Big Data is collected and processed, how they are applied to studies using AI, and outline the immense potential positive impact Big Data can have on diagnosis and management.
Collapse
Affiliation(s)
- Colin B. Josephson
- Department of Clinical Neurosciences, Cumming School of MedicineUniversity of CalgaryCalgaryAlbertaCanada
- Hotchkiss Brain InstituteUniversity of CalgaryCalgaryAlbertaCanada
- Department of Community Health Sciences, Cumming School of MedicineUniversity of CalgaryAlbertaCanada
- O'Brien Institute for Public HealthUniversity of CalgaryCalgaryAlbertaCanada
- Centre for Health InformaticsUniversity of CalgaryCalgaryAlbertaCanada
- Institute for Health InformaticsUniversity College LondonLondonUK
| | - Eleonora Aronica
- Department of (Neuro)Pathology, Amsterdam UMCUniversity of Amsterdam, Amsterdam NeuroscienceAmsterdamThe Netherlands
- Stichting Epilepsie Instellingen Nederland (SEIN)HeemstedeThe Netherlands
| | - Sandor Beniczky
- Department of Neurology, Albert Szent‐Györgyi Medical SchoolUniversity of SzegedSzegedHungary
- Department of NeurophysiologyDanish Epilepsy CenterDianalundDenmark
- Department of Clinical Medicine, Aarhus University and Department of Clinical NeurophysiologyAarhus University HospitalAarhusDenmark
| | - Danielle Boyce
- Tufts University School of MedicineBostonMassachusettsUSA
- Johns Hopkins University Biomedical Informatics and Data Science SectionBaltimoreMarylandUSA
- West Chester University Department of Public Policy and AdministrationWest ChesterPennsylvaniaUSA
| | - Gianpiero Cavalleri
- School of Pharmacy and Biomolecular SciencesThe Royal College of Surgeons in IrelandDublinIreland
- FutureNeuro SFI Research CentreThe Royal College of Surgeons in IrelandDublinIreland
| | - Spiros Denaxas
- Institute for Health InformaticsUniversity College LondonLondonUK
- British Heart Foundation Data Science CenterHealth Data Research UKLondonUK
| | - Jacqueline French
- Department of NeurologyGrossman School of Medicine, New York UniversityNew YorkNew YorkUSA
| | - Lara Jehi
- Epilepsy CenterCleveland ClinicClevelandOhioUSA
- Center for Computational Life SciencesClevelandOhioUSA
| | - Hyunyong Koh
- Harvard Brain Science InitiativeHarvard UniversityBostonMassachusettsUSA
| | - Patrick Kwan
- Department of Neuroscience, School of Translational MedicineMonash UniversityMelbourneVictoriaAustralia
- Department of NeurologyAlfred HealthMelbourneVictoriaAustralia
- Department of NeurologyThe Royal Melbourne HospitalParkvilleVictoriaAustralia
| | - Carrie McDonald
- Department of Radiation Medicine and Applied Sciences & PsychiatryUniversity of CaliforniaSan DiegoCaliforniaUSA
| | - James W. Mitchell
- Institute of Systems, Molecular and Integrative Biology (ISMIB)University of LiverpoolLiverpoolUK
- Department of NeurologyThe Walton Cetnre NHS Foundation TrustLiverpoolUK
| | - Stefan Rampp
- Department of Neurosurgery and Department of Neuroradiology, University Hospital Erlangen, Department of NeurosurgeryUniversity Hospital Halle (Saale)Halle (Saale)Germany
| | - Lynette Sadleir
- Department of Paediatrics and Child HealthUniversity of OtagoWellingtonNew Zealand
| | - Sanjay M. Sisodiya
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of NeurologyLondon WC1N 3BG and Chalfont Centre for EpilepsyLondonUK
| | - Irene Wang
- Epilepsy Center, Neurological InstituteCleveland ClinicClevelandOhioUSA
| | - Samuel Wiebe
- Department of Clinical Neurosciences, Cumming School of MedicineUniversity of CalgaryCalgaryAlbertaCanada
- Hotchkiss Brain InstituteUniversity of CalgaryCalgaryAlbertaCanada
- Department of Community Health Sciences, Cumming School of MedicineUniversity of CalgaryAlbertaCanada
- O'Brien Institute for Public HealthUniversity of CalgaryCalgaryAlbertaCanada
- Clinical Research Unit, Cumming School of MedicineUniversity of CalgaryCalgaryAlbertaCanada
| | | | - Brett Youngerman
- Department of Neurological SurgeryColumbia University Vagelos College of Physicians and SurgeonsNew YorkNew YorkUSA
| | | |
Collapse
|
30
|
Tai AMY, Kim JJ, Schmeckenbecher J, Kitchin V, Wang J, Kazemi A, Masoudi R, Fadakar H, Iorfino F, Krausz RM. Clinical decision support systems in addiction and concurrent disorders: A systematic review and meta-analysis. J Eval Clin Pract 2024; 30:1664-1683. [PMID: 38979849 DOI: 10.1111/jep.14069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 06/03/2024] [Accepted: 06/06/2024] [Indexed: 07/10/2024]
Abstract
INTRODUCTION This review aims to synthesise the literature on the efficacy, evolution, and challenges of implementing Clincian Decision Support Systems (CDSS) in the realm of mental health, addiction, and concurrent disorders. METHODS Following PRISMA guidelines, a systematic review and meta-analysis were performed. Searches conducted in databases such as MEDLINE, Embase, CINAHL, PsycINFO, and Web of Science through 25 May 2023, yielded 27,344 records. After necessary exclusions, 69 records were allocated for detailed synthesis. In the examination of patient outcomes with a focus on metrics such as therapeutic efficacy, patient satisfaction, and treatment acceptance, meta-analytic techniques were employed to synthesise data from randomised controlled trials. RESULTS A total of 69 studies were included, revealing a shift from knowledge-based models pre-2017 to a rise in data-driven models post-2017. The majority of models were found to be in Stage 2 or 4 of maturity. The meta-analysis showed an effect size of -0.11 for addiction-related outcomes and a stronger effect size of -0.50 for patient satisfaction and acceptance of CDSS. DISCUSSION The results indicate a shift from knowledge-based to data-driven CDSS approaches, aligned with advances in machine learning and big data. Although the immediate impact on addiction outcomes is modest, higher patient satisfaction suggests promise for wider CDSS use. Identified challenges include alert fatigue and opaque AI models. CONCLUSION CDSS shows promise in mental health and addiction treatment but requires a nuanced approach for effective and ethical implementation. The results emphasise the need for continued research to ensure optimised and equitable use in healthcare settings.
Collapse
Affiliation(s)
- Andy Man Yeung Tai
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jane J Kim
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jim Schmeckenbecher
- Department of Psychiatry and Psychotherapy, Medical University of Vienna, Wien, Austria
| | - Vanessa Kitchin
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Johnston Wang
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Alireza Kazemi
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Raha Masoudi
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Hasti Fadakar
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Frank Iorfino
- Brain and Mind Centre, The University of Sydney, Sydney, Australia
| | - Reinhard Michael Krausz
- Department of Psychiatry, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
31
|
Grechuta K, Shokouh P, Alhussein A, Müller-Wieland D, Meyerhoff J, Gilbert J, Purushotham S, Rolland C. Benefits of Clinical Decision Support Systems for the Management of Noncommunicable Chronic Diseases: Targeted Literature Review. Interact J Med Res 2024; 13:e58036. [PMID: 39602213 PMCID: PMC11635333 DOI: 10.2196/58036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 07/09/2024] [Accepted: 09/23/2024] [Indexed: 11/29/2024] Open
Abstract
BACKGROUND Clinical decision support systems (CDSSs) are designed to assist in health care delivery by supporting medical practice with clinical knowledge, patient information, and other relevant types of health information. CDSSs are integral parts of health care technologies assisting in disease management, including diagnosis, treatment, and monitoring. While electronic medical records (EMRs) serve as data repositories, CDSSs are used to assist clinicians in providing personalized, context-specific recommendations derived by comparing individual patient data to evidence-based guidelines. OBJECTIVE This targeted literature review (TLR) aimed to identify characteristics and features of both stand-alone and EMR-integrated CDSSs that influence their outcomes and benefits based on published scientific literature. METHODS A TLR was conducted using the Embase, MEDLINE, and Cochrane databases to identify data on CDSSs published in a 10-year frame (2012-2022). Studies on computerized, guideline-based CDSSs used by health care practitioners with a focus on chronic disease areas and reporting outcomes for CDSS utilization were eligible for inclusion. RESULTS A total of 49 publications were included in the TLR. Studies predominantly reported on EMR-integrated CDSSs (ie, connected to an EMR database; n=32, 65%). The implementation of CDSSs varied globally, with substantial utilization in the United States and within the domain of cardio-renal-metabolic diseases. CDSSs were found to positively impact "quality assurance" (n=35, 69%) and provide "clinical benefits" (n=20, 41%), compared to usual care. Among CDSS features, treatment guidance and flagging were consistently reported as the most frequent elements for enhancing health care, followed by risk level estimation, diagnosis, education, and data export. The effectiveness of a CDSS was evaluated most frequently in primary care settings (n=34, 69%) across cardio-renal-metabolic disease areas (n=32, 65%), especially in diabetes (n=13, 26%). Studies reported CDSSs to be commonly used by a mixed group (n=27, 55%) of users including physicians, specialists, nurses or nurse practitioners, and allied health care professionals. CONCLUSIONS Overall, both EMR-integrated and stand-alone CDSSs showed positive results, suggesting their benefits to health care providers and potential for successful adoption. Flagging and treatment recommendation features were commonly used in CDSSs to improve patient care; other features such as risk level estimation, diagnosis, education, and data export were tailored to specific requirements and collectively contributed to the effectiveness of health care delivery. While this TLR demonstrated that both stand-alone and EMR-integrated CDSSs were successful in achieving clinical outcomes, the heterogeneity of included studies reflects the evolving nature of this research area, underscoring the need for further longitudinal studies to elucidate aspects that may impact their adoption in real-world scenarios.
Collapse
Affiliation(s)
- Klaudia Grechuta
- Boehringer Ingelheim International GmbH, Ingelheim am Rhein, Germany
| | | | - Ahmad Alhussein
- Boehringer Ingelheim International GmbH, Ingelheim am Rhein, Germany
| | - Dirk Müller-Wieland
- Department of Internal Medicine I, University Hospital Aachen, Aachen, Germany
| | - Juliane Meyerhoff
- Boehringer Ingelheim International GmbH, Ingelheim am Rhein, Germany
| | - Jeremy Gilbert
- Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
| | | | | |
Collapse
|
32
|
Muhindo MK, Armas J, Kamya M, Danziger E, Bress J, Ruel T. Midwives as trainers for a neonatal clinical decision support system at four rural health facilities in eastern Uganda: a mixed-methods observational study. BMJ Open 2024; 14:e081088. [PMID: 39592162 PMCID: PMC11590793 DOI: 10.1136/bmjopen-2023-081088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 11/02/2024] [Indexed: 11/28/2024] Open
Abstract
OBJECTIVES To evaluate acceptability and effectiveness of midwives as trainers for NoviGuide, a neonatal clinical decision support system (CDSS). DESIGN A 20-months, mixed-methods open cohort study. SETTINGS AND PARTICIPANTS Nurse-midwives at four rural health facilities in eastern Uganda. METHODS We developed a midwife-led trainer programme and instructed two midwives as NoviGuide Trainers in three 3-hour-long sessions. Trainers trained all nurse-midwives at each site in single 3-hour-long sessions. Using the Kirkpatrick model, we evaluated acceptability at level 1 for participant's reaction and level 3 for participant's attitudes towards the programme. We evaluated effectiveness at level 2 for newly learnt skills, and level 3 for participant's uptake of NoviGuide and perception of newborn care practices. We used surveys and focus groups at baseline, 3 months and 6 months and viewed usage data from September 2020 through May 2022. RESULTS All 49 participants were female, 23 (46.9%) owned smartphones, 12 (24.5%) accessed the internet daily and 17 (34.7%) were present by study end following staff changes. All participants perceived the use of midwives as NoviGuide Trainers to be an acceptable approach to introduce NoviGuide (mean 5.9 out of 6, SD 0.37). Participants reported gaining new skills and confidence to use NoviGuide; some, in turn, trained others. Participants reported improvement in newborn care. Uptake of NoviGuide was high. Of 49 trained participants, 48 (98%) used NoviGuide. A total of 4045 assessments of newborns were made. Of these, 13.8% (558/4045) were preterm, 17.5% (709/4045) weighed under 2.5 kg and 21.1% (855/4045) had a temperature <36.5°C. CONCLUSION This midwife-led programme was acceptable and led to self-reported improvement in newborn care and high uptake of NoviGuide among nurse-midwives. Task shifting CDSS expert roles to midwives could facilitate large-scale implementation. However, resources like internet coverage, reliable electricity and mobile devices should be considered in low-resource settings.
Collapse
Affiliation(s)
| | - Jean Armas
- Global Strategies, Albany, California, USA
| | - Moses Kamya
- Infectious Diseases Research Collaboration, Kampala, Uganda
| | | | | | - Theodore Ruel
- Division of Pediatric Infectious Diseases and Global Health, Department of Pediatrics, University of California San Francisco, San Francisco, California, USA
| |
Collapse
|
33
|
Bai E, Zhang Z, Xu Y, Luo X, Adelgais K. Enhancing Prehospital Decision-Making: Exploring User Needs and Design Considerations for Clinical Decision Support Systems. RESEARCH SQUARE 2024:rs.3.rs-5206138. [PMID: 39606439 PMCID: PMC11601868 DOI: 10.21203/rs.3.rs-5206138/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2024]
Abstract
Background In prehospital emergency care, providers face significant challenges in making informed decisions due to factors such as limited cognitive support, high-stress environments, and lack of experience with certain patient conditions. Effective Clinical Decision Support Systems (CDSS) have great potential to alleviate these challenges. However, such systems have not yet been widely adopted in real-world practice and have found to cause workflow disruptions and usability issues. Therefore, it is critical to investigate how to design CDSS that meet the needs of prehospital providers while accounting for the unique characteristics of prehospital workflows. Methods We conducted semi-structured interviews with 20 prehospital providers recruited from four emergency medical services (EMS) agencies in an urban area in the northeastern U.S. The interviews focused on the decision-making challenges faced by prehospital providers, their technological needs for decision support, and key considerations for the design and implementation of a CDSS that can seamlessly integrate into prehospital care workflows. The data were analyzed using content analysis to identify common themes. Results Our qualitative study identified several challenges in prehospital decision-making, including limited access to diagnostic tools, insufficient experience with certain critical patient conditions, and a lack of cognitive support. Participants highlighted several desired features to make CDSS more effective in the dynamic, hands-busy, and cognitively demanding prehospital context, such as automatic prompts for possible patient conditions and treatment options, alerts for critical patient safety events, AI-powered medication identification, and easy retrieval of protocols and guidelines using voice commands. Key considerations for successful CDSS adoption included prioritizing alerts to reduce alert fatigue and workflow disruptions, facilitating real-time data collection and documentation to enable decision generation, and ensuring trust and accountability while preventing over-reliance when using CDSS. Conclusion This study provides empirical insights into the challenges prehospital providers face and offers design recommendations for developing CDSS solutions that align with prehospital workflows.
Collapse
|
34
|
Schmidt S, Ambroggio L. Four rights of clinical decision support: You can build it, but will they come? J Hosp Med 2024; 19:1078-1079. [PMID: 38867653 DOI: 10.1002/jhm.13432] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 06/03/2024] [Indexed: 06/14/2024]
Affiliation(s)
- Sarah Schmidt
- Sections of Emergency Medicine and Hospital Medicine, Children's Hospital of Colorado, Department of Pediatrics, University of Colorado School of Medicine, Aurora, Colorado, USA
| | - Lilliam Ambroggio
- Sections of Emergency Medicine and Hospital Medicine, Children's Hospital of Colorado, Department of Pediatrics, University of Colorado School of Medicine, Aurora, Colorado, USA
- Section of Hospital Medicine, Children's Hospital of Colorado, Department of Pediatrics, University of Colorado School of Medicine, Aurora, Colorado, USA
| |
Collapse
|
35
|
Maulik PK, Daniel M, Devarapalli S, Kallakuri S, Kaur A, Ghosh A, Billot L, Mukherjee A, Sagar R, Kant S, Chatterjee S, Essue BM, Raman U, Praveen D, Thornicroft G, Saxena S, Patel A, Peiris D. Mental Health Care Support in Rural India: A Cluster Randomized Clinical Trial. JAMA Psychiatry 2024; 81:1061-1070. [PMID: 39141372 PMCID: PMC11325245 DOI: 10.1001/jamapsychiatry.2024.2305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Accepted: 06/03/2024] [Indexed: 08/15/2024]
Abstract
Importance More than 150 million people in India need mental health care but few have access to affordable care, especially in rural areas. Objective To determine whether a multifaceted intervention involving a digital health care model along with a community-based antistigma campaign leads to reduced depression risk and lower mental health-related stigma among adults residing in rural India. Design, Setting, and Participants This parallel, cluster randomized, usual care-controlled trial was conducted from September 2020 to December 2021 with blinded follow-up assessments at 3, 6, and 12 months at 44 rural primary health centers across 3 districts in Haryana and Andhra Pradesh states in India. Adults aged 18 years and older at high risk of depression or self-harm defined by either a Patient Health Questionnaire-9 item (PHQ-9) score of 10 or greater, a Generalized Anxiety Disorder-7 item (GAD-7) score of 10 or greater, or a score of 2 or greater on the self-harm/suicide risk question on the PHQ-9. A second cohort of adults not at high risk were selected randomly from the remaining screened population. Data were cleaned and analyzed from April 2022 to February 2023. Interventions The 12-month intervention included a community-based antistigma campaign involving all participants and a digital mental health intervention involving only participants at high risk. Primary health care workers were trained to identify and manage participants at high risk using the Mental Health Gap Action Programme guidelines from the World Health Organization. Main Outcomes and Measures The 2 coprimary outcomes assessed at 12 months were mean PHQ-9 scores in the high-risk cohort and mean behavior scores in the combined high-risk and non-high-risk cohorts using the Mental Health Knowledge, Attitude, and Behavior scale. Results Altogether, 9928 participants were recruited (3365 at high risk and 6563 not at high risk; 5638 [57%] female and 4290 [43%] male; mean [SD] age, 43 [16] years) with 9057 (91.2%) followed up at 12 months. Mean PHQ-9 scores at 12 months for the high-risk cohort were lower in the intervention vs control groups (2.77 vs 4.48; mean difference, -1.71; 95% CI, -2.53 to -0.89; P < .001). The remission rate in the high-risk cohort (PHQ-9 and GAD-7 scores <5 and no risk of self-harm) was higher in the intervention vs control group (74.7% vs 50.6%; odds ratio [OR], 2.88; 95% CI, 1.53 to 5.42; P = .001). Across both cohorts, there was no difference in 12-month behavior scores in the intervention vs control group (17.39 vs 17.74; mean difference, -0.35; 95% CI, -1.11 to 0.41; P = .36). Conclusions and Relevance A multifaceted intervention was effective in reducing depression risk but did not improve intended help-seeking behaviors for mental illness. Trial Registration Clinical Trial Registry India: CTRI/2018/08/015355.
Collapse
Affiliation(s)
- Pallab K. Maulik
- The George Institute for Global Health, New Delhi, India
- University of New South Wales, Sydney, New South Wales, Australia
| | - Mercian Daniel
- The George Institute for Global Health, New Delhi, India
| | | | | | - Amanpreet Kaur
- The George Institute for Global Health, New Delhi, India
- Jindal School of Psychology and Counselling, O.P. Jindal Global University, Haryana, India
| | - Arpita Ghosh
- The George Institute for Global Health, New Delhi, India
- University of New South Wales, Sydney, New South Wales, Australia
- Prasanna School of Public Health, Manipal Academy of Higher Education, Manipal, India
| | - Laurent Billot
- University of New South Wales, Sydney, New South Wales, Australia
- The George Institute for Global Health, Sydney, New South Wales, Australia
| | | | - Rajesh Sagar
- Department of Psychiatry, All India Institute of Medical Sciences, New Delhi, India
| | - Sashi Kant
- Department of Community Medicine, All India Institute of Medical Sciences, New Delhi, India
| | - Susmita Chatterjee
- The George Institute for Global Health, New Delhi, India
- University of New South Wales, Sydney, New South Wales, Australia
- Prasanna School of Public Health, Manipal Academy of Higher Education, Manipal, India
| | - Beverley M. Essue
- Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Usha Raman
- Department of Communication, University of Hyderabad, Telangana, India
| | - Devarsetty Praveen
- University of New South Wales, Sydney, New South Wales, Australia
- The George Institute for Global Health, Hyderabad, India
- Prasanna School of Public Health, Manipal Academy of Higher Education, Manipal, India
| | - Graham Thornicroft
- Centre for Global Mental Health and Centre for Implementation Science, Health Service and Population Research Department, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, United Kingdom
| | - Shekhar Saxena
- Harvard T. H. Chan School of Public Health, Boston, Massachusetts
| | - Anushka Patel
- University of New South Wales, Sydney, New South Wales, Australia
- The George Institute for Global Health, Sydney, New South Wales, Australia
| | - David Peiris
- University of New South Wales, Sydney, New South Wales, Australia
- The George Institute for Global Health, Sydney, New South Wales, Australia
| |
Collapse
|
36
|
Ayorinde A, Mensah DO, Walsh J, Ghosh I, Ibrahim SA, Hogg J, Peek N, Griffiths F. Health Care Professionals' Experience of Using AI: Systematic Review With Narrative Synthesis. J Med Internet Res 2024; 26:e55766. [PMID: 39476382 PMCID: PMC11561443 DOI: 10.2196/55766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 06/10/2024] [Accepted: 07/25/2024] [Indexed: 11/15/2024] Open
Abstract
BACKGROUND There has been a substantial increase in the development of artificial intelligence (AI) tools for clinical decision support. Historically, these were mostly knowledge-based systems, but recent advances include non-knowledge-based systems using some form of machine learning. The ability of health care professionals to trust technology and understand how it benefits patients or improves care delivery is known to be important for their adoption of that technology. For non-knowledge-based AI tools for clinical decision support, these issues are poorly understood. OBJECTIVE The aim of this study is to qualitatively synthesize evidence on the experiences of health care professionals in routinely using non-knowledge-based AI tools to support their clinical decision-making. METHODS In June 2023, we searched 4 electronic databases, MEDLINE, Embase, CINAHL, and Web of Science, with no language or date limit. We also contacted relevant experts and searched reference lists of the included studies. We included studies of any design that reported the experiences of health care professionals using non-knowledge-based systems for clinical decision support in their work settings. We completed double independent quality assessment for all included studies using the Mixed Methods Appraisal Tool. We used a theoretically informed thematic approach to synthesize the findings. RESULTS After screening 7552 titles and 182 full-text articles, we included 25 studies conducted in 9 different countries. Most of the included studies were qualitative (n=13), and the remaining were quantitative (n=9) and mixed methods (n=3). Overall, we identified 7 themes: health care professionals' understanding of AI applications, level of trust and confidence in AI tools, judging the value added by AI, data availability and limitations of AI, time and competing priorities, concern about governance, and collaboration to facilitate the implementation and use of AI. The most frequently occurring are the first 3 themes. For example, many studies reported that health care professionals were concerned about not understanding the AI outputs or the rationale behind them. There were issues with confidence in the accuracy of the AI applications and their recommendations. Some health care professionals believed that AI provided added value and improved decision-making, and some reported that it only served as a confirmation of their clinical judgment, while others did not find it useful at all. CONCLUSIONS Our review identified several important issues documented in various studies on health care professionals' use of AI tools in real-world health care settings. Opinions of health care professionals regarding the added value of AI tools for supporting clinical decision-making varied widely, and many professionals had concerns about their understanding of and trust in this technology. The findings of this review emphasize the need for concerted efforts to optimize the integration of AI tools in real-world health care settings. TRIAL REGISTRATION PROSPERO CRD42022336359; https://tinyurl.com/2yunvkmb.
Collapse
Affiliation(s)
- Abimbola Ayorinde
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| | - Daniel Opoku Mensah
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| | - Julia Walsh
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| | - Iman Ghosh
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| | - Siti Aishah Ibrahim
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| | - Jeffry Hogg
- AI Digital Health Research and Policy Group, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom
| | - Niels Peek
- Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, United Kingdom
- The Healthcare Improvement Studies Institute, Department of Public Health and Primary Care, University of Cambridge, Cambridge, United Kingdom
| | - Frances Griffiths
- Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, United Kingdom
| |
Collapse
|
37
|
Porcel Gálvez AM, Lima-Serrano M, Allande-Cussó R, Costanzo-Talarico MG, García MDM, Bueno-Ferrán M, Fernández-García E, D'Agostino F, Romero-Sánchez JM. Enhancing nursing care through technology and standardized nursing language: The TEC-MED multilingual platform. Int J Nurs Knowl 2024. [PMID: 39439415 DOI: 10.1111/2047-3095.12493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2024] [Accepted: 09/29/2024] [Indexed: 10/25/2024]
Abstract
PURPOSE This study describes the design, integration, and semantic interoperability process of a minimum data set using standardized nursing language in the caring module of the TEC-MED care platform. METHODS The caring module was developed in three phases (2020-2022): platform concept, functional design and construction, and testing and evaluation. Phases involved collaboration among academics, information technology developers, and social/healthcare professionals. Nursing taxonomies (NANDA-I, NOC, NIC) were integrated to support the nursing process. The platform was piloted in six Mediterranean countries. FINDINGS The final platform features an assessment module with eight dimensions for data collection on older adults and their caregivers. A clinical decision support system links assessment data with nursing diagnoses, outcomes, and interventions. The platform is available in six languages (English, Spanish, French, Italian, Greek, and Arabic). Usability testing identified the need for improved Arabic language support. CONCLUSIONS The TEC-MED platform is a pioneering tool using standardized nursing language to improve care for older adults in the Mediterranean. The platform's multilingualism promotes accessibility. Limitations include offline use and mobile app functionality. Pilot testing is underway to evaluate effectiveness and facilitate cross-cultural validation of nursing taxonomies. IMPLICATIONS FOR NURSING PRACTICE The TEC-MED platform offers standardized nursing care for older adults across the Mediterranean, promoting consistent communication and evidence-based practice. This approach has the potential to improve care quality and accessibility for a vulnerable population.
Collapse
Affiliation(s)
- Ana-María Porcel Gálvez
- Nursing Department, Faculty of Nursing, Physiotherapy and Podiatry, Universidad de Sevilla, Sevilla, Spain
| | - Marta Lima-Serrano
- Nursing Department, Faculty of Nursing, Physiotherapy and Podiatry, Universidad de Sevilla, Sevilla, Spain
| | - Regina Allande-Cussó
- Nursing Department, Faculty of Nursing, Physiotherapy and Podiatry, Universidad de Sevilla, Sevilla, Spain
| | - Maria-Giulia Costanzo-Talarico
- Research group Ecological Economy, Feminist Economy and Development (EcoECoFem - SEJ 507), Universidad Pablo de Olavide, Sevilla, Spain
| | | | - Mercedes Bueno-Ferrán
- Nursing Department, Faculty of Nursing, Physiotherapy and Podiatry, Universidad de Sevilla, Sevilla, Spain
| | - Elena Fernández-García
- Nursing Department, Faculty of Nursing, Physiotherapy and Podiatry, Universidad de Sevilla, Sevilla, Spain
| | - Fabio D'Agostino
- Medicine and Surgery Department, Saint Camillus International University of Health Sciences, Rome, Italy
| | | |
Collapse
|
38
|
Alyazeedi A, Stewart C, Soiza RL, Stewart D, Awaisu A, Ryan C, Alhail M, Aldarwish A, Myint PK. Enhancing medication management of older adults in Qatar: healthcare professionals' perspectives on challenges, barriers and enabling solutions. Ther Adv Drug Saf 2024; 15:20420986241272846. [PMID: 39421007 PMCID: PMC11483847 DOI: 10.1177/20420986241272846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 07/11/2024] [Indexed: 10/19/2024] Open
Abstract
Background Polypharmacy and potentially inappropriate medications are significant challenges in older adults' medication management. The Consolidated Framework for Implementation Research (CFIR) is a comprehensive approach used to explore barriers and enablers to the healthcare system in guiding the effective implementation of evidence-based practices. Objectives This study examines the barriers and enablers to promote safe medication management among older adults in Qatar from healthcare professionals' perspectives. This includes identifying critical factors within the healthcare system influencing medication management and suggesting practical solutions to improve it. Design The study employs a qualitative design. Focus Groups (FGs) were conducted with healthcare professionals from the geriatric, mental health and medicine departments of Hamad Medical Corporation (HMC), the leading governmental sector in Qatar serving the older adult population. Methods Utilising the CFIR, this study analysed feedback from healthcare professionals through FGs at HMC. A combined inductive and deductive thematic analysis was applied to transcripts from five FGs, focusing on identifying barriers and enablers to safe medication management among older adults. Two researchers transcribed the audio-recorded FG discussions verbatim, and two researchers analysed the data using a mixed inductive and deductive thematic analysis approach utilising CFIR constructs. Results We engaged 53 healthcare professionals (31 physicians, 10 nurses and 12 clinical pharmacists) in FGs. The analysis identified current barriers and enabler themes under different CFIR constructs, including inner settings, outer settings, individual characteristics and intervention characteristics. We identified 44 themes, with 25 classifieds as barriers and 19 as enablers. The findings revealed that barriers and enablers within the inner settings were primarily related to structural characteristics, resources, policies, communication and culture. On the other hand, barriers and enablers from the outer settings included patients and caregivers, care coordination, policies and laws, and resources. Conclusion This study identified several barriers and enablers to promote medication management for older adults using the CFIR constructs from the perspective of healthcare professionals. The multifaceted findings emphasise involving stakeholders like clinical leaders, policymakers and decision-makers to address medication safety factors. A robust action plan, continuously monitored under Qatar's national strategy, is vital. Further research is needed to implement recommended interventions.
Collapse
Affiliation(s)
- Ameena Alyazeedi
- Pharmacy Department, Rumailah Hospital, Hamad Medical Corporation, PO Box 3050, Doha, Qatar
- Ageing Clinical and Experimental Research (ACER) Team, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, UK
| | - Carrie Stewart
- Ageing Clinical and Experimental Research (ACER) Team, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, UK
| | - Roy L. Soiza
- Ageing Clinical and Experimental Research (ACER) Team, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, UK
- Aberdeen Royal Infirmary, NHS Grampian, University of Aberdeen, Aberdeen, UK
| | - Derek Stewart
- Department of Clinical Pharmacy and Practice, College of Pharmacy, QU Health, Qatar University, Doha, Qatar
| | - Ahmed Awaisu
- Department of Clinical Pharmacy and Practice, College of Pharmacy, QU Health, Qatar University, Doha, Qatar
| | - Cristin Ryan
- School of Pharmacy and Pharmaceutical Sciences, Trinity College Dublin, Dublin, Ireland
| | - Moza Alhail
- Corporate Pharmacy, Hamad Medical Corporation, Doha, Qatar
| | | | - Phyo Kyaw Myint
- Ageing Clinical and Experimental Research (ACER) Team, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen, UK
- Aberdeen Royal Infirmary, NHS Grampian, University of Aberdeen, Aberdeen, UK
| |
Collapse
|
39
|
Hirosawa T, Harada Y, Tokumasu K, Ito T, Suzuki T, Shimizu T. Comparative Study to Evaluate the Accuracy of Differential Diagnosis Lists Generated by Gemini Advanced, Gemini, and Bard for a Case Report Series Analysis: Cross-Sectional Study. JMIR Med Inform 2024; 12:e63010. [PMID: 39357052 PMCID: PMC11483254 DOI: 10.2196/63010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 07/29/2024] [Accepted: 08/06/2024] [Indexed: 10/04/2024] Open
Abstract
BACKGROUND Generative artificial intelligence (GAI) systems by Google have recently been updated from Bard to Gemini and Gemini Advanced as of December 2023. Gemini is a basic, free-to-use model after a user's login, while Gemini Advanced operates on a more advanced model requiring a fee-based subscription. These systems have the potential to enhance medical diagnostics. However, the impact of these updates on comprehensive diagnostic accuracy remains unknown. OBJECTIVE This study aimed to compare the accuracy of the differential diagnosis lists generated by Gemini Advanced, Gemini, and Bard across comprehensive medical fields using case report series. METHODS We identified a case report series with relevant final diagnoses published in the American Journal Case Reports from January 2022 to March 2023. After excluding nondiagnostic cases and patients aged 10 years and younger, we included the remaining case reports. After refining the case parts as case descriptions, we input the same case descriptions into Gemini Advanced, Gemini, and Bard to generate the top 10 differential diagnosis lists. In total, 2 expert physicians independently evaluated whether the final diagnosis was included in the lists and its ranking. Any discrepancies were resolved by another expert physician. Bonferroni correction was applied to adjust the P values for the number of comparisons among 3 GAI systems, setting the corrected significance level at P value <.02. RESULTS In total, 392 case reports were included. The inclusion rates of the final diagnosis within the top 10 differential diagnosis lists were 73% (286/392) for Gemini Advanced, 76.5% (300/392) for Gemini, and 68.6% (269/392) for Bard. The top diagnoses matched the final diagnoses in 31.6% (124/392) for Gemini Advanced, 42.6% (167/392) for Gemini, and 31.4% (123/392) for Bard. Gemini demonstrated higher diagnostic accuracy than Bard both within the top 10 differential diagnosis lists (P=.02) and as the top diagnosis (P=.001). In addition, Gemini Advanced achieved significantly lower accuracy than Gemini in identifying the most probable diagnosis (P=.002). CONCLUSIONS The results of this study suggest that Gemini outperformed Bard in diagnostic accuracy following the model update. However, Gemini Advanced requires further refinement to optimize its performance for future artificial intelligence-enhanced diagnostics. These findings should be interpreted cautiously and considered primarily for research purposes, as these GAI systems have not been adjusted for medical diagnostics nor approved for clinical use.
Collapse
Affiliation(s)
- Takanobu Hirosawa
- Department of Diagnostic and Generalist Medicine, Dokkyo Medical University, Shimotsuga, Japan
| | - Yukinori Harada
- Department of Diagnostic and Generalist Medicine, Dokkyo Medical University, Shimotsuga, Japan
| | - Kazuki Tokumasu
- Department of General Medicine, Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Okayama, Japan
| | | | - Tomoharu Suzuki
- Department of Hospital Medicine, Urasoe General Hospital, Okinawa, Japan
| | - Taro Shimizu
- Department of Diagnostic and Generalist Medicine, Dokkyo Medical University, Shimotsuga, Japan
| |
Collapse
|
40
|
Brown AM, Kennebeck SS, Kerlin MJ, Widecan ML, Zhang Y, Reed JL. Using the Electronic Health Record to Implement Expedited Partner Therapy in the Pediatric Emergency Department. Pediatr Emerg Care 2024; 40:726-730. [PMID: 39051972 DOI: 10.1097/pec.0000000000003242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/27/2024]
Abstract
OBJECTIVES Expedited partner therapy (EPT) is a partner treatment strategy for sexually transmitted infections (STIs) including gonorrhea and chlamydia as well as trichomoniasis in some states. The process allows healthcare providers to write prescriptions for STI treatment among partners of infected patients without a previous medical evaluation. The Centers for Disease Control (CDC) has recommended EPT as a useful option to facilitate partner treatment, particularly male partners of women with chlamydia or gonorrhea infections. Our institution implemented EPT in 2016 after Ohio legislation was passed to authorize its use. We aim to describe the implementation process and descriptive outcomes of EPT adoption in a pediatric emergency department. METHODS This study describes use of the electronic health record for implementation of EPT in our institution. We conducted a retrospective review of EPT utilization from implementation. Electronic records from the implementation date of January 1, 2017, through December 31, 2021, were reviewed. We describe basic demographics and overall uptake of the intervention. Fisher exact tests were used for categorical variables and two-sample t -tests for continuous variables. RESULTS There was a total of 3275 positive test results and 739 EPT prescriptions written. Adolescent patients who received prescriptions for EPT were more likely to be female (78.7% of all EPT prescriptions, P = 0.007) and older than other patients (average age 17.7 vs 17.4 years, P = 0.004). There was no significant difference in race, insurance, or ethnicity among adolescent patients receiving and not receiving EPT. The percentage of positive STI tests associated with an EPT prescription ranged between 11.4% and 18.2%. Metronidazole was the most prescribed EPT medication. CONCLUSIONS The use of the electronic health record provides a platform for implementation of EPT. Our study highlights a potential strategy for increasing treatments of STIs through EPT prescribing in the emergency department setting.
Collapse
Affiliation(s)
- Angela M Brown
- From the Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH
| | | | - Melissa J Kerlin
- From the Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH
| | - Michelle L Widecan
- From the Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH
| | - Yin Zhang
- From the Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, OH
| | | |
Collapse
|
41
|
Thompson C, Mebrahtu T, Skyrme S, Bloor K, Andre D, Keenan AM, Ledward A, Yang H, Randell R. The effects of computerised decision support systems on nursing and allied health professional performance and patient outcomes: a systematic review and user contextualisation. HEALTH AND SOCIAL CARE DELIVERY RESEARCH 2024; 12:1-93. [PMID: 37470324 DOI: 10.3310/grnm5147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/21/2023]
Abstract
Background Computerised decision support systems (CDSS) are widely used by nurses and allied health professionals but their effect on clinical performance and patient outcomes is uncertain. Objectives Evaluate the effects of clinical decision support systems use on nurses', midwives' and allied health professionals' performance and patient outcomes and sense-check the results with developers and users. Eligibility criteria Comparative studies (randomised controlled trials (RCTs), non-randomised trials, controlled before-and-after (CBA) studies, interrupted time series (ITS) and repeated measures studies comparing) of CDSS versus usual care from nurses, midwives or other allied health professionals. Information sources Nineteen bibliographic databases searched October 2019 and February 2021. Risk of bias Assessed using structured risk of bias guidelines; almost all included studies were at high risk of bias. Synthesis of results Heterogeneity between interventions and outcomes necessitated narrative synthesis and grouping by: similarity in focus or CDSS-type, targeted health professionals, patient group, outcomes reported and study design. Included studies Of 36,106 initial records, 262 studies were assessed for eligibility, with 35 included: 28 RCTs (80%), 3 CBA studies (8.6%), 3 ITS (8.6%) and 1 non-randomised trial, a total of 1318 health professionals and 67,595 patient participants. Few studies were multi-site and most focused on decision-making by nurses (71%) or paramedics (5.7%). Standalone, computer-based CDSS featured in 88.7% of the studies; only 8.6% of the studies involved 'smart' mobile or handheld technology. Care processes - including adherence to guidance - were positively influenced in 47% of the measures adopted. For example, nurses' adherence to hand disinfection guidance, insulin dosing, on-time blood sampling, and documenting care were improved if they used CDSS. Patient care outcomes were statistically - if not always clinically - significantly improved in 40.7% of indicators. For example, lower numbers of falls and pressure ulcers, better glycaemic control, screening of malnutrition and obesity, and accurate triaging were features of professionals using CDSS compared to those who were not. Evidence limitations Allied health professionals (AHPs) were underrepresented compared to nurses; systems, studies and outcomes were heterogeneous, preventing statistical aggregation; very wide confidence intervals around effects meant clinical significance was questionable; decision and implementation theory that would have helped interpret effects - including null effects - was largely absent; economic data were scant and diverse, preventing estimation of overall cost-effectiveness. Interpretation CDSS can positively influence selected aspects of nurses', midwives' and AHPs' performance and care outcomes. Comparative research is generally of low quality and outcomes wide ranging and heterogeneous. After more than a decade of synthesised research into CDSS in healthcare professions other than medicine, the effect on processes and outcomes remains uncertain. Higher-quality, theoretically informed, evaluative research that addresses the economics of CDSS development and implementation is still required. Future work Developing nursing CDSS and primary research evaluation. Funding This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in Health and Social Care Delivery Research; 2023. See the NIHR Journals Library website for further project information. Registration PROSPERO 1 [number: CRD42019147773].
Collapse
Affiliation(s)
- Carl Thompson
- School of Healthcare, University of Leeds, Leeds, UK
| | | | - Sarah Skyrme
- School of Healthcare, University of Leeds, Leeds, UK
| | - Karen Bloor
- Department of Health Sciences, University of York, York, UK
| | - Deidre Andre
- Library Services, University of Leeds, Leeds, UK
| | | | | | - Huiqin Yang
- School of Healthcare, University of Leeds, Leeds, UK
| | - Rebecca Randell
- Faculty of Health Studies, University of Bradford, Bradford, UK
| |
Collapse
|
42
|
James MT, Dixon E, Tan Z, Mathura P, Datta I, Lall RN, Landry J, Minty EP, Samis GA, Winkelaar GB, Pannu N. Stepped-Wedge Trial of Decision Support for Acute Kidney Injury on Surgical Units. Kidney Int Rep 2024; 9:2996-3005. [PMID: 39430177 PMCID: PMC11489824 DOI: 10.1016/j.ekir.2024.07.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 07/22/2024] [Indexed: 10/22/2024] Open
Abstract
Introduction Acute kidney injury (AKI) is common in the perioperative setting and associated with poor outcomes. Whether clinical decision support improves early management and outcomes of AKI on surgical units is uncertain. Methods In this cluster-randomized, stepped-wedge trial, 8 surgical units in Alberta, Canada were randomized to various start dates to receive an education and clinical decision support intervention for recognition and early management of AKI. Eligible patients were aged ≥18 years, receiving care on a surgical unit, not already receiving dialysis, and with AKI. Results There were 2135 admissions of 2038 patients who met the inclusion criteria; mean (SD) age was 64.3 (16.2) years, and 885 (41.4%) were females. The proportion of patients who experienced the composite primary outcome of progression of AKI to a higher stage, receipt of dialysis, or death was 16.0% (178 events/1113 admissions) in the intervention group; and 17.5% (179 events/1022 admissions) in the control group (time-adjusted odds ratio, 0.76; 95% confidence interval [CI], 0.53-1.08; P = 0.12). There were no significant differences between groups in process of care outcomes within 48 hours of AKI onset, including administration of i.v. fluids, or withdrawal of medications affecting kidney function. Both groups experienced similar lengths of stay in hospital after AKI and change in estimated glomerular filtration rate (eGFR) at 3 months. Conclusion An education and clinical decision support intervention did not significantly improve processes of care or reduce progression of AKI, length of hospital stays, or recovery of kidney function in patients with AKI on surgical units.
Collapse
Affiliation(s)
- Matthew T. James
- Department of Medicine, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- Libin Cardiovascular Institute, University of Calgary, Calgary, Alberta, Canada
- O’Brien Institute of Public Health, University of Calgary, Calgary, Alberta, Canada
| | - Elijah Dixon
- Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- Department of Surgery, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Zhi Tan
- Department of Medicine, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Pamela Mathura
- Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
- Alberta Health Services, Edmonton, Alberta, Canada
| | - Indraneel Datta
- Department of Surgery, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Rohan N. Lall
- Department of Surgery, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Jennifer Landry
- Department of Medicine, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Evan P. Minty
- Department of Medicine, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Gregory A. Samis
- Department of Surgery, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Gerald B. Winkelaar
- Department of Surgery, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | - Neesh Pannu
- Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
43
|
Fan K, Cai X, Niranjan M. Discrepancy-based diffusion models for lesion detection in brain MRI. Comput Biol Med 2024; 181:109079. [PMID: 39217963 DOI: 10.1016/j.compbiomed.2024.109079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 07/22/2024] [Accepted: 08/23/2024] [Indexed: 09/04/2024]
Abstract
Diffusion probabilistic models (DPMs) have exhibited significant effectiveness in computer vision tasks, particularly in image generation. However, their notable performance heavily relies on labelled datasets, which limits their application in medical images due to the associated high-cost annotations. Current DPM-related methods for lesion detection in medical imaging, which can be categorized into two distinct approaches, primarily rely on image-level annotations. The first approach, based on anomaly detection, involves learning reference healthy brain representations and identifying anomalies based on the difference in inference results. In contrast, the second approach, resembling a segmentation task, employs only the original brain multi-modalities as prior information for generating pixel-level annotations. In this paper, our proposed model - discrepancy distribution medical diffusion (DDMD) - for lesion detection in brain MRI introduces a novel framework by incorporating distinctive discrepancy features, deviating from the conventional direct reliance on image-level annotations or the original brain modalities. In our method, the inconsistency in image-level annotations is translated into distribution discrepancies among heterogeneous samples while preserving information within homogeneous samples. This property retains pixel-wise uncertainty and facilitates an implicit ensemble of segmentation, ultimately enhancing the overall detection performance. Thorough experiments conducted on the BRATS2020 benchmark dataset containing multimodal MRI scans for brain tumour detection demonstrate the great performance of our approach in comparison to state-of-the-art methods.
Collapse
Affiliation(s)
- Keqiang Fan
- Electronics and Computer Science, University of Southampton, Southampton, SO17 1BJ, UK.
| | - Xiaohao Cai
- Electronics and Computer Science, University of Southampton, Southampton, SO17 1BJ, UK.
| | - Mahesan Niranjan
- Electronics and Computer Science, University of Southampton, Southampton, SO17 1BJ, UK.
| |
Collapse
|
44
|
Rambach T, Gleim P, Mandelartz S, Heizmann C, Kunze C, Kellmeyer P. Challenges and Facilitation Approaches for the Participatory Design of AI-Based Clinical Decision Support Systems: Protocol for a Scoping Review. JMIR Res Protoc 2024; 13:e58185. [PMID: 39235846 PMCID: PMC11413541 DOI: 10.2196/58185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Revised: 06/28/2024] [Accepted: 07/02/2024] [Indexed: 09/06/2024] Open
Abstract
BACKGROUND In the last few years, there has been an increasing interest in the development of artificial intelligence (AI)-based clinical decision support systems (CDSS). However, there are barriers to the successful implementation of such systems in practice, including the lack of acceptance of these systems. Participatory approaches aim to involve future users in designing applications such as CDSS to be more acceptable, feasible, and fundamentally more relevant for practice. The development of technologies based on AI, however, challenges the process of user involvement and related methods. OBJECTIVE The aim of this review is to summarize and present the main approaches, methods, practices, and specific challenges for participatory research and development of AI-based decision support systems involving clinicians. METHODS This scoping review will follow the Joanna Briggs Institute approach to scoping reviews. The search for eligible studies was conducted in the databases MEDLINE via PubMed; ACM Digital Library; Cumulative Index to Nursing and Allied Health; and PsycInfo. The following search filters, adapted to each database, were used: Period January 01, 2012, to October 31, 2023, English and German studies only, abstract available. The scoping review will include studies that involve the development, piloting, implementation, and evaluation of AI-based CDSS (hybrid and data-driven AI approaches). Clinical staff must be involved in a participatory manner. Data retrieval will be accompanied by a manual gray literature search. Potential publications will then be exported into reference management software, and duplicates will be removed. Afterward, the obtained set of papers will be transferred into a systematic review management tool. All publications will be screened, extracted, and analyzed: title and abstract screening will be carried out by 2 independent reviewers. Disagreements will be resolved by involving a third reviewer. Data will be extracted using a data extraction tool prepared for the study. RESULTS This scoping review protocol was registered on March 11, 2023, at the Open Science Framework. The full-text screening had already started at that time. Of the 3,118 studies screened by title and abstract, 31 were included in the full-text screening. Data collection and analysis as well as manuscript preparation are planned for the second and third quarter of 2024. The manuscript should be submitted towards the end of 2024. CONCLUSIONS This review will describe the current state of knowledge on participatory development of AI-based decision support systems. The aim is to identify knowledge gaps and provide research impetus. It also aims to provide relevant information for policy makers and practitioners. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/58185.
Collapse
Affiliation(s)
- Tabea Rambach
- Care & Technology Lab, Furtwangen University, Furtwangen, Germany
| | - Patricia Gleim
- Human-Technology Interaction Lab, Department of Neurosurgery, University Medical Center Freiburg, Freiburg im Breisgau, Germany
| | - Sekina Mandelartz
- Human-Technology Interaction Lab, Department of Neurosurgery, University Medical Center Freiburg, Freiburg im Breisgau, Germany
| | - Carolin Heizmann
- Human-Technology Interaction Lab, Department of Neurosurgery, University Medical Center Freiburg, Freiburg im Breisgau, Germany
| | - Christophe Kunze
- Care & Technology Lab, Furtwangen University, Furtwangen, Germany
| | - Philipp Kellmeyer
- Human-Technology Interaction Lab, Department of Neurosurgery, University Medical Center Freiburg, Freiburg im Breisgau, Germany
- Data and Web Science Group, School of Business Informatics and Mathematics, University of Mannheim, Mannheim, Germany
| |
Collapse
|
45
|
Alsalemi N, Sadowski C, Elftouh N, Kilpatrick K, Houle S, Leclerc S, Fernandez N, Lafrance JP. Designing and validating a clinical decision support algorithm for diabetic nephroprotection in older patients. BMJ Health Care Inform 2024; 31:e100869. [PMID: 39209331 PMCID: PMC11367403 DOI: 10.1136/bmjhci-2023-100869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Accepted: 08/06/2024] [Indexed: 09/04/2024] Open
Abstract
BACKGROUND Older patients with diabetic kidney disease (DKD) often do not receive optimal pharmacological treatment. Current clinical practice guidelines (CPGs) do not incorporate the concept of personalised care. Clinical decision support (CDS) algorithms that consider both evidence and personalised care to improve patient outcomes can improve the care of older adults. The aim of this research is to design and validate a CDS algorithm for prescribing renin-angiotensin-aldosterone system inhibitors (RAASi) for older patients with diabetes. METHODS The design of the CDS tool included the following phases: (1) gathering evidence from systematic reviews and meta-analyses of randomised clinical trials to determine the number needed to treat (NNT) and time-to-benefit (TTB) values applicable to our target population for use in the algorithm. (2) Building a list of potential cases that addressed different prescribing scenarios (starting, adding or switching to RAASi). (3) Reviewing relevant guidelines and extracting all recommendations related to prescribing RAASi for DKD. (4) Matching NNT and TTB with specific clinical cases. (5) Validating the CDS algorithm using Delphi technique. RESULTS We created a CDS algorithm that covered 15 possible scenarios and we generated 36 personalised and nine general recommendations based on the calculated and matched NNT and TTB values and considering the patient's life expectancy and functional capacity. The algorithm was validated by experts in three rounds of Delphi study. CONCLUSION We designed an evidence-informed CDS algorithm that integrates considerations often overlooked in CPGs. The next steps include testing the CDS algorithm in a clinical trial.
Collapse
Affiliation(s)
- Noor Alsalemi
- College of Pharmacy - Clinical Pharmacy and Practice, Qatar University, Doha, Qatar
- Universite de Montreal, Montreal, Quebec, Canada
| | | | - Naoual Elftouh
- Hopital Maisonneuve-Rosemont Centre de Recherche, Montreal, Quebec, Canada
| | | | | | | | | | - Jean-Philippe Lafrance
- Universite de Montreal, Montreal, Quebec, Canada
- Hopital Maisonneuve-Rosemont Centre de Recherche, Montreal, Quebec, Canada
| |
Collapse
|
46
|
Shang Z, Chauhan V, Devi K, Patil S. Artificial Intelligence, the Digital Surgeon: Unravelling Its Emerging Footprint in Healthcare - The Narrative Review. J Multidiscip Healthc 2024; 17:4011-4022. [PMID: 39165254 PMCID: PMC11333562 DOI: 10.2147/jmdh.s482757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Accepted: 08/09/2024] [Indexed: 08/22/2024] Open
Abstract
Background Artificial Intelligence (AI) holds transformative potential for the healthcare industry, offering innovative solutions for diagnosis, treatment planning, and improving patient outcomes. As AI continues to be integrated into healthcare systems, it promises advancements across various domains. This review explores the diverse applications of AI in healthcare, along with the challenges and limitations that need to be addressed. The aim is to provide a comprehensive overview of AI's impact on healthcare and to identify areas for further development and focus. Main Applications The review discusses the broad range of AI applications in healthcare. In medical imaging and diagnostics, AI enhances the accuracy and efficiency of diagnostic processes, aiding in early disease detection. AI-powered clinical decision support systems assist healthcare professionals in patient management and decision-making. Predictive analytics using AI enables the prediction of patient outcomes and identification of potential health risks. AI-driven robotic systems have revolutionized surgical procedures, improving precision and outcomes. Virtual assistants and chatbots enhance patient interaction and support, providing timely information and assistance. In the pharmaceutical industry, AI accelerates drug discovery and development by identifying potential drug candidates and predicting their efficacy. Additionally, AI improves administrative efficiency and operational workflows in healthcare, streamlining processes and reducing costs. AI-powered remote monitoring and telehealth solutions expand access to healthcare, particularly in underserved areas. Challenges and Limitations Despite the significant promise of AI in healthcare, several challenges persist. Ensuring the reliability and consistency of AI-driven outcomes is crucial. Privacy and security concerns must be navigated carefully, particularly in handling sensitive patient data. Ethical considerations, including bias and fairness in AI algorithms, need to be addressed to prevent unintended consequences. Overcoming these challenges is critical for the ethical and successful integration of AI in healthcare. Conclusion The integration of AI into healthcare is advancing rapidly, offering substantial benefits in improving patient care and operational efficiency. However, addressing the associated challenges is essential to fully realize the transformative potential of AI in healthcare. Future efforts should focus on enhancing the reliability, transparency, and ethical standards of AI technologies to ensure they contribute positively to global health outcomes.
Collapse
Affiliation(s)
- Zifang Shang
- Guangdong Engineering Technological Research Centre of Clinical Molecular Diagnosis and Antibody Drugs, Meizhou People’s Hospital (Huangtang Hospital), Meizhou Academy of Medical Sciences, Meizhou, People’s Republic of China
| | - Varun Chauhan
- Multi-Disciplinary Research Unit, Government Institute of Medical Sciences, Greater Noida, India
| | - Kirti Devi
- Department of Medicine, Government Institute of Medical Sciences, Greater Noida, India
| | - Sandip Patil
- Department Haematology and Oncology, Shenzhen Children’s Hospital, Shenzhen, People’s Republic of China
| |
Collapse
|
47
|
Jiang P, Niu W, Wang Q, Yuan R, Chen K. Understanding Users' Acceptance of Artificial Intelligence Applications: A Literature Review. Behav Sci (Basel) 2024; 14:671. [PMID: 39199067 PMCID: PMC11351494 DOI: 10.3390/bs14080671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 07/30/2024] [Accepted: 08/01/2024] [Indexed: 09/01/2024] Open
Abstract
In recent years, with the continuous expansion of artificial intelligence (AI) application forms and fields, users' acceptance of AI applications has attracted increasing attention from scholars and business practitioners. Although extant studies have extensively explored user acceptance of different AI applications, there is still a lack of understanding of the roles played by different AI applications in human-AI interaction, which may limit the understanding of inconsistent findings about user acceptance of AI. This study addresses this issue by conducting a systematic literature review on AI acceptance research in leading journals of Information Systems and Marketing disciplines from 2020 to 2023. Based on a review of 80 papers, this study made contributions by (i) providing an overview of methodologies and theoretical frameworks utilized in AI acceptance research; (ii) summarizing the key factors, potential mechanisms, and theorization of users' acceptance response to AI service providers and AI task substitutes, respectively; and (iii) proposing opinions on the limitations of extant research and providing guidance for future research.
Collapse
Affiliation(s)
- Pengtao Jiang
- School of Information Science and Engineering, NingboTech University, Ningbo 315100, China;
- Nottingham University Business School China, University of Nottingham Ningbo China, Ningbo 315100, China;
| | - Wanshu Niu
- Business School, Ningbo University, Ningbo 315211, China;
| | - Qiaoli Wang
- School of Management, Zhejiang University, Hangzhou 310058, China;
| | - Ruizhi Yuan
- Nottingham University Business School China, University of Nottingham Ningbo China, Ningbo 315100, China;
| | - Keyu Chen
- Business School, Ningbo University, Ningbo 315211, China;
| |
Collapse
|
48
|
An L, Lukac PJ, Kulkarni D. Clinical Decision Support Tool to Promote Adoption of New Neonatal Hyperbilirubinemia Guidelines. Appl Clin Inform 2024; 15:751-755. [PMID: 38897228 PMCID: PMC11390172 DOI: 10.1055/a-2348-3958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/21/2024] Open
Abstract
OBJECTIVE This study aimed to increase the adoption of revised newborn hyperbilirubinemia guidelines by building a clinical decision support (CDS) tool into templated notes. METHODS We created a rule-based CDS tool that correctly populates the phototherapy threshold from more than 2,700 possible values directly into the note and guides clinicians to an appropriate follow-up plan consistent with the new recommendations. We manually reviewed notes before and after CDS tool implementation to evaluate new guidelines adherence, and surveys were used to assess clinicians' perceptions. RESULTS Postintervention documentation showed a decrease in old risk stratification methods (48 to 0.4%, p < 0.01) and an increase in new phototherapy threshold usage (39 to 95%, p < 0.01) and inclusion of follow-up guidance (28 to 79%, p < 0.01). Survey responses on workflow efficiency and satisfaction did not significantly change after CDS tool implementation. CONCLUSION Our study details an innovative CDS tool that contributed to increased adoption of newly revised guidelines after the addition of this tool to templated notes.
Collapse
Affiliation(s)
- Lucia An
- Department of Pediatrics at UCLA Mattel Children's Hospital, Los Angeles, California, United States
| | - Paul J Lukac
- Department of Pediatrics and Office of Health Informatics and Analytics, University of California, Los Angeles, California, United States
| | - Deepa Kulkarni
- Department of Pediatrics at UCLA Mattel Children's Hospital, Los Angeles, California, United States
| |
Collapse
|
49
|
Ng APP, Chen Q, Wu DD, Leung SC. Improving hypertension management in primary care. BMJ 2024; 386:q1466. [PMID: 39043414 DOI: 10.1136/bmj.q1466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/25/2024]
Affiliation(s)
- Amy Pui Pui Ng
- Department of Family Medicine and Primary Care, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
| | - Qingqi Chen
- Department of Family Medicine and Primary Care, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
| | - Diana Dan Wu
- Department of Family Medicine and Primary Care, School of Clinical Medicine, Li Ka Shing Faculty of Medicine, University of Hong Kong, Hong Kong, China
| | | |
Collapse
|
50
|
Lampe D, Grosser J, Grothe D, Aufenberg B, Gensorowsky D, Witte J, Greiner W. How intervention studies measure the effectiveness of medication safety-related clinical decision support systems in primary and long-term care: a systematic review. BMC Med Inform Decis Mak 2024; 24:188. [PMID: 38965569 PMCID: PMC11225126 DOI: 10.1186/s12911-024-02596-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Accepted: 07/01/2024] [Indexed: 07/06/2024] Open
Abstract
BACKGROUND Medication errors and associated adverse drug events (ADE) are a major cause of morbidity and mortality worldwide. In recent years, the prevention of medication errors has become a high priority in healthcare systems. In order to improve medication safety, computerized Clinical Decision Support Systems (CDSS) are increasingly being integrated into the medication process. Accordingly, a growing number of studies have investigated the medication safety-related effectiveness of CDSS. However, the outcome measures used are heterogeneous, leading to unclear evidence. The primary aim of this study is to summarize and categorize the outcomes used in interventional studies evaluating the effects of CDSS on medication safety in primary and long-term care. METHODS We systematically searched PubMed, Embase, CINAHL, and Cochrane Library for interventional studies evaluating the effects of CDSS targeting medication safety and patient-related outcomes. We extracted methodological characteristics, outcomes and empirical findings from the included studies. Outcomes were assigned to three main categories: process-related, harm-related, and cost-related. Risk of bias was assessed using the Evidence Project risk of bias tool. RESULTS Thirty-two studies met the inclusion criteria. Almost all studies (n = 31) used process-related outcomes, followed by harm-related outcomes (n = 11). Only three studies used cost-related outcomes. Most studies used outcomes from only one category and no study used outcomes from all three categories. The definition and operationalization of outcomes varied widely between the included studies, even within outcome categories. Overall, evidence on CDSS effectiveness was mixed. A significant intervention effect was demonstrated by nine of fifteen studies with process-related primary outcomes (60%) but only one out of five studies with harm-related primary outcomes (20%). The included studies faced a number of methodological problems that limit the comparability and generalizability of their results. CONCLUSIONS Evidence on the effectiveness of CDSS is currently inconclusive due in part to inconsistent outcome definitions and methodological problems in the literature. Additional high-quality studies are therefore needed to provide a comprehensive account of CDSS effectiveness. These studies should follow established methodological guidelines and recommendations and use a comprehensive set of harm-, process- and cost-related outcomes with agreed-upon and consistent definitions. PROSPERO REGISTRATION CRD42023464746.
Collapse
Affiliation(s)
- David Lampe
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany.
| | - John Grosser
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| | - Dennis Grothe
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| | - Birthe Aufenberg
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| | | | | | - Wolfgang Greiner
- Department of Health Economics and Health Care Management, School of Public Health, Bielefeld University, Universitätsstraße 25, Bielefeld, 33615, Germany
| |
Collapse
|