1
|
Simeon-Dubach D, Glueck LM, Singh Kalra P, Benaouag S, Ansari S. ISO/GxP Industrial Facilities with In-House Biobanks to Pursue Accreditation for ISO 20387. Biopreserv Biobank 2025. [PMID: 40358128 DOI: 10.1089/bio.2024.0149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/15/2025] Open
Abstract
Introduction: The International Organization for Standardization (ISO) standard 20387:2018 outlines general requirements for biobanks to ensure competence, impartiality, and uniform operation. Reasons for seeking ISO 20387 accreditation are improved compliance, international recognition, and increased credibility of a biobank. Methods: The Philip Morris International (PMI) BioBank is an in-house biobank of an ISO/GxP-driven, for-profit organization. A cross-functional team analyzed ISO 20387 requirements and assessed them against the existing quality management system (QMS) to identify gaps and develop a remediation plan. This allowed the development of an implementation plan with clear timelines. An audit room was reserved for the auditor and PMI BioBank representatives for the two-day audit. In the second room, a group of internal experts were available to answer the auditor's questions, prepare solutions, and bring them to the audit room. Results: The gap analysis did not reveal any relevant deficits, given that the PMI BioBank follows the corporate QMS mainly based on ISO 17025. However, numerous checklist items require more specific adjustments to the existing QMS. Therefore, a corrective and preventive action (CAPA) was opened to demonstrate that gaps were identified and brought under control during the audit process. Four key areas required documentation employee competencies, complaint management, conduction of risk analysis, and impartiality maintenance. The audit lasted two days. One minor deviation was addressed with a detailed explanation of the process and was accepted by the auditor. Conclusions: Being part of an ISO/GxP-driven organization allowed the PMI BioBank to go through the ISO 20387 accreditation process rapidly. However, there was a noteworthy need for financial and manpower resources. Still, the benefits of demonstrating highly standardized processes are impactful as they enhance compliance and gain internal and external recognition, credibility, and reputation of an organization.
Collapse
Affiliation(s)
| | - Lotte Marie Glueck
- Biobank Operation Engineer, Philip Morris International, Neuchâtel, Switzerland
| | | | - Souad Benaouag
- Quality Operations Lead, Philip Morris International, Neuchâtel, Switzerland
| | - Sam Ansari
- Manager Biobank & LIMS, Philip Morris International, Neuchâtel, Switzerland
| |
Collapse
|
2
|
Schoeps B, Lauer UM, Elbers K. Deciphering permissivity of human tumor ecosystems to oncolytic viruses. Oncogene 2025; 44:1069-1077. [PMID: 40148688 PMCID: PMC11996678 DOI: 10.1038/s41388-025-03357-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2024] [Revised: 02/10/2025] [Accepted: 03/17/2025] [Indexed: 03/29/2025]
Abstract
Effective cancer therapy involves initiation of a tumor-specific immune response. Consequently, the interest in oncolytic viruses (OV) capable of triggering immunogenic cell death has sparked in recent years. However, the common use of pre-clinical models that fail to mirror patient tumor ecosystems (TES) hinders clinical translation. Here, we provide a condensed view on the intricate interplay between several aspects of TES and OV action and discuss these considerations in the view of recently developed pre-clinical human model systems. Given the urgent demand for innovative cancer treatments, the purpose of this review is to highlight the so-far overlooked complex impact of the tumor microenvironment (TME) on OV permissivity, with the intent to provide a foundation for future, more effective pre-clinical studies.
Collapse
Affiliation(s)
| | - Ulrich M Lauer
- Department of Medical Oncology and Pneumology, Virotherapy Center Tübingen (VCT), Medical University Hospital, Tübingen, Germany
- German Cancer Consortium (DKTK), German Cancer Research Center (DKFZ), Tübingen, Germany
| | | |
Collapse
|
3
|
Degen PM, Medo M. Replicability of bulk RNA-Seq differential expression and enrichment analysis results for small cohort sizes. PLoS Comput Biol 2025; 21:e1011630. [PMID: 40324149 DOI: 10.1371/journal.pcbi.1011630] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 05/14/2025] [Accepted: 04/07/2025] [Indexed: 05/07/2025] Open
Abstract
The high-dimensional and heterogeneous nature of transcriptomics data from RNA sequencing (RNA-Seq) experiments poses a challenge to routine downstream analysis steps, such as differential expression analysis and enrichment analysis. Additionally, due to practical and financial constraints, RNA-Seq experiments are often limited to a small number of biological replicates. In light of recent studies on the low replicability of preclinical cancer research, it is essential to understand how the combination of population heterogeneity and underpowered cohort sizes affects the replicability of RNA-Seq research. Using 18'000 subsampled RNA-Seq experiments based on real gene expression data from 18 different data sets, we find that differential expression and enrichment analysis results from underpowered experiments are unlikely to replicate well. However, low replicability does not necessarily imply low precision of results, as data sets exhibit a wide range of possible outcomes. In fact, 10 out of 18 data sets achieve high median precision despite low recall and replicability for cohorts with more than five replicates. To assist researchers constrained by small cohort sizes in estimating the expected performance regime of their data sets, we provide a simple bootstrapping procedure that correlates strongly with the observed replicability and precision metrics. We conclude with practical recommendations to alleviate problems with underpowered RNA-Seq studies.
Collapse
Affiliation(s)
- Peter Methys Degen
- Department for BioMedical Research, Radiation Oncology, University of Bern, Bern, Switzerland
- Department of Radiation Oncology, Inselspital Bern University Hospital, Bern, Switzerland
- Graduate School for Cellular and Biomedical Sciences, University of Bern, Bern, Switzerland
| | - Matúš Medo
- Department for BioMedical Research, Radiation Oncology, University of Bern, Bern, Switzerland
- Department of Radiation Oncology, Inselspital Bern University Hospital, Bern, Switzerland
| |
Collapse
|
4
|
Hamilton DG, Page MJ, Everitt S, Fraser H, Fidler F. Cancer researchers' experiences with and perceptions of research data sharing: Results of a cross-sectional survey. Account Res 2025; 32:530-557. [PMID: 38299475 DOI: 10.1080/08989621.2024.2308606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Accepted: 01/18/2024] [Indexed: 02/02/2024]
Abstract
BACKGROUND Despite wide recognition of the benefits of sharing research data, public availability rates have not increased substantially in oncology or medicine more broadly over the last decade. METHODS We surveyed 285 cancer researchers to determine their prior experience with sharing data and views on known drivers and inhibitors. RESULTS We found that 45% of respondents had shared some data from their most recent empirical publication, with respondents who typically studied non-human research participants, or routinely worked with human genomic data, more likely to share than those who did not. A third of respondents added that they had previously shared data privately, with 74% indicating that doing so had also led to authorship opportunities or future collaborations for them. Journal and funder policies were reported to be the biggest general drivers toward sharing, whereas commercial interests, agreements with industrial sponsors and institutional policies were the biggest prohibitors. We show that researchers' decisions about whether to share data are also likely to be influenced by participants' desires. CONCLUSIONS Our survey suggests that increased promotion and support by research institutions, alongside greater championing of data sharing by journals and funders, may motivate more researchers in oncology to share their data.
Collapse
Affiliation(s)
- Daniel G Hamilton
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, Australia
- Melbourne Medical School, Faculty of Medicine, Dentistry & Health Sciences, University of Melbourne, Melbourne, Australia
| | - Matthew J Page
- Methods in Evidence Synthesis Unit, School of Public Health & Preventive Medicine, Monash University, Melbourne, Australia
| | - Sarah Everitt
- Sir Peter MacCallum Department of Oncology, University of Melbourne, Melbourne, Australia
| | - Hannah Fraser
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, Australia
| | - Fiona Fidler
- MetaMelb Research Group, School of BioSciences, University of Melbourne, Melbourne, Australia
- School of History & Philosophy of Sciences, University of Melbourne, Melbourne, Australia
| |
Collapse
|
5
|
Smith N, McGuire H, Fazekas de St Groth B. A Workflow to Achieve Saturation of Fluorophore-Conjugated Monoclonal Antibodies for Robust Comparison of Biomarker Expression. Cytometry A 2025. [PMID: 40298242 DOI: 10.1002/cyto.a.24938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2025] [Revised: 02/25/2025] [Accepted: 04/18/2025] [Indexed: 04/30/2025]
Abstract
Antibody titration is an important step in every cytometric workflow, with the goal being to determine antibody concentrations that ensure highly reproducible results. When aiming to compare antigen expression between samples using mean or median fluorescence intensity (MFI), reagents should be used at a saturating concentration so that unavoidable variations in staining conditions do not affect the fluorescence signal. The recommended concentrations of commercially available fluorophore-labeled monoclonal antibodies (mAbs) may not achieve plateau staining, and their saturating concentration may be too high to be experimentally useful. To address these common concerns, we present a novel method to achieve saturation of fluorophore-conjugated mAbs, by 'spiking-in' unlabelled antibody of the same clone. Here, we demonstrate the application of this workflow to human anti-CD3 (clone OKT3, mouse IgG2a) and anti-TCRαβ (clone IP26, mouse IgG1), two mAbs that do not achieve saturation at 2-fold above their commercially recommended concentrations. First, the saturating concentration of unlabelled (purified) OKT3 and IP26 was determined by detection with a fluorophore-labeled anti-mouse IgG (H + L) secondary antibody. Titration curves of unlabelled and labeled mAbs were compared for each clone to determine whether labeling had resulted in any loss in binding activity. Unlabelled antibody was then 'spiked' into the labeled antibody at varying ratios, and those that achieved saturation while maintaining an adequate fluorescence signal were identified. We demonstrate that antibody saturation can be achieved with an optimized mixture of labeled and unlabelled antibody, while maintaining a clear signal from the fluorophore. While this workflow has only been applied to OKT3 and IP26, it has potential applicability for any antibody clone for which both labeled and unlabelled preparations are available. This method has significance for robust comparison of biomarker expression when fluorophore labeled reagents do not reach saturation under standard staining conditions.
Collapse
Affiliation(s)
- Natalie Smith
- School of Medical Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Helen McGuire
- School of Medical Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| | - Barbara Fazekas de St Groth
- School of Medical Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia
| |
Collapse
|
6
|
Solomon AD, Dabral S, Brajesh RG, Day BW, Juric M, Zielonka J, Bosnjak ZJ, Pant T. Understanding the Mechanisms of Chemotherapy-Related Cardiotoxicity Employing hiPSC-Derived Cardiomyocyte Models for Drug Screening and the Identification of Genetic and Epigenetic Variants. Int J Mol Sci 2025; 26:3966. [PMID: 40362211 DOI: 10.3390/ijms26093966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2025] [Revised: 04/10/2025] [Accepted: 04/18/2025] [Indexed: 05/15/2025] Open
Abstract
Chemotherapy-related cardiotoxicity (CTRTOX) is a profound and common side effect of cancer-based therapy in a subset of patients. The underlying factors and the associated mechanisms contributing to severe toxicity of the heart among these patients remain unknown. While challenges remain in accessing human subjects and their ventricular cardiomyocytes (CMs), advancements in human induced pluripotent stem cell (hiPSC)-technology-based CM differentiation protocols over the past few decades have paved the path for iPSC-based models of human cardiac diseases. Here, we offer a detailed analysis of the underlying mechanisms of CTRTOX. We also discuss the recent advances in therapeutic strategies in different animal models and clinical trials. Furthermore, we explore the prospects of iPSC-based models for identifying novel functional targets and developing safer chemotherapy regimens for cancer patients that may be beneficial for developing personalized cardioprotectants and their application in clinical practice.
Collapse
Affiliation(s)
- Abhishikt David Solomon
- Adams School of Dentistry, Oral and Craniofacial Biomedicine, University of North Carolina, Chapel Hill, NC 27599, USA
| | - Swarna Dabral
- Maharishi Markandeshwar College of Pharmacy, Maharishi Markandeshwar (Deemed to be University), Mullana, Ambala 133207, India
| | - Raman Gulab Brajesh
- Department of Biomedical Engineering and Bioinformatics, Swami Vivekanand Technical University, Durg 491107, India
| | | | - Matea Juric
- Department of Biophysics, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, USA
| | - Jacek Zielonka
- Department of Biophysics, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, USA
| | - Zeljko J Bosnjak
- Department of Medicine, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, USA
| | - Tarun Pant
- Department of Medicine, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, USA
- Department of Surgery, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, WI 53226, USA
| |
Collapse
|
7
|
Miedel MT, Varmazyad M, Xia M, Brooks MM, Gavlock DC, Reese C, Behari J, Soto-Gutierrez A, Gough A, Taylor DL, Schurdak ME. Validation of microphysiological systems for interpreting patient heterogeneity requires robust reproducibility analytics and experimental metadata. CELL REPORTS METHODS 2025; 5:101028. [PMID: 40233763 DOI: 10.1016/j.crmeth.2025.101028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Revised: 12/24/2024] [Accepted: 03/20/2025] [Indexed: 04/17/2025]
Abstract
Multi-cell-type, 3D microphysiological systems (MPS) that recapitulate normal organ/organ system functions and the progression of diseases are being applied in drug discovery and development programs to enable precision medicine. A critical step for this application is to demonstrate the reproducibility of the MPS and its ability to identify biologic/clinical heterogeneity from experimental variability, which requires capturing detailed metadata associated with MPS studies as well as a strong analytical approach for assessing reproducibility. Detailed metadata ensure that identical study parameters are being compared when evaluating reproducibility. We have developed the Pittsburgh reproducibility protocol (PReP), which uses a set of common statistical metrics, the coefficient of variation (CV), ANOVA, and intraclass correlation coefficient (ICC), in a pipeline as a standard approach to evaluate the intra- and interstudy reproducibility of MPS performance. The PReP can be employed to identify biological/clinical heterogeneity relevant to precision medicine.
Collapse
Affiliation(s)
- Mark T Miedel
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Pathology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Mahboubeh Varmazyad
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Mengying Xia
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Maria Mori Brooks
- Department of Epidemiology, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA; Department of Biostatistics, University of Pittsburgh School of Public Health, Pittsburgh, PA, USA
| | - Dillon C Gavlock
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Celeste Reese
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Jaideep Behari
- Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Division of Gastroenterology, Hepatology and Nutrition, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - Alejandro Soto-Gutierrez
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Pathology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Center for Transcriptional Medicine, Pittsburgh, PA 15261, USA
| | - Albert Gough
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA
| | - D Lansing Taylor
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Computational and System Biology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15260, USA
| | - Mark E Schurdak
- Drug Discovery Institute, University of Pittsburgh, Pittsburgh, PA 15261, USA; Pittsburgh Liver Research Center, University of Pittsburgh, Pittsburgh, PA 15261, USA; Department of Computational and System Biology, School of Medicine, University of Pittsburgh, Pittsburgh, PA 15260, USA.
| |
Collapse
|
8
|
Meirmans S, Luijken K, Bruijning-Verhagen PCJL, Groenwold RHH, de Boer AR. The function of conducting a direct replication may be different than typically assumed: understanding contextuality and asymmetry. J Clin Epidemiol 2025; 183:111785. [PMID: 40222717 DOI: 10.1016/j.jclinepi.2025.111785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2024] [Revised: 03/26/2025] [Accepted: 04/07/2025] [Indexed: 04/15/2025]
Abstract
Direct replication, that is, analysis of new data with the same study protocol, has a purpose in checking the reliability of earlier research findings. However, using a case study we show that direct replication can have an additional function. We find that identical numerical replication results can be the result of differential effects of biases across different data sources and we draw attention to the risk of asymmetric evaluation in such cases. We then show how exact replications have the important function to bring into focus the contextualities inherent in the generation of research findings. Understanding the contextuality allows for a better and richer understanding of what the results imply.
Collapse
Affiliation(s)
- Stephanie Meirmans
- Department of Ethics, Law and Humanities, Amsterdam UMC, Amsterdam Medical Center, University of Amsterdam, Meibergdreef 9, Amsterdam 1105 AZ, The Netherlands.
| | - Kim Luijken
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht 3584 CX, The Netherlands
| | - Patricia C J L Bruijning-Verhagen
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht 3584 CX, The Netherlands
| | - Rolf H H Groenwold
- Department of Clinical Epidemiology, Leiden University Medical Center, Albinusdreef 2, Leiden 2333 ZA, The Netherlands
| | - Annemarijn R de Boer
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht 3584 CX, The Netherlands
| |
Collapse
|
9
|
Mundinger C, Schulz NKE, Singh P, Janz S, Schurig M, Seidemann J, Kurtz J, Müller C, Schielzeth H, von Kortzfleisch VT, Richter SH. Testing the reproducibility of ecological studies on insect behavior in a multi-laboratory setting identifies opportunities for improving experimental rigor. PLoS Biol 2025; 23:e3003019. [PMID: 40261831 PMCID: PMC12013911 DOI: 10.1371/journal.pbio.3003019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2024] [Accepted: 03/25/2025] [Indexed: 04/24/2025] Open
Abstract
The reproducibility of studies involving insect species is an underexplored area in the broader discussion about poor reproducibility in science. Our study addresses this gap by conducting a systematic multi-laboratory investigation into the reproducibility of ecological studies on insect behavior. We implemented a 3 × 3 experimental design, incorporating three study sites, and three independent experiments on three insect species from different orders: the turnip sawfly (Athalia rosae, Hymenoptera), the meadow grasshopper (Pseudochorthippus parallelus, Orthoptera), and the red flour beetle (Tribolium castaneum, Coleoptera). Using random-effect meta-analysis, we compared the consistency and accuracy of treatment effects on insect behavioral traits across replicate experiments. We successfully reproduced the overall statistical treatment effect in 83% of the replicate experiments, but overall effect size replication was achieved in only 66% of the replicates. Thus, though demonstrating sufficient reproducibility in some measures, this study also provides the first experimental evidence for cases of poor reproducibility in insect experiments. Our findings further show that reasons causing poor reproducibility established in rodent research also hold for other study organisms and research questions. We believe that a rethinking of current best practices is required to face reproducibility issues in insect studies but also across disciplines. Specifically, we advocate for adopting open research practices and the implementation of methodological strategies that reduce bias and problems arising from over-standardization. With respect to the latter, the introduction of systematic variation through multi-laboratory or heterogenized designs may contribute to improved reproducibility in studies involving any living organisms.
Collapse
Affiliation(s)
- Carolin Mundinger
- Department of Behavioural Biology, University of Münster, Münster, Germany
| | - Nora K. E. Schulz
- Institute for Evolution and Biodiversity, University of Münster, Münster, Germany
| | - Pragya Singh
- Department of Chemical Ecology, Bielefeld University, Bielefeld, Germany
| | - Steven Janz
- Department of Chemical Ecology, Bielefeld University, Bielefeld, Germany
| | - Maximilian Schurig
- Institute for Evolution and Biodiversity, University of Münster, Münster, Germany
| | - Jacob Seidemann
- Institute of Ecology and Evolution, Friedrich Schiller University Jena, Jena, Germany
| | - Joachim Kurtz
- Institute for Evolution and Biodiversity, University of Münster, Münster, Germany
- Joint Institute for Individualisation in a Changing Environment, University of Münster and Bielefeld University, Münster and Bielefeld, Germany
| | - Caroline Müller
- Department of Chemical Ecology, Bielefeld University, Bielefeld, Germany
- Joint Institute for Individualisation in a Changing Environment, University of Münster and Bielefeld University, Münster and Bielefeld, Germany
| | - Holger Schielzeth
- Institute of Ecology and Evolution, Friedrich Schiller University Jena, Jena, Germany
- Joint Institute for Individualisation in a Changing Environment, University of Münster and Bielefeld University, Münster and Bielefeld, Germany
| | | | - S. Helene Richter
- Department of Behavioural Biology, University of Münster, Münster, Germany
- Joint Institute for Individualisation in a Changing Environment, University of Münster and Bielefeld University, Münster and Bielefeld, Germany
| |
Collapse
|
10
|
Bicer S, Nelson A, Carayannis K, Kimmelman J. Supporting evidence in phase 2 cancer trial protocols: a content analysis. J Natl Cancer Inst 2025; 117:637-643. [PMID: 39531308 PMCID: PMC11972674 DOI: 10.1093/jnci/djae281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2024] [Revised: 10/21/2024] [Accepted: 11/03/2024] [Indexed: 11/16/2024] Open
Abstract
BACKGROUND Phase 2 trials are instrumental for designing definitive efficacy trials or attaining accelerated approval. However, high attrition of drug candidates in phase 2 trials raises questions about their supporting evidence. METHODS We developed a typology of supporting evidence for phase 2 cancer trials. We also devised a scheme for capturing elements that enable an assessment of the strength of such evidence. Using this framework, we content analyzed supporting evidence provided in protocols of 50 randomly sampled phase 2 cancer monotherapy trials between January 2014 and January 2019, available on ClinicalTrials.gov. RESULTS Of the 50 protocols in our sample, 52% were industry funded. Most invoked supporting evidence deriving from trials against different cancers (n = 28, 56%) or preclinical studies (n = 48, 96%) but not from clinical studies involving the target drug-indication pairing (n = 23, 46%). When presenting evidence from models, only 1 (2%) protocol explained its translational relevance. Instead, protocols implied translatability by describing molecular (86%) and pathophysiological (84%) processes shared by model and target systems. Protocols often provided information for assessing the magnitude, precision, and risk of bias for supporting trials (n = 43; 93%, 91%, 47%, respectively). However, such information was often unavailable for preclinical studies (n = 49; 53%, 22%, 59%, respectively). CONCLUSIONS Supporting evidence is key to justifying the commitment of scientific resources and patients to a clinical hypothesis. Protocols often omit elements that would enable critical assessment of supporting evidence for phase 2 monotherapy cancer trials. These gaps suggest the promise of more structured approaches for presenting supporting evidence.
Collapse
Affiliation(s)
- Selin Bicer
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| | - Angela Nelson
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| | - Katerina Carayannis
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| | - Jonathan Kimmelman
- Department of Equity, Ethics and Policy, Studies of Translation, Ethics and Medicine, McGill University, Montreal, QC, Canada
| |
Collapse
|
11
|
Tang G. Mapping nine decades of research integrity studies (1935-2024): A scientometric analysis. Account Res 2025:1-36. [PMID: 40083052 DOI: 10.1080/08989621.2025.2470860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2024] [Accepted: 02/19/2025] [Indexed: 03/16/2025]
Abstract
BACKGROUND Research integrity is fundamental to responsible research practice. Despite attention, the intellectual structure and evolution of this field remains underexplored. This study maps the knowledge landscape of research integrity, identifying key themes, contributions, and trends. METHODS A scientometric analysis was conducted on 6,895 records from Web of Science and Scopus (1935-2024). CiteSpace facilitated network analysis, including co-authorship, keyword co-occurrence, and co-citation patterns, while burst detection identified topics. RESULTS Research integrity studies have grown significantly since the 1980s, with interdisciplinary collaboration. Keyword and co-citation analyses reveal a shift from early discussions on scientific misconduct to concerns such as open science, AI ethics, and research governance. A collaboration network has emerged, with leading contributions from North America, Europe, and Asia. CONCLUSIONS Research integrity has matured into an interdisciplinary field, reaching academic consensus with growing integration of policies, regulations, and technology. Future research is expected to focus on AI's role in research integrity. Key areas of concern include algorithmic bias, automation ethics, and implications for scholarly publishing. Open science and transparency will remain central, particularly in addressing data fabrication, paper mills, and predatory publishing. Institutional policies will continue evolving, embedding integrity principles into governance and public engagement initiatives.
Collapse
Affiliation(s)
- Gengyan Tang
- Werklund School of Education, University of Calgary, Calgary, Canada
| |
Collapse
|
12
|
Pelot NA, Wang B, Marshall DP, Hussain MA, Musselman ED, Yu GJ, Dale J, Baumgart IW, Dardani D, Zamani PT, Chang Villacreses D, Wagenaar JB, Grill WM. Guidance for sharing computational models of neural stimulation: from project planning to publication. J Neural Eng 2025; 22:021001. [PMID: 39993327 DOI: 10.1088/1741-2552/adb997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Accepted: 02/24/2025] [Indexed: 02/26/2025]
Abstract
Objective. Sharing computational models offers many benefits, including increased scientific rigor during project execution, readership of the associated paper, resource usage efficiency, replicability, and reusability. In recognition of the growing practice and requirement of sharing models, code, and data, herein, we provide guidance to facilitate sharing of computational models by providing an accessible resource for regular reference throughout a project's stages.Approach. We synthesized literature on good practices in scientific computing and on code and data sharing with our experience in developing, sharing, and using models of neural stimulation, although the guidance will also apply well to most other types of computational models.Main results. We first describe the '6 R' characteristics of shared models, leaning on prior scientific computing literature, which enforce accountability and enable advancement: re-runnability, repeatability, replicability, reproducibility, reusability, and readability. We then summarize action items associated with good practices in scientific computing, including selection of computational tools during project planning, code and documentation design during development, and user instructions for deployment. We provide a detailed checklist of the contents of shared models and associated materials, including the model itself, code for reproducing published figures, documentation, and supporting datasets. We describe code, model, and data repositories, including a list of characteristics to consider when selecting a platform for sharing. We describe intellectual property (IP) considerations to balance permissive, open-source licenses versus software patents and bespoke licenses that govern and incentivize commercialization. Finally, we exemplify these practices with our ASCENT pipeline for modeling peripheral nerve stimulation.Significance. We hope that this paper will serve as an important and actionable reference for scientists who develop models-from project planning through publication-as well as for model users, institutions, IP experts, journals, funding sources, and repository platform developers.
Collapse
Affiliation(s)
- Nicole A Pelot
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Boshuo Wang
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Duke University, Durham, NC, United States of America
| | - Daniel P Marshall
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Minhaj A Hussain
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Eric D Musselman
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Gene J Yu
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Duke University, Durham, NC, United States of America
| | - Jahrane Dale
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Ian W Baumgart
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - Daniel Dardani
- Office for Translation & Commercialization, Duke University, Durham, NC, United States of America
| | - Princess Tara Zamani
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
| | - David Chang Villacreses
- Office for Translation & Commercialization, Duke University, Durham, NC, United States of America
| | - Joost B Wagenaar
- Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Warren M Grill
- Department of Biomedical Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
- Department of Electrical and Computer Engineering, Pratt School of Engineering, Duke University, Durham, NC, United States of America
- Department of Neurobiology, School of Medicine, Duke University, Durham, NC, United States of America
- Department of Neurosurgery, School of Medicine, Duke University, Durham, NC, United States of America
| |
Collapse
|
13
|
Skubera M, Korbmacher M, Evans TR, Azevedo F, Pennington CR. International initiatives to enhance awareness and uptake of open research in psychology: a systematic mapping review. ROYAL SOCIETY OPEN SCIENCE 2025; 12:241726. [PMID: 40109933 PMCID: PMC11919529 DOI: 10.1098/rsos.241726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Revised: 02/07/2025] [Accepted: 02/07/2025] [Indexed: 03/22/2025]
Abstract
Concerns about the replicability, reproducibility and transparency of research have ushered in a set of practices and behaviours under the umbrella of 'open research'. To this end, many new initiatives have been developed that represent procedural (i.e. behaviours and sets of commonly used practices in the research process), structural (new norms, rules, infrastructure and incentives), and community-based change (working groups, networks). The objectives of this research were to identify and outline international initiatives that enhance awareness and uptake of open research practices in the discipline of psychology. A systematic mapping review was conducted in three stages: (i) a Web search to identify open research initiatives in psychology; (ii) a literature search to identify related articles; and (iii) a hand search of grey literature. Eligible initiatives were then coded into an overarching theme of procedural, structural or community-based change. A total of 187 initiatives were identified; 30 were procedural (e.g. toolkits, resources, software), 70 structural (e.g. policies, strategies, frameworks) and 87 community-based (e.g. working groups, networks). This review highlights that open research is progressing at pace through various initiatives that share a common goal to reform research culture. We hope that this review promotes their further adoption and facilitates coordinated efforts between individuals, organizations, institutions, publishers and funders.
Collapse
Affiliation(s)
- Magda Skubera
- School of Psychology, Aston University, Birmingham, UK
| | - Max Korbmacher
- Mohn Medical Imaging and Visualisation Centre, Bergen, Norway
- Department of Neurology, Haukeland University Hospital, Bergen, Norway
| | - Thomas Rhys Evans
- School of Human Sciences and Institute for Lifecourse Developments, University of Greenwich, London, UK
| | - Flavio Azevedo
- Department of Interdisciplinary Social Sciences, Utrecht University, Utrecht, The Netherlands
| | | |
Collapse
|
14
|
Fonseca Teixeira A, Pires BRB, Panis C, Monte-Alto-Costa A, da Fonseca ADS, Mencalha AL. Low-Power Blue LED Modulates NF-κB and Proinflammatory Cytokines in Doxorubicin-Treated MDA-MB-231 Cells. J Biochem Mol Toxicol 2025; 39:e70192. [PMID: 39987519 DOI: 10.1002/jbt.70192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2024] [Revised: 01/08/2025] [Accepted: 02/11/2025] [Indexed: 02/25/2025]
Abstract
Doxorubicin is a crucial chemotherapy used in the treatment of triple-negative breast cancer (TNBC) patients, but elevated doxorubicin doses may induce therapeutic resistance. To overcome this limitation, we have previously established a photodynamic therapeutic (PDT)-like strategy that irradiates doxorubicin-treated cells with a low-power nonionizing blue LED device. This combined treatment increases the production of reactive oxygen species to promote cell death, consequently enabling reduced doxorubicin dosages. Yet, precisely determining the molecular mechanisms that drive this outcome is still required for advancing such PDT-like approach. Here, we aimed to correlate the expression of the inflammatory markers NF-κB, IL-8, IL-6, and IL-1β with the survival of TNBC cells submitted to our PDT-like protocol. Our results show that NF-κB/p65 nuclear levels were enhanced in MDA-MB-231 cells treated with doxorubicin and blue LED. Moreover, this PDT-like strategy increased IL-6 mRNA levels in MDA-MB-231 cells. IL-1β and IL-8 mRNA were upregulated in samples incubated with doxorubicin regardless of concomitant irradiation with blue LED. These results show that our PDT-like protocol is effective in elevating inflammatory signals, shedding light on the molecular mechanisms that underlie the efficacy of this innovative anticancer therapeutic approach.
Collapse
Affiliation(s)
- Adilson Fonseca Teixeira
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Bruno Ricardo Barreto Pires
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Carolina Panis
- Centro de Ciências da Saúde, Universidade Estadual do Oeste do Paraná, Paraná, Brazil
| | - Andréa Monte-Alto-Costa
- Departamento de Histologia e Embriologia, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Adenilson de Souza da Fonseca
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| | - Andre Luiz Mencalha
- Departamento de Biofísica e Biometria, Instituto de Biologia Roberto Alcantara Gomes, Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil
| |
Collapse
|
15
|
Unger JM, Mazza GL, Elsaid MI, Duan F, Dressler EV, Snavely AC, Enserro DM, Pugh SL. When to adjust for multiplicity in cancer clinical trials. J Natl Cancer Inst Monogr 2025; 2025:3-9. [PMID: 39989044 PMCID: PMC11848029 DOI: 10.1093/jncimonographs/lgae051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Revised: 10/21/2024] [Accepted: 11/19/2024] [Indexed: 02/25/2025] Open
Abstract
Interpreting cancer clinical trial results often depends on addressing issues of multiplicity. When testing multiple hypotheses, unreliable findings can occur by chance due to the inflation of the type I error rate, the probability of mistakenly rejecting the null hypothesis when the null hypothesis is true. In this setting, researchers may often set the type I error rate (or the alpha level) low to limit false positive findings and the interpretation of a causal relationship where none exists. Conversely, overly conservative type I error control may result in declaring findings, that do not meet multiplicity-adjusted alpha levels, as false when they are actually true, reducing opportunities for new discovery. This presentation focuses on multiplicity adjustment in the context of clinical trials conducted within the NCI's Community Oncology Research Program (NCORP). Because federally sponsored trials often require long-term participation from patients and represent a substantial investment by taxpayers, striking the right balance between optimizing what is learned from these trials, while avoiding false positive results, should be a priority.
Collapse
Affiliation(s)
- Joseph M Unger
- SWOG Statistics and Data Management Center, Fred Hutchinson Cancer Center, Seattle, WA 98109, United States
| | - Gina L Mazza
- Alliance Statistics and Data Management Center, Mayo Clinic, Scottsdale, AZ 85259, United States
| | - Mohamed I Elsaid
- Department of Biomedical Informatics, College of Medicine, The Ohio State University, Columbus, OH 43210, United States
- Division of Medical Oncology, Department of Internal Medicine, College of Medicine, The Ohio State University, Columbus, OH 43210, United States
- Center for Biostatistics, College of Medicine, The Ohio State University, Columbus, OH 43210, United States
| | - Fenhai Duan
- Department of Biostatistics and Center for Statistical Sciences, Brown University School of Public Health, Providence, RI 02903, United States
| | - Emily V Dressler
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, NC 27157, United States
| | - Anna C Snavely
- Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, NC 27157, United States
| | - Danielle M Enserro
- Department of Biostatistics and Bioinformatics, Roswell Park Comprehensive Cancer Center, Buffalo, NY 14203, United States
| | - Stephanie L Pugh
- NRG Oncology Statistics and Data Management Center, Philadelphia, PA 19103, United States
| |
Collapse
|
16
|
Franzen DL, Salholz-Hillel M, Müller-Ohlraun S, Strech D. Improving research transparency with individualized report cards: A feasibility study in clinical trials at a large university medical center. BMC Med Res Methodol 2025; 25:37. [PMID: 39948475 PMCID: PMC11823227 DOI: 10.1186/s12874-025-02482-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 01/21/2025] [Indexed: 02/17/2025] Open
Abstract
BACKGROUND Research transparency is crucial for ensuring the relevance, integrity, and reliability of scientific findings. However, previous work indicates room for improvement across transparency practices. The primary objective of this study was to develop an extensible tool to provide individualized feedback and guidance for improved transparency across phases of a study. Our secondary objective was to assess the feasibility of implementing this tool to improve transparency in clinical trials. METHODS We developed study-level "report cards" that combine tailored feedback and guidance to investigators across several transparency practices, including prospective registration, availability of summary results, and open access publication. The report cards were generated through an automated pipeline for scalability. We also developed an infosheet to summarize relevant laws, guidelines, and resources relating to transparency. To assess the feasibility of using these tools to improve transparency, we conducted a single-arm intervention study at Berlin's university medical center, the Charité - Universitätsmedizin Berlin. Investigators (n = 92) of 155 clinical trials were sent individualized report cards and the infosheet, and surveyed to assess their perceived usefulness. We also evaluated included trials for improvements in transparency following the intervention. RESULTS Survey responses indicated general appreciation for the report cards and infosheet, with a majority of participants finding them helpful to build awareness of the transparency of their trial and transparency requirements. However, improvement on transparency practices was minimal and largely limited to linking publications in registries. Investigators also commented on various challenges associated with implementing transparency, including a lack of clarity around best practices and institutional hurdles. CONCLUSIONS This study demonstrates the potential of developing and using tools, such as report cards, to provide individualized feedback at scale to investigators on the transparency of their study. While these tools were positively received by investigators, the limited improvement in transparency practices suggests that awareness alone is likely not sufficient to drive improvement. Future research and implementation efforts may adapt the tools to further practices or research areas, and explore integrated approaches that combine the report cards with incentives and institutional support to effectively strengthen transparency in research.
Collapse
Affiliation(s)
- Delwen L Franzen
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany.
| | - Maia Salholz-Hillel
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany.
| | - Stephanie Müller-Ohlraun
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany
| | - Daniel Strech
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin, QUEST Center for Responsible Research, Charitéplatz 1, 10117, Berlin, Germany
| |
Collapse
|
17
|
Hair K, Arroyo-Araujo M, Vojvodic S, Economou M, Wong C, Tinsdeall F, Smith S, Rackoll T, Sena ES, McCann SK. Connecting the dots in neuroscience research: The future of evidence synthesis. Exp Neurol 2025; 384:115047. [PMID: 39510296 DOI: 10.1016/j.expneurol.2024.115047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2024] [Revised: 10/31/2024] [Accepted: 11/03/2024] [Indexed: 11/15/2024]
Abstract
Making progress in neuroscience research involves learning from existing data. In this perspective piece, we explore the potential of a data-driven evidence ecosystem to connect all primary data streams, and synthesis efforts to inform evidence-based research and translational success from bench to bedside. To enable this transformation, we set out how we can produce evidence designed with evidence curation in mind. All data should be findable, understandable, and easily synthesisable, using a combination of human and machine effort. This will require shifts in research culture and tailored infrastructure to support rapid dissemination, data sharing, and transparency. We also discuss improvements in the way we can synthesise evidence to better inform primary research, including the potential of emerging technologies, big-data approaches, and breaking down research silos. Through a case study in stroke research, one of the most well-established areas for synthesis efforts, we demonstrate the progress in implementing elements of this ecosystem, with an emphasis on the need for coordinated efforts between laboratory researchers and synthesists.
Collapse
Affiliation(s)
- Kaitlyn Hair
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - María Arroyo-Araujo
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Sofija Vojvodic
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Maria Economou
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Charis Wong
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom; Euan MacDonald Centre for Motor Neuron Disease Research, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom; Anne Rowling Regenerative Neurology Clinic, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom; MRC Clinical Trials Unit, 90 High Holborn, London WC1V 6LJ, United Kingdom.
| | - Francesca Tinsdeall
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - Sean Smith
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - Torsten Rackoll
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| | - Emily S Sena
- Centre for Clinical Brain Sciences, University of Edinburgh, Chancellor's Building, 49 Little France Crescent, Edinburgh EH16 4SB, United Kingdom.
| | - Sarah K McCann
- Berlin Institute of Health at Charité-Universitätsmedizin Berlin, QUEST Center, Charitéplatz 1, 10117 Berlin, Germany.
| |
Collapse
|
18
|
Elliott C, Patterson ED, Tarcea A, Mattiello B, Frizzell B, Walker REA, Hildebrand KA, White NJ. An endpoint adjudication committee for the assessment of computed tomography scans in fracture healing. Injury 2025; 56:112067. [PMID: 39622103 DOI: 10.1016/j.injury.2024.112067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Revised: 11/04/2024] [Accepted: 11/23/2024] [Indexed: 02/07/2025]
Abstract
INTRODUCTION Endpoint Adjudication Committees (EACs) benefit the quality of randomized control trials (RCTs) where outcomes depend on subjective interpretations. However, assembling a committee to adjudicate large datasets is cumbersome. In a recent RCT, the primary outcome was time to union following operative fixation of scaphoid non-union, with real or placebo adjunctive ultrasound treatment. Union status was determined with computed tomography (CT) scans interpreted by treating surgeons and radiologists. An EAC was established to deliberate discrepancies between radiologists' and surgeons' interpretations of union status. METHODS Three hundred sixty-four CT scans from 142 participants were collected in the RCT. The treating surgeon and an MSK radiologist categorized images by percent-union (0 %, 1-24 %, 25-49 %, 50-74 %, 75-99 %, 100 %). Union was defined as at least 50 % trabecular bridging. The EAC adjudicated those images that were deemed major discrepancies. The committee was composed of three members assembled by the committee chair, an MSK radiologist. A charter was established to guide the adjudication process. Ten minutes were allotted to each scan, including 2-3 min of an independent adjudicator's review, followed by 5-7 min of committee discussion to reach a diagnosis. RESULTS Adjudicators spent an average of seven minutes on each scan. The EAC assessed 101 CT scans from 69 patients collected across five study sites: four scans from the agreed upon group as practice interpretations, 75 major discrepancies, and 22 missing interpretations from either the initial MSK radiologist, the treating orthopaedic surgeon, or both. These were adjudicated for final union status. Twenty-eight of the images with major discrepancies were adjudicated to union, and 47 to non-union. Adjudication changed the primary outcome of time to union in 40/142 (28 %) of study participants. CONCLUSION This adjudication process provides a valuable research tool for reference by other clinical investigators whose RCTs' outcomes are dependent on interpretation of radiographic images.
Collapse
Affiliation(s)
- Chloe Elliott
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Ethan D Patterson
- University of Saskatchewan, College of Medicine, 107 Wiggins Rd, Saskatoon, SK S7N 5E5, Canada
| | - Adina Tarcea
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada.
| | - Brenna Mattiello
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Bevan Frizzell
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Richard E A Walker
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Kevin A Hildebrand
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| | - Neil J White
- University of Calgary, Cumming School of Medicine, 2500 University Dr NW, Calgary, AB T2N 1N4, Canada
| |
Collapse
|
19
|
Marcoci A, Wilkinson DP, Vercammen A, Wintle BC, Abatayo AL, Baskin E, Berkman H, Buchanan EM, Capitán S, Capitán T, Chan G, Cheng KJG, Coupé T, Dryhurst S, Duan J, Edlund JE, Errington TM, Fedor A, Fidler F, Field JG, Fox N, Fraser H, Freeman ALJ, Hanea A, Holzmeister F, Hong S, Huggins R, Huntington-Klein N, Johannesson M, Jones AM, Kapoor H, Kerr J, Kline Struhl M, Kołczyńska M, Liu Y, Loomas Z, Luis B, Méndez E, Miske O, Mody F, Nast C, Nosek BA, Simon Parsons E, Pfeiffer T, Reed WR, Roozenbeek J, Schlyfestone AR, Schneider CR, Soh A, Song Z, Tagat A, Tutor M, Tyner AH, Urbanska K, van der Linden S. Predicting the replicability of social and behavioural science claims in COVID-19 preprints. Nat Hum Behav 2025; 9:287-304. [PMID: 39706868 PMCID: PMC11860236 DOI: 10.1038/s41562-024-01961-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Accepted: 07/19/2024] [Indexed: 12/23/2024]
Abstract
Replications are important for assessing the reliability of published findings. However, they are costly, and it is infeasible to replicate everything. Accurate, fast, lower-cost alternatives such as eliciting predictions could accelerate assessment for rapid policy implementation in a crisis and help guide a more efficient allocation of scarce replication resources. We elicited judgements from participants on 100 claims from preprints about an emerging area of research (COVID-19 pandemic) using an interactive structured elicitation protocol, and we conducted 29 new high-powered replications. After interacting with their peers, participant groups with lower task expertise ('beginners') updated their estimates and confidence in their judgements significantly more than groups with greater task expertise ('experienced'). For experienced individuals, the average accuracy was 0.57 (95% CI: [0.53, 0.61]) after interaction, and they correctly classified 61% of claims; beginners' average accuracy was 0.58 (95% CI: [0.54, 0.62]), correctly classifying 69% of claims. The difference in accuracy between groups was not statistically significant and their judgements on the full set of claims were correlated (r(98) = 0.48, P < 0.001). These results suggest that both beginners and more-experienced participants using a structured process have some ability to make better-than-chance predictions about the reliability of 'fast science' under conditions of high uncertainty. However, given the importance of such assessments for making evidence-based critical decisions in a crisis, more research is required to understand who the right experts in forecasting replicability are and how their judgements ought to be elicited.
Collapse
Affiliation(s)
- Alexandru Marcoci
- Centre for the Study of Existential Risk, University of Cambridge, Cambridge, UK.
- School of Politics and International Relations, University of Nottingham, Nottingham, UK.
| | - David P Wilkinson
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- QAECO, University of Melbourne, Melbourne, Victoria, Australia
| | - Ans Vercammen
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- School of Communication and Arts, The University of Queensland, Brisbane, Queensland, Australia
- School of Population Health, Curtin University, Bentley, Western Australia, Australia
| | - Bonnie C Wintle
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
| | - Anna Lou Abatayo
- Environmental Economics and Natural Resources Group, Wageningen University and Research, Wageningen, the Netherlands
| | - Ernest Baskin
- Department of Food, Pharma and Healthcare, Saint Joseph's University, Philadelphia, PA, USA
| | - Henk Berkman
- Business School, University of Auckland, Auckland, New Zealand
| | - Erin M Buchanan
- Analytics, Harrisburg University of Science and Technology, Harrisburg, PA, USA
| | - Sara Capitán
- Department of Ecology, Swedish University of Agricultural Sciences, Uppsala, Sweden
| | - Tabaré Capitán
- Department of Economics, Swedish University of Agricultural Sciences, Uppsala, Sweden
| | - Ginny Chan
- Rhizom Psychological Services LLC, Atlanta, GA, USA
| | - Kent Jason G Cheng
- Center for Healthy Aging, The Pennsylvania State University, University Park, PA, USA
| | - Tom Coupé
- UCMeta, University of Canterbury, Christchurch, New Zealand
| | - Sarah Dryhurst
- Department of Psychology, University of Cambridge, Cambridge, UK
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
- UCL Institute for Risk and Disaster Reduction, University College London, London, UK
| | - Jianhua Duan
- Statistics New Zealand, Christchurch, New Zealand
| | - John E Edlund
- Rochester Institute of Technology, Rochester, NY, USA
| | | | - Anna Fedor
- Independent researcher, Budapest, Hungary
| | - Fiona Fidler
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
| | - James G Field
- Department of Management, John Chambers School of Business and Economics, West Virginia University, Morgantown, WV, USA
| | - Nicholas Fox
- Center for Open Science, Charlottesville, VA, USA
| | - Hannah Fraser
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
| | - Alexandra L J Freeman
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
| | - Anca Hanea
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- Centre of Excellence for Biosecurity Risk Analysis, University of Melbourne, Melbourne, Victoria, Australia
| | - Felix Holzmeister
- Department of Economics, University of Innsbruck, Innsbruck, Austria
| | - Sanghyun Hong
- UCMeta, University of Canterbury, Christchurch, New Zealand
| | - Raquel Huggins
- Analytics, Harrisburg University of Science and Technology, Harrisburg, PA, USA
| | | | - Magnus Johannesson
- Department of Economics, Stockholm School of Economics, Stockholm, Sweden
| | - Angela M Jones
- School of Criminal Justice and Criminology, Texas State University, San Marcos, TX, USA
| | - Hansika Kapoor
- Department of Psychology, Monk Prayogshala, Mumbai, India
- Neag School of Education, University of Connecticut, Storrs, USA
| | - John Kerr
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
- Department of Public Health, University of Otago, Wellington, New Zealand
| | | | - Marta Kołczyńska
- Institute of Political Studies, Polish Academy of Sciences, Warszawa, Poland
| | - Yang Liu
- Department of Computer Science and Engineering, University of California, Santa Cruz, Santa Cruz, CA, USA
| | | | - Brianna Luis
- Center for Open Science, Charlottesville, VA, USA
| | | | - Olivia Miske
- Center for Open Science, Charlottesville, VA, USA
| | - Fallon Mody
- MetaMelb Research Initiative, University of Melbourne, Melbourne, Victoria, Australia
- History and Philosophy of Science, University of Melbourne, Melbourne, Victoria, Australia
| | - Carolin Nast
- University of Stavanger, School of Business and Law, Stavanger, Norway
| | - Brian A Nosek
- Center for Open Science, Charlottesville, VA, USA
- Department of Psychology, University of Virginia, Charlottesville, VA, USA
| | | | | | - W Robert Reed
- UCMeta, University of Canterbury, Christchurch, New Zealand
| | - Jon Roozenbeek
- Department of Psychology, University of Cambridge, Cambridge, UK
| | | | - Claudia R Schneider
- Department of Psychology, University of Cambridge, Cambridge, UK
- Winton Centre for Risk and Evidence Communication, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
- School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand
| | - Andrew Soh
- Department of Philosophy, University of Hawaii at Manoa, Honolulu, HI, USA
| | - Zhongchen Song
- New Zealand Institute of Economic Research (NZIER), Wellington, New Zealand
| | - Anirudh Tagat
- Department of Economics, Monk Prayogshala, Mumbai, India
| | - Melba Tutor
- Independent researcher, Quezon City, Philippines
| | | | | | | |
Collapse
|
20
|
Holzmeister F, Johannesson M, Camerer CF, Chen Y, Ho TH, Hoogeveen S, Huber J, Imai N, Imai T, Jin L, Kirchler M, Ly A, Mandl B, Manfredi D, Nave G, Nosek BA, Pfeiffer T, Sarafoglou A, Schwaiger R, Wagenmakers EJ, Waldén V, Dreber A. Examining the replicability of online experiments selected by a decision market. Nat Hum Behav 2025; 9:316-330. [PMID: 39562799 PMCID: PMC11860227 DOI: 10.1038/s41562-024-02062-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 10/11/2024] [Indexed: 11/21/2024]
Abstract
Here we test the feasibility of using decision markets to select studies for replication and provide evidence about the replicability of online experiments. Social scientists (n = 162) traded on the outcome of close replications of 41 systematically selected MTurk social science experiments published in PNAS 2015-2018, knowing that the 12 studies with the lowest and the 12 with the highest final market prices would be selected for replication, along with 2 randomly selected studies. The replication rate, based on the statistical significance indicator, was 83% for the top-12 and 33% for the bottom-12 group. Overall, 54% of the studies were successfully replicated, with replication effect size estimates averaging 45% of the original effect size estimates. The replication rate varied between 54% and 62% for alternative replication indicators. The observed replicability of MTurk experiments is comparable to that of previous systematic replication projects involving laboratory experiments.
Collapse
Affiliation(s)
- Felix Holzmeister
- Department of Economics, University of Innsbruck, Innsbruck, Austria
| | - Magnus Johannesson
- Department of Economics, Stockholm School of Economics, Stockholm, Sweden
| | - Colin F Camerer
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, CA, USA
| | - Yiling Chen
- John A. Paulson School of Engineering and Applied Sciences, Harvard University, Boston, MA, USA
| | - Teck-Hua Ho
- Nanyang Technological University, Singapore, Singapore
| | - Suzanne Hoogeveen
- Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
| | - Juergen Huber
- Department of Banking and Finance, University of Innsbruck, Innsbruck, Austria
| | - Noriko Imai
- Institute of Social and Economic Research, Osaka University, Osaka, Japan
| | - Taisuke Imai
- Institute of Social and Economic Research, Osaka University, Osaka, Japan
| | - Lawrence Jin
- Lee Kuan Yew School of Public Policy, National University of Singapore, Singapore, Singapore
| | - Michael Kirchler
- Department of Banking and Finance, University of Innsbruck, Innsbruck, Austria
| | - Alexander Ly
- Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
- Machine Learning, Centrum Wiskunde and Informatica, Amsterdam, The Netherlands
| | | | - Dylan Manfredi
- Marketing Department, Wharton School, University of Pennsylvania, Philadelphia, PA, USA
| | - Gideon Nave
- Marketing Department, Wharton School, University of Pennsylvania, Philadelphia, PA, USA
| | - Brian A Nosek
- Department of Psychology, University of Virginia, Charlottesville, VA, USA
- Center for Open Science, Charlottesville, VA, USA
| | - Thomas Pfeiffer
- Institute for Advanced Study, Massey University, Auckland, New Zealand
| | - Alexandra Sarafoglou
- Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
| | - Rene Schwaiger
- Department of Banking and Finance, University of Innsbruck, Innsbruck, Austria
| | - Eric-Jan Wagenmakers
- Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
| | | | - Anna Dreber
- Department of Economics, University of Innsbruck, Innsbruck, Austria.
- Department of Economics, Stockholm School of Economics, Stockholm, Sweden.
| |
Collapse
|
21
|
Kerpel-Fronius S, Becker AL. The Value and Importance of a Professional Ethical Code for Medicines Development: IFAPP International Ethics Framework. Pharmaceut Med 2025:10.1007/s40290-024-00547-6. [PMID: 39873953 DOI: 10.1007/s40290-024-00547-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/23/2024] [Indexed: 01/30/2025]
Abstract
Pharmaceutical medicine professionals have to face many ethical problems during the entire life span of new medicines extending from animal studies to broad clinical practice. The primary aim of the general ethical principles governing research conducted in humans is to diminish the physical and psychological burdens of the participants in human drug studies but overlooks many additional social and ethical problems faced by medicine developers. These arise mainly at the interface connecting the profit-oriented pharmaceutical industry and the healthcare-centered medical profession cooperating in medicines development. In 2002, the International Federation of Associations of Pharmaceutical Physicians and Pharmaceutical Medicine developed the International Code of Ethical Conduct for Pharmaceutical Physicians for providing ethical advice for their members to manage the frequently competitive goals characteristic for their specialty. The ethical framework compiled by the International Federation of Associations of Pharmaceutical Physicians and Pharmaceutical Medicine serves its members by presenting morally acceptable or inacceptable behaviors in frequently encountered controversies arising from competing industrial and healthcare interests in medicines development. The authors selected this format to encourage reflection and debate for finding optimal moral conclusions in specific issues. Many recent examples of serious scientific-ethical misconduct, such as the oxycodone tragedy, the recommendations of unproven useless occasionally dangerous therapies during the coronavirus disease 2019 pandemic, and the withdrawal of many papers containing non-reproducible results, contributed to the increasing loss of trust by the public in science including pharmaceutical medicine. We are convinced that the ethical guidance developed by the International Federation of Associations of Pharmaceutical Physicians and Pharmaceutical Medicine will encourage its members to reflect intensively on optimal ethical behavior in drug development for strengthening the trust of society in innovative new medicines. Finally, considering the increasingly active participation of non-medically trained scientists in producing and applying complex biological medicines, distant monitoring methods coupled together with artificial intelligence technology in innovative clinical trials, the Ethics Working Group recommended already in 2017 measures to optimize their smooth cooperation and underlined their joint ethical responsibilities in guarding the safety and human dignity of trial participants.
Collapse
Affiliation(s)
- Sandor Kerpel-Fronius
- Department of Pharmacology and Pharmacotherapy, Semmelweis University, Nagyvárad tér 4, 1089, Budapest, Hungary.
| | - Alexander L Becker
- Consultants in Pharmaceutical Medicine, Dover Heights, Sydney, NSW, Australia
| |
Collapse
|
22
|
Wu Y, Xie L. AI-driven multi-omics integration for multi-scale predictive modeling of genotype-environment-phenotype relationships. Comput Struct Biotechnol J 2025; 27:265-277. [PMID: 39886532 PMCID: PMC11779603 DOI: 10.1016/j.csbj.2024.12.030] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2024] [Revised: 12/22/2024] [Accepted: 12/26/2024] [Indexed: 02/01/2025] Open
Abstract
Despite the wealth of single-cell multi-omics data, it remains challenging to predict the consequences of novel genetic and chemical perturbations in the human body. It requires knowledge of molecular interactions at all biological levels, encompassing disease models and humans. Current machine learning methods primarily establish statistical correlations between genotypes and phenotypes but struggle to identify physiologically significant causal factors, limiting their predictive power. Key challenges in predictive modeling include scarcity of labeled data, generalization across different domains, and disentangling causation from correlation. In light of recent advances in multi-omics data integration, we propose a new artificial intelligence (AI)-powered biology-inspired multi-scale modeling framework to tackle these issues. This framework will integrate multi-omics data across biological levels, organism hierarchies, and species to predict genotype-environment-phenotype relationships under various conditions. AI models inspired by biology may identify novel molecular targets, biomarkers, pharmaceutical agents, and personalized medicines for presently unmet medical needs.
Collapse
Affiliation(s)
- You Wu
- Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York, NY, USA
| | - Lei Xie
- Ph.D. Program in Computer Science, The Graduate Center, The City University of New York, New York, NY, USA
- Ph.D. Program in Biology and Biochemistry, The Graduate Center, The City University of New York, New York, NY, USA
- Department of Computer Science, Hunter College, The City University of New York, New York, NY, USA
- Helen & Robert Appel Alzheimer's Disease Research Institute, Feil Family Brain & Mind Research Institute, Weill Cornell Medicine, Cornell University, New York, NY, USA
| |
Collapse
|
23
|
Matsumoto K, Harada SY, Yoshida SY, Narumi R, Mitani TT, Yada S, Sato A, Morii E, Shimizu Y, Ueda HR. DECODE enables high-throughput mapping of antibody epitopes at single amino acid resolution. PLoS Biol 2025; 23:e3002707. [PMID: 39847587 PMCID: PMC11756784 DOI: 10.1371/journal.pbio.3002707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2024] [Accepted: 12/06/2024] [Indexed: 01/25/2025] Open
Abstract
Antibodies are extensively used in biomedical research, clinical fields, and disease treatment. However, to enhance the reproducibility and reliability of antibody-based experiments, it is crucial to have a detailed understanding of the antibody's target specificity and epitope. In this study, we developed a high-throughput and precise epitope analysis method, DECODE (Decoding Epitope Composition by Optimized-mRNA-display, Data analysis, and Expression sequencing). This method allowed identifying patterns of epitopes recognized by monoclonal or polyclonal antibodies at single amino acid resolution and predicted cross-reactivity against the entire protein database. By applying the obtained epitope information, it has become possible to develop a new 3D immunostaining method that increases the penetration of antibodies deep into tissues. Furthermore, to demonstrate the applicability of DECODE to more complex blood antibodies, we performed epitope analysis using serum antibodies from mice with experimental autoimmune encephalomyelitis (EAE). As a result, we were able to successfully identify an epitope that matched the sequence of the peptide inducing the disease model without relying on existing antigen information. These results demonstrate that DECODE can provide high-quality epitope information, improve the reproducibility of antibody-dependent experiments, diagnostics and therapeutics, and contribute to discover pathogenic epitopes from antibodies in the blood.
Collapse
Affiliation(s)
- Katsuhiko Matsumoto
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Systems Pharmacology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Shoko Y. Harada
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Shota Y. Yoshida
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Pathology, Graduate School of Medicine, Osaka University, Osaka, Japan
| | - Ryohei Narumi
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Tomoki T. Mitani
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Systems Biology, Graduate school of Medicine, Osaka University, Osaka, Japan
- Department of Neurology, Graduate school of Medicine, Osaka University, Osaka, Japan
| | - Saori Yada
- Department of Systems Pharmacology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
| | - Aya Sato
- Laboratory for Cell-Free Protein Synthesis, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Eiichi Morii
- Department of Pathology, Graduate School of Medicine, Osaka University, Osaka, Japan
| | - Yoshihiro Shimizu
- Laboratory for Cell-Free Protein Synthesis, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
| | - Hiroki R. Ueda
- Laboratory for Synthetic Biology, RIKEN Center for Biosystems Dynamics Research, Osaka, Japan
- Department of Systems Pharmacology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan
- Department of Pathology, Graduate School of Medicine, Osaka University, Osaka, Japan
- Institute of Life Science, Kurume University, Kurume, Japan
| |
Collapse
|
24
|
Poole D, Linden A, Sedgewick F, Allchin O, Hobson H. A systematic review of pre-registration in autism research journals. AUTISM : THE INTERNATIONAL JOURNAL OF RESEARCH AND PRACTICE 2024:13623613241308312. [PMID: 39720839 DOI: 10.1177/13623613241308312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2024]
Abstract
LAY ABSTRACT When researchers write down their plans for a study ahead of time and make this public, this is called pre-registration. Pre-registration allows others to see if the researchers stuck to their original plan or changed as they went along. Pre-registration is growing in popularity but we do not know how widely it is used in autism research. In this study, we looked at papers published in six major autism journals between 2011 and 2022. We found that only 2.23% of papers published in autism journals had been pre-registered. We also took a close look at a selection of the pre-registrations to check how good they were and if researchers stuck to their plans. We found that the pre-registrations generally lacked specifics, particularly about how the study was designed and the data would be analysed. We also found that only 28% of the papers closely followed the pre-registered plans or reported the changes.Based on these findings, we recommend that autism researchers consider pre-registering their work and transparently report any changes from their original plans. We have provided some recommendations for researchers and journals on how pre-registration could be better used in autism research.
Collapse
|
25
|
Wang B, Kim HJ, Bradley KM, Chen C, McLendon C, Yang Z, Benner SA. Joining Natural and Synthetic DNA Using Biversal Nucleotides: Efficient Sequencing of Six-Nucleotide DNA. J Am Chem Soc 2024; 146:35129-35138. [PMID: 39625448 DOI: 10.1021/jacs.4c11043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2024]
Abstract
By rearranging hydrogen bond donor and acceptor groups within a standard Watson-Crick geometry, DNA can add eight independently replicable nucleotides forming four additional not found in standard Terran DNA. For many applications, the orthogonal pairing of standard and nonstandard pairs offers a key advantage. However, other applications require standard and nonstandard nucleotides to communicate with each other. This is especially true when seeking to recruit high-throughput instruments (e.g., Illumina), designed to sequence standard 4-nucleotide DNA, to sequence DNA that includes added nucleotides. For this purpose, PCR workflows are needed to replace nonstandard nucleotides in (for example) a 6-letter DNA sequence by defined mixtures of standard nucleotides built from 4 nucleotides. High-throughput sequencing can then report the sequences of those mixtures to bioinformatic alignment tools, which infer the original 6-nucleotide sequence by analysis of the mixtures. Unfortunately, the intrinsic orthogonality of standard and nonstandard nucleotides often demand polymerases that violate pairing biophysics to do this replacement, leading to inefficiencies in this "transliteration" process. Thus, laboratory in vitro evolution (LIVE) using "anthropogenic evolvable genetic information systems" (AEGIS), an important "consumer" of new sequencing tools, has been slow to be democratized; robust sequencing is needed to identify the AegisBodies and AegisZymes that AEGIS-LIVE delivers. This work introduces a new way to connect synthetic and standard molecular biology: biversal nucleotides. In an example presented here, a pyrimidine analogue (pyridine-2-one, y) pairs with Watson-Crick geometry to both a nonstandard base (2-amino-8-imidazo-[1,2a]-1,3,5-triazin-[8H]-4-one, P, the Watson-Crick partner of 6-amino-5-nitro-[1H]-pyridin-2-one, Z) and a base that completes the Watson-Crick hydrogen bond pattern (2-amino-2'-deoxyadenosine, amA). PCR amplification of GACTZP DNA with dyTP delivers products where Z:P pairs are cleanly transliterated to A:T pairs. In parallel, PCR of the same GACTZP sample at higher pH delivers products where Z:P pairs are cleanly transliterated to C:G pairs. By allowing robust sequencing of 6-letter GACTZP DNA, this workflow will help democratize AEGIS-LIVE. Further, other implementations of the biversal concept can enable communication across and between standard DNA and synthetic DNA more generally.
Collapse
Affiliation(s)
- Bang Wang
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Hyo-Joong Kim
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
| | - Kevin M Bradley
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Cen Chen
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
| | - Chris McLendon
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Zunyi Yang
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| | - Steven A Benner
- Foundation for Applied Molecular Evolution, 13709 Progress Blvd, Alachua, Florida 32601, United States
- Firebird Biomolecular Sciences, LLC, Alachua, Florida 32601, United States
| |
Collapse
|
26
|
Fikar P, Alvarez L, Berne L, Cienciala M, Kan C, Kasl H, Luo M, Novackova Z, Ordonez S, Sramkova Z, Holubova M, Lysak D, Avery L, Caro AA, Crowder RN, Diaz-Martinez LA, Donley DW, Giorno RR, Reed IKG, Hensley LL, Johnson KC, Kim AY, Kim P, LaGier AJ, Newman JJ, Padilla-Crespo E, Reyna NS, Tsotakos N, Al-Saadi NN, Appleton T, Arosemena-Pickett A, Bell BA, Bing G, Bishop B, Forde C, Foster MJ, Gray K, Hasley BL, Johnson K, Jones DJ, LaShall AC, McGuire K, McNaughton N, Morgan AM, Norris L, Ossman LA, Rivera-Torres PA, Robison ME, Thibodaux K, Valmond L, Georgiev D. Enhancing reproducibility in single cell research with biocytometry: An inter-laboratory study. PLoS One 2024; 19:e0314992. [PMID: 39652549 PMCID: PMC11627387 DOI: 10.1371/journal.pone.0314992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 11/19/2024] [Indexed: 12/12/2024] Open
Abstract
Biomedicine today is experiencing a shift towards decentralized data collection, which promises enhanced reproducibility and collaboration across diverse laboratory environments. This inter-laboratory study evaluates the performance of biocytometry, a method utilizing engineered bioparticles for enumerating cells based on their surface antigen patterns. In centralized and aggregated inter-lab studies, biocytometry demonstrated significant statistical power in discriminating numbers of target cells at varying concentrations as low as 1 cell per 100,000 background cells. User skill levels varied from expert to beginner capturing a range of proficiencies. Measurement was performed in a decentralized environment without any instrument cross-calibration or advanced user training outside of a basic instruction manual. The results affirm biocytometry to be a viable solution for immunophenotyping applications demanding sensitivity as well as scalability and reproducibility and paves the way for decentralized analysis of rare cells in heterogeneous samples.
Collapse
Affiliation(s)
- Pavel Fikar
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Laura Alvarez
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Laura Berne
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Martin Cienciala
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Christopher Kan
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Hynek Kasl
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Mona Luo
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Zuzana Novackova
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Sheyla Ordonez
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Zuzana Sramkova
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
| | - Monika Holubova
- Department of Hematology and Oncology, University Hospital Pilsen, Pilsen, Czech Republic
| | - Daniel Lysak
- Department of Hematology and Oncology, University Hospital Pilsen, Pilsen, Czech Republic
| | - Lyndsay Avery
- Department of Biology, Saint Michael’s College, Colchester, Vermont, United States of America
| | - Andres A. Caro
- Chemistry Department, Hendrix College, Conway, Arkansas, United States of America
| | - Roslyn N. Crowder
- Department of Biology, Stetson University, Deland, Florida, United States of America
| | - Laura A. Diaz-Martinez
- Department of Biology, Gonzaga University, Spokane, Washington, United States of America
| | - David W. Donley
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Rebecca R. Giorno
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Irene K. Guttilla Reed
- Department of Biology, University of Saint Joseph, West Hartford, Connecticut, United States of America
| | - Lori L. Hensley
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Kristen C. Johnson
- Department of Life Sciences, University of New Hampshire, Manchester, New Hampshire, United States of America
| | - Audrey Y. Kim
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Paul Kim
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Adriana J. LaGier
- Department of Biology, College of Social and Natural Sciences, Grand View University, Des Moines, Iowa, United States of America
| | - Jamie J. Newman
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Elizabeth Padilla-Crespo
- Department of Science and Technology, Inter American University of Puerto Rico-Aguadilla, Aguadilla, Puerto Rico, United States of America
| | - Nathan S. Reyna
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Nikolaos Tsotakos
- Department of Biological Sciences, School of Science Engineering and Technology, Penn State Harrisburg, Middletown, Pennsylvania, United States of America
| | - Noha N. Al-Saadi
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Tayler Appleton
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Ana Arosemena-Pickett
- Department of Science and Technology, Inter American University of Puerto Rico-Aguadilla, Aguadilla, Puerto Rico, United States of America
| | - Braden A. Bell
- Department of Biology, Gonzaga University, Spokane, Washington, United States of America
| | - Grace Bing
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Bre Bishop
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Christa Forde
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Michael J. Foster
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Kassidy Gray
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Bennett L. Hasley
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Kennedy Johnson
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Destiny J. Jones
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Allison C. LaShall
- Department of Biological Sciences, Jacksonville State University, Jacksonville, Alabama, United States of America
| | - Kennedy McGuire
- Department of Biology, Ouachita Baptist University, Arkadelphia, Arkansas, United States of America
| | - Naomi McNaughton
- Department of Biology, Harding University, Searcy, Arkansas, United States of America
| | - Angelina M. Morgan
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Lucas Norris
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Landon A. Ossman
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Paollette A. Rivera-Torres
- Department of Science and Technology, Inter American University of Puerto Rico-Aguadilla, Aguadilla, Puerto Rico, United States of America
| | - Madeline E. Robison
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Kathryn Thibodaux
- School of Biological Sciences, Louisiana Tech University, Ruston, Louisiana, United States of America
| | - Lescia Valmond
- Department of Biological Sciences, Grambling State University, Grambling, Louisiana, United States of America
| | - Daniel Georgiev
- Department of Research & Development, Sampling Human Inc., Berkeley, California, United States of America
- Faculty of Applied Sciences, University of West Bohemia, Pilsen, Czech Republic
| |
Collapse
|
27
|
Agudogo S, Moody R, Whelan A, Wagner S, Berghella V, Chauhan SP, Ramos S, Gupta M. Characteristics of obstetrical randomized controlled trials with large versus modest or no treatment effects. Eur J Obstet Gynecol Reprod Biol 2024; 303:369-370. [PMID: 39448353 DOI: 10.1016/j.ejogrb.2024.10.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Revised: 10/07/2024] [Accepted: 10/14/2024] [Indexed: 10/26/2024]
Affiliation(s)
- Sroda Agudogo
- Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, MA, United States
| | - Rachel Moody
- Brown Medical School, Providence, RI, United States
| | - Anna Whelan
- University of Massachusetts, Worchester, MA, United States
| | - Stephen Wagner
- Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, MA, United States.
| | | | | | | | - Megha Gupta
- Beth Israel Deaconess Medical Center/Harvard Medical School, Boston, MA, United States
| |
Collapse
|
28
|
Di Camillo F, Grimaldi DA, Cattarinussi G, Di Giorgio A, Locatelli C, Khuntia A, Enrico P, Brambilla P, Koutsouleris N, Sambataro F. Magnetic resonance imaging-based machine learning classification of schizophrenia spectrum disorders: a meta-analysis. Psychiatry Clin Neurosci 2024; 78:732-743. [PMID: 39290174 PMCID: PMC11612547 DOI: 10.1111/pcn.13736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 07/31/2024] [Accepted: 08/19/2024] [Indexed: 09/19/2024]
Abstract
BACKGROUND Recent advances in multivariate pattern recognition have fostered the search for reliable neuroimaging-based biomarkers in psychiatric conditions, including schizophrenia. These approaches consider the complex pattern of alterations in brain function and structure, overcoming the limitations of traditional univariate methods. To assess the reliability of neuroimaging-based biomarkers and the contribution of study characteristics in distinguishing individuals with schizophrenia spectrum disorder (SSD) from healthy controls (HCs), we conducted a systematic review of the studies that used multivariate pattern recognition for this objective. METHODS We systematically searched PubMed, Scopus, and Web of Science for studies on SSD classification using multivariate pattern analysis on magnetic resonance imaging data. We employed a bivariate random-effects meta-analytic model to explore the classification of sensitivity (SE) and specificity (SP) across studies while also evaluating the moderator effects of clinical and non-clinical variables. RESULTS A total of 119 studies (with 12,723 patients with SSD and 13,196 HCs) were identified. The meta-analysis estimated a SE of 79.1% (95% confidence interval [CI], 77.1%-81.0%) and a SP of 80.0% (95% CI, 77.8%-82.0%). In particular, the Positive and Negative Syndrome Scale and the Global Assessment of Functioning scores, age, age of onset, duration of untreated psychosis, deep learning, algorithm type, features selection, and validation methods had significant effects on classification performance. CONCLUSIONS Multivariate pattern analysis reliably identifies neuroimaging-based biomarkers of SSD, achieving ∼80% SE and SP. Despite clinical heterogeneity, discernible brain modifications effectively differentiate SSD from HCs. Classification performance depends on patient-related and methodological factors crucial for the development, validation, and application of prospective models in clinical settings.
Collapse
Affiliation(s)
| | | | - Giulia Cattarinussi
- Department of Neuroscience (DNS)University of PadovaPaduaItaly
- Padova Neuroscience CenterUniversity of PadovaPaduaItaly
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and NeuroscienceKing's College LondonLondonUnited Kingdom
| | | | - Clara Locatelli
- Department of Mental Health and AddictionsASST Papa Giovanni XXIIIBergamoItaly
| | - Adyasha Khuntia
- Department of Psychiatry and PsychotherapyLudwig‐Maximilian UniversityMunichGermany
- International Max Planck Research School for Translational Psychiatry (IMPRS‐TP)MunichGermany
- Max‐Planck‐Institute of PsychiatryMunichGermany
| | - Paolo Enrico
- Department of Psychiatry and PsychotherapyLudwig‐Maximilian UniversityMunichGermany
- Department of Pathophysiology and TransplantationUniversity of MilanMilanItaly
- Department of Neurosciences and Mental HealthFondazione IRCSS Ca’ Granda Ospedale Maggiore PoliclinicoMilanItaly
| | - Paolo Brambilla
- Department of Pathophysiology and TransplantationUniversity of MilanMilanItaly
- Department of Neurosciences and Mental HealthFondazione IRCSS Ca’ Granda Ospedale Maggiore PoliclinicoMilanItaly
| | - Nikolaos Koutsouleris
- Max‐Planck‐Institute of PsychiatryMunichGermany
- Department of PsychiatryMunich University HospitalMunichGermany
- Department of Psychosis Studies, Institute of Psychiatry, Psychology and NeuroscienceKing's College LondonLondonUnited Kingdom
| | - Fabio Sambataro
- Department of Neuroscience (DNS)University of PadovaPaduaItaly
- Padova Neuroscience CenterUniversity of PadovaPaduaItaly
| |
Collapse
|
29
|
Harbut E, Makris Y, Pertsemlidis A, Bleris L. The history, landscape, and outlook of human cell line authentication and security. SLAS DISCOVERY : ADVANCING LIFE SCIENCES R & D 2024; 29:100194. [PMID: 39522879 DOI: 10.1016/j.slasd.2024.100194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 09/30/2024] [Accepted: 11/04/2024] [Indexed: 11/16/2024]
Affiliation(s)
- Elijah Harbut
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX, USA; Center for Systems Biology, The University of Texas at Dallas, Richardson, TX, USA; Department of Biological Sciences, The University of Texas at Dallas, Richardson, TX, USA
| | - Yiorgos Makris
- Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX, USA
| | - Alexander Pertsemlidis
- Department of Pediatrics, The University of Texas Health Science Center at San Antonio, San Antonio, TX, USA; Department of Cell Systems & Anatomy, The University of Texas Health Science Center at San Antonio, San Antonio, TX, USA; Greehey Children's Cancer Research Institute, The University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Leonidas Bleris
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX, USA; Center for Systems Biology, The University of Texas at Dallas, Richardson, TX, USA; Department of Biological Sciences, The University of Texas at Dallas, Richardson, TX, USA.
| |
Collapse
|
30
|
Wittau J, Seifert R. How to fight fake papers: a review on important information sources and steps towards solution of the problem. NAUNYN-SCHMIEDEBERG'S ARCHIVES OF PHARMACOLOGY 2024; 397:9281-9294. [PMID: 38970685 PMCID: PMC11582211 DOI: 10.1007/s00210-024-03272-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2024] [Accepted: 07/01/2024] [Indexed: 07/08/2024]
Abstract
Scientific fake papers, containing manipulated or completely fabricated data, are a problem that has reached dramatic dimensions. Companies known as paper mills (or more bluntly as "criminal science publishing gangs") produce and sell such fake papers on a large scale. The main drivers of the fake paper flood are the pressure in academic systems and (monetary) incentives to publish in respected scientific journals and sometimes the personal desire for increased "prestige." Published fake papers cause substantial scientific, economic, and social damage. There are numerous information sources that deal with this topic from different points of view. This review aims to provide an overview of these information sources until June 2024. Much more original research with larger datasets is needed, for example on the extent and impact of the fake paper problem and especially on how to detect them, as many findings are based more on small datasets, anecdotal evidence, and assumptions. A long-term solution would be to overcome the mantra of publication metrics for evaluating scientists in academia.
Collapse
Affiliation(s)
- Jonathan Wittau
- Institute of Pharmacology, Hannover Medical School, Carl-Neuberg-Straße 1, 30625, Hannover, Germany
| | - Roland Seifert
- Institute of Pharmacology, Hannover Medical School, Carl-Neuberg-Straße 1, 30625, Hannover, Germany.
| |
Collapse
|
31
|
Hartung J, Reuter S, Kulow VA, Fähling M, Spreckelsen C, Mrowka R. Experts fail to reliably detect AI-generated histological data. Sci Rep 2024; 14:28677. [PMID: 39562595 PMCID: PMC11577117 DOI: 10.1038/s41598-024-73913-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2024] [Accepted: 09/23/2024] [Indexed: 11/21/2024] Open
Abstract
AI-based methods to generate images have seen unprecedented advances in recent years challenging both image forensic and human perceptual capabilities. Accordingly, these methods are expected to play an increasingly important role in the fraudulent fabrication of data. This includes images with complicated intrinsic structures such as histological tissue samples, which are harder to forge manually. Here, we use stable diffusion, one of the most recent generative algorithms, to create such a set of artificial histological samples. In a large study with over 800 participants, we study the ability of human subjects to discriminate between these artificial and genuine histological images. Although they perform better than naive participants, we find that even experts fail to reliably identify fabricated data. While participant performance depends on the amount of training data used, even low quantities are sufficient to create convincing images, necessitating methods and policies to detect fabricated data in scientific publications.
Collapse
Affiliation(s)
- Jan Hartung
- Institute for Physiology, Faculty of Medicine, University of Freiburg, 79108, Freiburg, Germany.
- BrainLinks-BrainTools, IMBIT (Institute for Machine-Brain Interfacing Technology), University of Freiburg, Georges-Köhler-Allee 201, 79110, Freiburg, Germany.
- Department of Internal Medicine III, Experimental Nephrology, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany.
- Section of Translational Neuroimmunology, Department of Neurology, Jena University Hospital, 07747, Jena, Germany.
| | - Stefanie Reuter
- ThIMEDOP, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany
| | - Vera Anna Kulow
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Freie Universität Berlin and Humboldt-Universität zu Berlin, Institut für Translationale Physiologie (CCM), Charitéplatz 1, 10117, Berlin, Germany
| | - Michael Fähling
- Charité - Universitätsmedizin Berlin, Corporate member of Freie Universität Berlin and Freie Universität Berlin and Humboldt-Universität zu Berlin, Institut für Translationale Physiologie (CCM), Charitéplatz 1, 10117, Berlin, Germany
| | - Cord Spreckelsen
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, Bachstrase 18, 07743, Jena, Germany
- SMITH Consortium of the German Medical Informatics Initiative, Jena, Germany
| | - Ralf Mrowka
- Department of Internal Medicine III, Experimental Nephrology, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany.
- ThIMEDOP, Jena University Hospital, Nonnenplan 4, 07745, Jena, Germany.
| |
Collapse
|
32
|
Ioannidis JP. Transparency, bias, and reproducibility across science: a meta-research view. J Clin Invest 2024; 134:e181923. [PMID: 39545412 PMCID: PMC11563668 DOI: 10.1172/jci181923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2024] Open
|
33
|
Balas EA, De Leo G, Shaw K. Strategic policy options to improve quality and productivity of biomedical research. Politics Life Sci 2024; 44:108-119. [PMID: 39530190 PMCID: PMC11968251 DOI: 10.1017/pls.2024.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
Emerging societal expectations from biomedical research and intensifying international scientific competition are becoming existential matters. Based on a review of pertinent evidence, this article analyzes challenges and formulates public policy recommendations for improving productivity and impact of life sciences. Critical risks include widespread quality defects of research, particularly non-reproducible results, and narrow access to scientifically sound information giving advantage to health misinformation. In funding life sciences, the simultaneous shift to nondemocratic societies is an added challenge. Simply spending more on research will not be enough in the global competition. Considering the pacesetter role of the federal government, five national policy recommendations are put forward: (i) funding projects with comprehensive expectations of reproducibility; (ii) public-private partnerships for contemporaneous quality support in laboratories; (iii) making research institutions accountable for quality control; (iv) supporting new quality filtering standards for scientific journals and repositories, and (v) establishing a new network of centers for scientific health communications.
Collapse
Affiliation(s)
- E. Andrew Balas
- Biomedical Research Innovation Laboratory at Augusta University, Augusta GA
| | - Gianluca De Leo
- Biomedical Research Innovation Laboratory at Augusta University, Augusta GA
- Department of Health Management, Economics and Policy at Augusta University, Augusta GA
| | - Kelly Shaw
- Department of Political Science at Iowa State University, Ames IA
| |
Collapse
|
34
|
Morel VJ, Rössler J, Bernasconi M. Targeted immunotherapy and nanomedicine for rhabdomyosarcoma: The way of the future. Med Res Rev 2024; 44:2730-2773. [PMID: 38885148 DOI: 10.1002/med.22059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 04/17/2024] [Accepted: 05/20/2024] [Indexed: 06/20/2024]
Abstract
Rhabdomyosarcoma (RMS) is the most common soft tissue sarcoma of childhood. Histology separates two main subtypes: embryonal RMS (eRMS; 60%-70%) and alveolar RMS (aRMS; 20%-30%). The aggressive aRMS carry one of two characteristic chromosomal translocations that result in the expression of a PAX3::FOXO1 or PAX7::FOXO1 fusion transcription factor; therefore, aRMS are now classified as fusion-positive (FP) RMS. Embryonal RMS have a better prognosis and are clinically indistinguishable from fusion-negative (FN) RMS. Next to histology and molecular characteristics, RMS risk groupings are now available defining low risk tumors with excellent outcomes and advanced stage disease with poor prognosis, with an overall survival of about only 20% despite intensified multimodal treatment. Therefore, development of novel effective targeted strategies to increase survival and to decrease long-term side effects is urgently needed. Recently, immunotherapies and nanomedicine have been emerging for potent and effective tumor treatments with minimal side effects, raising hopes for effective and safe cures for RMS patients. This review aims to describe the most relevant preclinical and clinical studies in immunotherapy and targeted nanomedicine performed so far in RMS and to provide an insight in future developments.
Collapse
Affiliation(s)
- Victoria Judith Morel
- Department of Pediatric Hematology and Oncology, Inselspital, Bern University Hospital, Bern, Switzerland
- Department for BioMedical Research (DBMR), University of Bern, Bern, Switzerland
| | - Jochen Rössler
- Department of Pediatric Hematology and Oncology, Inselspital, Bern University Hospital, Bern, Switzerland
- Department for BioMedical Research (DBMR), University of Bern, Bern, Switzerland
| | - Michele Bernasconi
- Department of Pediatric Hematology and Oncology, Inselspital, Bern University Hospital, Bern, Switzerland
- Department for BioMedical Research (DBMR), University of Bern, Bern, Switzerland
| |
Collapse
|
35
|
Ghislat G, Hernandez-Hernandez S, Piyawajanusorn C, Ballester PJ. Data-centric challenges with the application and adoption of artificial intelligence for drug discovery. Expert Opin Drug Discov 2024; 19:1297-1307. [PMID: 39316009 DOI: 10.1080/17460441.2024.2403639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 09/09/2024] [Indexed: 09/25/2024]
Abstract
INTRODUCTION Artificial intelligence (AI) is exhibiting tremendous potential to reduce the massive costs and long timescales of drug discovery. There are however important challenges currently limiting the impact and scope of AI models. AREAS COVERED In this perspective, the authors discuss a range of data issues (bias, inconsistency, skewness, irrelevance, small size, high dimensionality), how they challenge AI models, and which issue-specific mitigations have been effective. Next, they point out the challenges faced by uncertainty quantification techniques aimed at enhancing and trusting the predictions from these AI models. They also discuss how conceptual errors, unrealistic benchmarks and performance misestimation can confound the evaluation of models and thus their development. Lastly, the authors explain how human bias, whether from AI experts or drug discovery experts, constitutes another challenge that can be alleviated by gaining more prospective experience. EXPERT OPINION AI models are often developed to excel on retrospective benchmarks unlikely to anticipate their prospective performance. As a result, only a few of these models are ever reported to have prospective value (e.g. by discovering potent and innovative drug leads for a therapeutic target). The authors have discussed what can go wrong in practice with AI for drug discovery. The authors hope that this will help inform the decisions of editors, funders investors, and researchers working in this area.
Collapse
Affiliation(s)
- Ghita Ghislat
- Department of Life Sciences, Imperial College London, London, UK
| | | | | | | |
Collapse
|
36
|
Ahuis TP, Smyk MK, Laloux C, Aulehner K, Bray J, Waldron AM, Miljanovic N, Seiffert I, Song D, Boulanger B, Jucker M, Potschka H, Platt B, Riedel G, Voehringer P, Nicholson JR, Drinkenburg WHIM, Kas MJH, Leiser SC. Evaluation of variation in preclinical electroencephalographic (EEG) spectral power across multiple laboratories and experiments: An EQIPD study. PLoS One 2024; 19:e0309521. [PMID: 39471212 PMCID: PMC11521305 DOI: 10.1371/journal.pone.0309521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 08/13/2024] [Indexed: 11/01/2024] Open
Abstract
The European Quality In Preclinical Data (EQIPD) consortium was born from the fact that publications report challenges with the robustness, rigor, and/or validity of research data, which may impact decisions about whether to proceed with further preclinical testing or to advance to clinical testing, as well as draw conclusions on the predictability of preclinical models. To address this, a consortium including multiple research laboratories from academia and industry participated in a series of electroencephalography (EEG) experiments in mice aimed to detect sources of variance and to gauge how protocol harmonisation and data analytics impact such variance. Ultimately, the goal of this first ever between-laboratory comparison of EEG recordings and analyses was to validate the principles that supposedly increase data quality, robustness, and comparability. Experiments consisted of a Localisation phase, which aimed to identify the factors that influence between-laboratory variability, a Harmonisation phase to evaluate whether harmonisation of standardized protocols and centralised processing and data analysis reduced variance, and a Ring-Testing phase to verify the ability of the harmonised protocol to generate consistent findings. Indeed, between-laboratory variability reduced from Localisation to Harmonisation and this reduction remained during the Ring-Testing phase. Results obtained in this multicentre preclinical qEEG study also confirmed the complex nature of EEG experiments starting from the surgery and data collection through data pre-processing to data analysis that ultimately influenced the results and contributed to variance in findings across laboratories. Overall, harmonisation of protocols and centralized data analysis were crucial in reducing laboratory-to-laboratory variability. To this end, it is recommended that standardized guidelines be updated and followed for collection and analysis of preclinical EEG data.
Collapse
Affiliation(s)
- Tim P. Ahuis
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
- Department of CNS Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Magdalena K. Smyk
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
- Department of Neuroscience, Janssen Research & Development, A Division of Janssen Pharmaceutica NV, Beerse, Belgium
| | | | - Katharina Aulehner
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Jack Bray
- Institute of Medical Sciences, University of Aberdeen, Foresterhill, Aberdeen, Scotland, United Kingdom
| | - Ann-Marie Waldron
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Nina Miljanovic
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Isabel Seiffert
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Dekun Song
- Translational EEG, PsychoGenics Inc., Paramus, New Jersey, United States of America
| | | | - Mathias Jucker
- Department of Cellular Neurology, Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Heidrun Potschka
- Institute of Pharmacology, Toxicology, and Pharmacy, Ludwig-Maximilians- Universität (LMU), Munich, Germany
| | - Bettina Platt
- Institute of Medical Sciences, University of Aberdeen, Foresterhill, Aberdeen, Scotland, United Kingdom
| | - Gernot Riedel
- Institute of Medical Sciences, University of Aberdeen, Foresterhill, Aberdeen, Scotland, United Kingdom
| | - Patrizia Voehringer
- Department of CNS Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Janet R. Nicholson
- Department of CNS Diseases Research, Boehringer Ingelheim Pharma GmbH & Co. KG, Biberach, Germany
| | - Wilhelmus H. I. M. Drinkenburg
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
- Department of Neuroscience, Janssen Research & Development, A Division of Janssen Pharmaceutica NV, Beerse, Belgium
| | - Martien J. H. Kas
- Groningen Institute for Evolutionary Life Sciences (GELIFES), Neurobiology, University of Groningen, Groningen, The Netherlands
| | - Steven C. Leiser
- Translational EEG, PsychoGenics Inc., Paramus, New Jersey, United States of America
| |
Collapse
|
37
|
Ameen-Ali KE, Allen C. The 3Rs in zebrafish research. Zebrafish 2024:225-250. [DOI: 10.1079/9781800629431.0008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2025] Open
|
38
|
Glover CN, Borowiec BG, Joyce W. Editorial: Common methodological issues in comparative biochemistry and physiology. Comp Biochem Physiol A Mol Integr Physiol 2024; 296:111697. [PMID: 39002941 DOI: 10.1016/j.cbpa.2024.111697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/15/2024]
Affiliation(s)
| | | | - William Joyce
- Centro Nacional de Investigaciones Cardiovasculares, Spain
| |
Collapse
|
39
|
Ronquillo JG, South B, Naik P, Singh R, De Jesus M, Watt SJ, Habtezion A. Informatics and Artificial Intelligence-Guided Assessment of the Regulatory and Translational Research Landscape of First-in-Class Oncology Drugs in the United States, 2018-2022. JCO Clin Cancer Inform 2024; 8:e2400087. [PMID: 39348666 DOI: 10.1200/cci.24.00087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2024] [Revised: 06/23/2024] [Accepted: 08/13/2024] [Indexed: 10/02/2024] Open
Abstract
PURPOSE Cancer drug development remains a critical but challenging process that affects millions of patients and their families. Using biomedical informatics and artificial intelligence (AI) approaches, we assessed the regulatory and translational research landscape defining successful first-in-class drugs for patients with cancer. METHODS This is a retrospective observational study of all novel first-in-class drugs approved by the US Food and Drug Administration (FDA) from 2018 to 2022, stratified by cancer versus noncancer drugs. A biomedical informatics pipeline leveraging interoperability standards and ChatGPT performed integration and analysis of public databases provided by the FDA, National Institutes of Health, and WHO. RESULTS Between 2018 and 2022, the FDA approved a total of 247 novel drugs, of which 107 (43.3%) were first-in-class drugs involving a new biologic target. Of these first-in-class drugs, 30 (28%) treatments were indicated for patients with cancer, including 19 (63.3%) for solid tumors and the remaining 11 (36.7%) for hematologic cancers. A median of 68 publications of basic, clinical, and other relevant translational science preceded successful FDA approval of first-in-class cancer drugs, with oncology-related treatments involving fewer median years of target-based research than therapies not related to cancer (33 v 43 years; P < .05). Overall, 94.4% of first-in-class drugs had at least 25 years of target-related research papers, while 85.5% of first-in-class drugs had at least 10 years of translational research publications. CONCLUSION Novel first-in-class cancer treatments are defined by diverse clinical indications, personalized molecular targets, dependence on expedited regulatory pathways, and translational research metrics reflecting this complex landscape. Biomedical informatics and AI provide scalable, data-driven ways to assess and even address important challenges in the drug development pipeline.
Collapse
Affiliation(s)
- Jay G Ronquillo
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Brett South
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Prakash Naik
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Rominder Singh
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Magdia De Jesus
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Stephen J Watt
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| | - Aida Habtezion
- Worldwide Medical and Safety, Pfizer Inc, New York, NY
- Pfizer Research and Development, Pfizer Inc, New York, NY
| |
Collapse
|
40
|
Jarvis MF. Decatastrophizing research irreproducibility. Biochem Pharmacol 2024; 228:116090. [PMID: 38408680 DOI: 10.1016/j.bcp.2024.116090] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Revised: 02/03/2024] [Accepted: 02/23/2024] [Indexed: 02/28/2024]
Abstract
The reported inability to replicate research findings from the published literature precipitated extensive efforts to identify and correct perceived deficiencies in the execution and reporting of biomedical research. Despite these efforts, quantification of the magnitude of irreproducible research or the effectiveness of associated remediation initiatives, across diverse biomedical disciplines, has made little progress over the last decade. The idea that science is self-correcting has been further challenged in recent years by the proliferation of unverified or fraudulent scientific content generated by predatory journals, paper mills, pre-print server postings, and the inappropriate use of artificial intelligence technologies. The degree to which the field of pharmacology has been negatively impacted by these evolving pressures is unknown. Regardless of these ambiguities, pharmacology societies and their associated journals have championed best practices to enhance the experimental rigor and reporting of pharmacological research. The value of transparent and independent validation of raw data generation and its analysis in basic and clinical research is exemplified by the discovery, development, and approval of Highly Effective Modulator Therapy (HEMT) for Cystic Fibrosis (CF) patients. This provides a didactic counterpoint to concerns regarding the current state of biomedical research. Key features of this important therapeutic advance include objective construction of basic and translational research hypotheses, associated experimental designs, and validation of experimental effect sizes with quantitative alignment to meaningful clinical endpoints with input from the FDA, which enhanced scientific rigor and transparency with real world deliverables for patients in need.
Collapse
Affiliation(s)
- Michael F Jarvis
- Department of Pharmaceutical Sciences, University of Illinois-Chicago, USA.
| |
Collapse
|
41
|
Ramadan A, Chleilat E, Martinez-Navarro H, Brennan-McLean J, Copier J, Caldwell J, Greiner J, Martínez Díaz P, Sobota V. Gordon Research Conference on Cardiac Arrhythmia Mechanisms 2023: early career investigators' views on emerging concepts and technologies. J Physiol 2024; 602:5151-5153. [PMID: 37462064 DOI: 10.1113/jp284666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 06/28/2023] [Indexed: 10/22/2024] Open
Affiliation(s)
- Ahmed Ramadan
- School of Biomedical Engineering, Dalhousie University, Halifax, Nova Scotia, Canada
| | - Enaam Chleilat
- Institute for Experimental Cardiovascular Medicine, University Heart Center Freiburg Bad Krozingen, and Medical Faculty of the University of Freiburg, Freiburg, Germany
| | - Hector Martinez-Navarro
- Department of Computer Science, British Heart Foundation Centre of Research Excellence, University of Oxford, Oxford, UK
| | - Jaclyn Brennan-McLean
- American Association for the Advancement of Science (AAAS) Science and Technology Policy Fellowships Program, Washington, DC, USA
| | - Jaël Copier
- Amsterdam UMC location University of Amsterdam, Experimental Cardiology, Amsterdam Cardiovascular Sciences, Heart failure & arrhythmias, Amsterdam, The Netherlands
| | - Jessica Caldwell
- Department of Pharmacology, University of California Davis, Davis, California, USA
| | - Joachim Greiner
- Institute for Experimental Cardiovascular Medicine, University Heart Center Freiburg Bad Krozingen, and Medical Faculty of the University of Freiburg, Freiburg, Germany
| | - Patricia Martínez Díaz
- Karlsruhe Institute of Technology (KIT), Institute of Biomedical Engineering, Karlsruhe, Germany
| | - Vladimír Sobota
- IHU Liryc, Electrophysiology and Heart Modeling Institute, Fondation Bordeaux Université, Bordeaux, France
| |
Collapse
|
42
|
Li Y, Zhou X, Chen R, Zhang X, Cao H. STAREG: Statistical replicability analysis of high throughput experiments with applications to spatial transcriptomic studies. PLoS Genet 2024; 20:e1011423. [PMID: 39361716 PMCID: PMC11478871 DOI: 10.1371/journal.pgen.1011423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 10/15/2024] [Accepted: 09/10/2024] [Indexed: 10/05/2024] Open
Abstract
Replicable signals from different yet conceptually related studies provide stronger scientific evidence and more powerful inference. We introduce STAREG, a statistical method for replicability analysis of high throughput experiments, and apply it to analyze spatial transcriptomic studies. STAREG uses summary statistics from multiple studies of high throughput experiments and models the the joint distribution of p-values accounting for the heterogeneity of different studies. It effectively controls the false discovery rate (FDR) and has higher power by information borrowing. Moreover, it provides different rankings of important genes. With the EM algorithm in combination with pool-adjacent-violator-algorithm (PAVA), STAREG is scalable to datasets with millions of genes without any tuning parameters. Analyzing two pairs of spatially resolved transcriptomic datasets, we are able to make biological discoveries that otherwise cannot be obtained by using existing methods.
Collapse
Affiliation(s)
- Yan Li
- School of Computer Science and Technology, Changchun University of Science and Technology, Changchun, Jilin, China
- School of Mathematics, Jilin University, Changchun, Jilin, China
| | - Xiang Zhou
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan, United States of America
| | - Rui Chen
- Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, Texas, United States of America
| | - Xianyang Zhang
- Department of Statistics, Texas A&M University, College Station, Texas, United States of America
| | - Hongyuan Cao
- Department of Statistics, Florida State University, Tallahassee, Florida, United States of America
| |
Collapse
|
43
|
Miyahira AK, Soule HR. The 30th Annual Prostate Cancer Foundation Scientific Retreat Report. Prostate 2024; 84:1271-1289. [PMID: 39021296 DOI: 10.1002/pros.24768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Accepted: 07/02/2024] [Indexed: 07/20/2024]
Abstract
BACKGROUND The 30th Annual Prostate Cancer Foundation (PCF) Scientific Retreat was held at the Omni La Costa Resort in Carlsbad, CA, from October 26 to 28, 2023. A hybrid component was included for virtual attendees. METHODS The Annual PCF Scientific Retreat is a leading international scientific conference focused on pioneering, unpublished, and impactful studies across the spectrum of basic through clinical prostate cancer research, as well as research from related fields with significant potential for improving prostate cancer research and patient outcomes. RESULTS The 2023 PCF Retreat concentrated on key areas of research, including: (i) the biology of cancer stem cells and prostate cancer lineage plasticity; (ii) mechanisms of treatment resistance; (iii) emerging AI applications in diagnostic medicine; (iv) analytical and computational biology approaches in cancer research; (v) the role of nerves in prostate cancer; (vi) the biology of prostate cancer bone metastases; (vii) the contribution of ancestry and genomics to prostate cancer disparities; (viii) prostate cancer 3D genomics; (ix) progress in new targets and treatments for prostate cancer; (x) the biology and translational applications of tumor extracellular vesicles; (xi) updates from PCF TACTICAL Award teams; (xii) novel platforms for small molecule molecular glues and binding inhibitors; and (xiii) diversity, equity and inclusion strategies for advancing cancer care equity. CONCLUSIONS This meeting report summarizes the presentations and discussions from the 2023 PCF Scientific Retreat. We hope that sharing this information will deepen our understanding of current and emerging research and drive future advancements in prostate cancer patient care.
Collapse
Affiliation(s)
- Andrea K Miyahira
- Department of Science, Prostate Cancer Foundation, Santa Monica, California, USA
| | - Howard R Soule
- Department of Science, Prostate Cancer Foundation, Santa Monica, California, USA
| |
Collapse
|
44
|
Calin-Jageman R, Cumming G. From significance testing to estimation and Open Science: How esci can help. INTERNATIONAL JOURNAL OF PSYCHOLOGY 2024; 59:672-689. [PMID: 38679926 DOI: 10.1002/ijop.13132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 04/02/2024] [Indexed: 05/01/2024]
Abstract
We argue that researchers should test less, estimate more, and adopt Open Science practices. We outline some of the flaws of null hypothesis significance testing and take three approaches to demonstrating the unreliability of the p value. We explain some advantages of estimation and meta-analysis ("the new statistics"), especially as contributions to Open Science practices, which aim to increase the openness, integrity, and replicability of research. We then describe esci (estimation statistics with confidence intervals): a set of online simulations and an R package for estimation that integrates into jamovi and JASP. This software provides (a) online activities to sharpen understanding of statistical concepts (e.g., "The Dance of the Means"); (b) effects sizes and confidence intervals for a range of study designs, largely by using techniques recently developed by Bonett; (c) publication-ready visualisations that make uncertainty salient; and (d) the option to conduct strong, fair hypothesis evaluation through specification of an interval null. Although developed specifically to support undergraduate learning through the 2nd edition of our textbook, esci should prove a valuable tool for graduate students and researchers interested in adopting the estimation approach. Further information is at ( https://thenewstatistics.com).
Collapse
Affiliation(s)
| | - Geoff Cumming
- School of Psychology and Public Health, La Trobe University, Melbourne, Australia
| |
Collapse
|
45
|
Lin C, Sniezek CM, McGann CD, Karki R, Giglio RM, Garcia BA, McFaline-Figeroa JL, Schweppe DK. Defining the heterogeneous molecular landscape of lung cancer cell responses to epigenetic inhibition. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.23.592075. [PMID: 38853901 PMCID: PMC11160595 DOI: 10.1101/2024.05.23.592075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2024]
Abstract
Epigenetic inhibitors exhibit powerful antiproliferative and anticancer activities. However, cellular responses to small-molecule epigenetic inhibition are heterogenous and dependent on factors such as the genetic background, metabolic state, and on-/off-target engagement of individual small-molecule compounds. The molecular study of the extent of this heterogeneity often measures changes in a single cell line or using a small number of compounds. To more comprehensively profile the effects of small-molecule perturbations and their influence on these heterogeneous cellular responses, we present a molecular resource based on the quantification of chromatin, proteome, and transcriptome remodeling due to histone deacetylase inhibitors (HDACi) in non-isogenic cell lines. Through quantitative molecular profiling of 10,621 proteins, these data reveal coordinated molecular remodeling of HDACi treated cancer cells. HDACi-regulated proteins differ greatly across cell lines with consistent (JUN, MAP2K3, CDKN1A) and divergent (CCND3, ASF1B, BRD7) cell-state effectors. Together these data provide valuable insight into cell-type driven and heterogeneous responses that must be taken into consideration when monitoring molecular perturbations in culture models.
Collapse
Affiliation(s)
- Chuwei Lin
- Genome Sciences, University of Washington, Seattle, WA 98105, USA
| | | | | | - Rashmi Karki
- Department of Biochemistry and Molecular Biophysics, Washington University School of Medicine, St. Louis, MO 63110, USA
| | - Ross M. Giglio
- Biomedical Engineer, Columbia University, New York, NY 10027, USA
| | - Benjamin A. Garcia
- Department of Biochemistry and Molecular Biophysics, Washington University School of Medicine, St. Louis, MO 63110, USA
| | | | - Devin K. Schweppe
- Genome Sciences, University of Washington, Seattle, WA 98105, USA
- Brotman Baty Institute for Precision Medicine, Seattle, Washington, USA
- Institute of Stem Cell and Regenerative Medicine, University of Washington, Seattle, Washington, USA
| |
Collapse
|
46
|
Mahooti M, Abdolalipour E, Sanami S, Zare D. Inflammatory Modulation Effects of Probiotics: A Safe and Promising Modulator for Cancer Prevention. Curr Microbiol 2024; 81:372. [PMID: 39312034 DOI: 10.1007/s00284-024-03901-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 09/15/2024] [Indexed: 10/22/2024]
Abstract
Chronic inflammation is the gate of many human illnesses and happens when the immune system is unable to suppress external attacks in the correct form. Nonetheless, the gut microbiome plays a pivotal role in keeping homeostasis in the human body and preventing inflammation. Imbalanced microbiota and many diseases can result in inflammation, which when not taken seriously, can be turned into chronic ones and ultimately lead to serious diseases such as cancer. One approach to maintaining hemostasis in the human body is consumption of probiotics as a supplement. Probiotics impact the immune functions of dendritic cells (DCs), T cells, and B cells in the gut-associated lymphoid tissue by inducing the secretion of an array of cytokines. They activate the innate immune response through their microbial-associated molecular pattern, and this activation is followed by multiple cytokine secretion and adaptive elicitation that mitigates pro-inflammatory expression levels and tumor incidence. Thus, according to several studies showing the benefit of probiotics application, alone or in combination with other agents, to induce potent immune responses in individuals against some inflammatory disorders and distinct types of cancers, this review is devoted to surveying the role of probiotics and the modulation of inflammation in some cancer models.
Collapse
Affiliation(s)
- Mehran Mahooti
- Department of Biotechnology, Iranian Research Organization for Science and Technology, P. O. Box 3353-5111, Tehran, Iran
| | - Elahe Abdolalipour
- Department of Virology, Pasteur Institute of Iran, P.O.Box: 1316943551, Tehran, Iran
| | - Samira Sanami
- Ubnormal Uterine Bleeding Research Center, Semnan University of Medical Sciences, Semnan, Iran
| | - Davood Zare
- Department of Biotechnology, Iranian Research Organization for Science and Technology, P. O. Box 3353-5111, Tehran, Iran.
| |
Collapse
|
47
|
Kokudeva M, Vichev M, Naseva E, Miteva DG, Velikova T. Artificial intelligence as a tool in drug discovery and development. World J Exp Med 2024; 14:96042. [PMID: 39312699 PMCID: PMC11372739 DOI: 10.5493/wjem.v14.i3.96042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 08/06/2024] [Accepted: 08/12/2024] [Indexed: 08/29/2024] Open
Abstract
The rapidly advancing field of artificial intelligence (AI) has garnered substantial attention for its potential application in drug discovery and development. This opinion review critically examined the feasibility and prospects of integrating AI as a transformative tool in the pharmaceutical industry. AI, encompassing machine learning algorithms, deep learning, and data analytics, offers unprecedented opportunities to streamline and enhance various stages of drug development. This opinion review delved into the current landscape of AI-driven approaches, discussing their utilization in target identification, lead optimization, and predictive modeling of pharmacokinetics and toxicity. We aimed to scrutinize the integration of large-scale omics data, electronic health records, and chemical informatics, highlighting the power of AI in uncovering novel therapeutic targets and accelerating drug repurposing strategies. Despite the considerable potential of AI, the review also addressed inherent challenges, including data privacy concerns, interpretability of AI models, and the need for robust validation in real-world clinical settings. Additionally, we explored ethical considerations surrounding AI-driven decision-making in drug development. This opinion review provided a nuanced perspective on the transformative role of AI in drug discovery by discussing the existing literature and emerging trends, presenting critical insights and addressing potential hurdles. In conclusion, this study aimed to stimulate discourse within the scientific community and guide future endeavors to harness the full potential of AI in drug development.
Collapse
Affiliation(s)
- Maria Kokudeva
- Department of Pharmacology and Toxicology, Faculty of Pharmacy, Medical University of Sofia, Sofia 1000, Bulgaria
| | | | - Emilia Naseva
- Faculty of Public Health, Medical University of Sofia, Sofia 1431, Bulgaria
| | - Dimitrina Georgieva Miteva
- Department of Genetics, Faculty of Biology, Sofia University St. Kliment Ohridski, Sofia 1164, Bulgaria
- Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| | - Tsvetelina Velikova
- Medical Faculty, Sofia University St. Kliment Ohridski, Sofia 1407, Bulgaria
| |
Collapse
|
48
|
Grimes DR. Towards replicability and sustainability in cancer research. BJC REPORTS 2024; 2:65. [PMID: 39516681 PMCID: PMC11524053 DOI: 10.1038/s44276-024-00090-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 07/23/2024] [Accepted: 08/08/2024] [Indexed: 11/16/2024]
Abstract
High-quality cancer research is crucial to both save lives and improve quality of life. Spurious findings, however, impedes these laudable goals by misleading research efforts and creating research waste that is inherently difficult to counteract. Irreproducible research is intrinsically wasteful, and unsustainable over the long term. In this perspective piece, we elucidate the extent of the current replication crisis and the underlying causes, identifying practices that lend themselves to unsustainable spurious findings, and the factors that underpin these practices. Finally we outline some remedies to the problem of irreproducible research, and how we might move towards more sustainable and trustworthy research in biomedical science.
Collapse
Affiliation(s)
- David Robert Grimes
- TCD Biostatistics Unit, Discipline of Public Health and Primary Care, School of Medicine, Trinity College Dublin, Dublin, Ireland.
- School of Physical Sciences, Dublin City University, Dublin, Ireland.
| |
Collapse
|
49
|
Kahn RA, Virk H, Laflamme C, Houston DW, Polinski NK, Meijers R, Levey AI, Saper CB, Errington TM, Turn RE, Bandrowski A, Trimmer JS, Rego M, Freedman LP, Ferrara F, Bradbury ARM, Cable H, Longworth S. Antibody characterization is critical to enhance reproducibility in biomedical research. eLife 2024; 13:e100211. [PMID: 39140332 PMCID: PMC11324233 DOI: 10.7554/elife.100211] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Accepted: 08/06/2024] [Indexed: 08/15/2024] Open
Abstract
Antibodies are used in many areas of biomedical and clinical research, but many of these antibodies have not been adequately characterized, which casts doubt on the results reported in many scientific papers. This problem is compounded by a lack of suitable control experiments in many studies. In this article we review the history of the 'antibody characterization crisis', and we document efforts and initiatives to address the problem, notably for antibodies that target human proteins. We also present recommendations for a range of stakeholders - researchers, universities, journals, antibody vendors and repositories, scientific societies and funders - to increase the reproducibility of studies that rely on antibodies.
Collapse
Affiliation(s)
- Richard A Kahn
- Department of Biochemistry, Emory University School of MedicineAtlantaUnited States
| | - Harvinder Virk
- Department of Respiratory Sciences, University of LeicesterLeicesterUnited Kingdom
| | - Carl Laflamme
- Department of Neurology and Neurosurgery, Structural Genomics Consortium, The Montreal Neurological Institute, McGill UniversityMontrealCanada
| | - Douglas W Houston
- The Development Studies Hybridoma Databank, University of IowaIowa CityUnited States
| | - Nicole K Polinski
- The Michael J Fox Foundation for Parkinson’s ResearchNew YorkUnited States
| | - Rob Meijers
- Institute for Protein InnovationBostonUnited States
| | - Allan I Levey
- Department of Neurology, Emory University School of MedicineAtlantaUnited States
| | - Clifford B Saper
- Department of Neurology and Program in Neuroscience, Harvard Medical School and Beth Israel Deaconess Medical CenterBostonUnited States
| | | | - Rachel E Turn
- Department of Microbiology and Immunology, Stanford University School of MedicineStanfordUnited States
| | - Anita Bandrowski
- Department of Neuroscience, University of California, San DiegoLa JollaUnited States
| | - James S Trimmer
- Department of Physiology and Membrane Biology, University of California, Davis School of MedicineDavisUnited States
| | | | | | | | | | - Hannah Cable
- Department of Research and Development, AbcamCambridgeUnited Kingdom
| | | |
Collapse
|
50
|
Meinhardt MW, Gerlach B, Spanagel R. Good Practice Guideline for Preclinical Alcohol Research: The STRINGENCY Framework. Curr Top Behav Neurosci 2024. [PMID: 39117860 DOI: 10.1007/7854_2024_484] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/10/2024]
Abstract
Research in the field of preclinical alcohol research, but also science in general, has a problem: Many published scientific results cannot be repeated. As a result, findings from preclinical research often do not translate well to humans, causing increasing disappointment and calls for restructuring of preclinical research, that is, better reproducibility of preclinical research. However, the replication crisis is an inherent problem in biomedical research. Replication failures are not only due to small experimental variations but are often the result of poor methodology. In response to the replication crisis, numerous guidelines and recommendations have been proposed to promote transparency, rigor, and reproducibility in scientific research. What is missing today is a framework that integrates all the confusing information that results from all these guidelines and recommendations. Here we present STRINGENCY, an integrative approach to good practice guidelines for preclinical alcohol research, which can also apply to behavioral research in general and which aims to improve preclinical research to better prepare it for translation and minimize the "valley of death" in translational research. STRINGENCY includes systematic review and, when possible, meta-analysis prior to study design, sample size calculation, preregistration, multisite experiments, scientific data management (FAIR), reporting of data using ARRIVE, generalization of research data, and transparent publications that allow reporting of null results. We invite the scientific community to adopt STRINGENCY to improve the reliability and impact of preclinical alcohol research.
Collapse
Affiliation(s)
- Marcus W Meinhardt
- Institute of Psychopharmacology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Heidelberg, Germany.
- Department of Molecular Neuroimaging, Medical Faculty Mannheim, Central Institute of Mental Health, University of Heidelberg, Heidelberg, Germany.
| | - Björn Gerlach
- Institute of Psychopharmacology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Heidelberg, Germany
- Guarantors of EQIPD e.V., Heidelberg, Germany
- PAASP GmbH, Heidelberg, Germany
| | - Rainer Spanagel
- Institute of Psychopharmacology, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Heidelberg, Germany.
- German Center for Mental Health (DZPG), Mannheim, Heidelberg, Ulm, Germany.
| |
Collapse
|