Fung KY, Nice E, Priebe I, Belobrajdic D, Phatak A, Purins L, Tabor B, Pompeia C, Lockett T, Adams TE, Burgess A, Cosgrove L. Colorectal cancer biomarkers: To be or not to be? Cautionary tales from a road well travelled. World J Gastroenterol 2014; 20(4): 888-898 [PMID: 24574763 DOI: 10.3748/wjg.v20.i4.888]
Corresponding Author of This Article
Kim YC Fung, PhD, CSIRO, Preventative Health National Research Flagship, PO Box 10041, Adelaide, SA 5000, Australia. kim.fung@csiro.au
Research Domain of This Article
Medicine, Research & Experimental
Article-Type of This Article
Topic Highlight
Open-Access Policy of This Article
This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Kim YC Fung, Ilka Priebe, Damien Belobrajdic, Leanne Purins, Bruce Tabor, Celine Pompeia, Trevor Lockett, Leah Cosgrove, CSIRO, Preventative Health National Research Flagship, Adelaide, SA 5000, Australia
Edouard Nice, Department of Biochemistry and Molecular Biology, Monash University, Clayton, VIC 3168, Australia
Aloke Phatak, CSIRO, Computational Informatics, Floreat, WA 6014, Australia
Timothy E Adams, CSIRO, Materials Science and Engineering, Parkville, VIC 3052, Australia
Antony Burgess, Walter and Eliza Hall Institute of Medical Research, Parkville, VIC 3052, Australia
ORCID number: $[AuthorORCIDs]
Author contributions: Fung KYC and Nice E wrote the paper; Priebe I performed the research and analysed the data; Fung KYC, Nice E and Priebe I contributed equally to the work; Belobrajdic D contributed data to the study; Fung KYC, Phatak A, Purins L, Tabor B and Pompeia C analysed the data; Lockett T, Adams TE, Burgess A and Cosgrove L designed the research.
Supported by The CSIRO Preventative Health National Research Flagship and the National Health and Medical Research Council, No. 1017078
Correspondence to: Kim YC Fung, PhD, CSIRO, Preventative Health National Research Flagship, PO Box 10041, Adelaide, SA 5000, Australia. kim.fung@csiro.au
Telephone: +61-8-83038840 Fax: +61-8-83038899
Received: September 26, 2013 Revised: November 26, 2013 Accepted: January 6, 2014 Published online: January 28, 2014 Processing time: 122 Days and 8.4 Hours
Abstract
Colorectal cancer (CRC) is the second most common cause of cancer-related death worldwide and places a major economic burden on the global health care system. The time frame for development from premalignant to malignant disease typically spans 10-15 years, and this latent period provides an ideal opportunity for early detection and intervention to improve patient outcomes. Currently, early diagnosis of CRC is hampered by a lack of suitable non-invasive biomarkers that are clinically or economically acceptable for population-based screening. New blood-based protein biomarkers for early detection of CRC are therefore urgently required. The success of clinical biomarker discovery and validation studies is critically dependent on understanding and adjusting for potential experimental, analytical, and biological factors that can interfere with the robust interpretation of results. In this review we outline some important considerations for research groups undertaking biomarker research with exemplars from our studies. Implementation of experimental strategies to minimise the potential effects of these problems will facilitate the identification of panels of biomarkers with the sensitivity and specificity required for the development of successful tests for the early detection and surveillance of CRC.
Core tip: The identification of sensitive and specific biomarkers for the early diagnosis and surveillance of colorectal cancer is recognised as being fundamental to improve survival for this disease. Studies involving analyses of multiple biomarkers require consideration of many potential confounding issues, some of which are impossible or difficult to control for. Implementation of strategies which can overcome and account for potentially confounding variables is essential to ensure robust verification and validation of potential biomarkers and their successful evaluation in large and meaningful clinical cohorts that are representative of the target population, ultimately with successful translation into the clinic.
Citation: Fung KY, Nice E, Priebe I, Belobrajdic D, Phatak A, Purins L, Tabor B, Pompeia C, Lockett T, Adams TE, Burgess A, Cosgrove L. Colorectal cancer biomarkers: To be or not to be? Cautionary tales from a road well travelled. World J Gastroenterol 2014; 20(4): 888-898
Worldwide, colorectal cancer (CRC) is one of the most prevalent cancers representing approximately 10% of all cancer diagnoses[1]. This places a major economic burden on the global health care system[2]. CRC is, however, regarded as one of the most preventable diseases as lifestyle and diet are believed to be major causative factors in disease development[3]. Epidemiological studies have shown that smoking, excess body weight, physical inactivity and low consumption of dietary fibre are risk factors for CRC[3]. Early detection of CRC is especially important as patients who are diagnosed early (TNM Stage I disease) have a 5-year survival rate of 90%-95% following surgical resection[4]. In contrast, when diagnosed at the later stages (i.e., Stage IV), the 5-year survival rate is only 5%-10%. Currently, the faecal occult blood test (FOBT) and faecal immune test are the only clinically accepted non-invasive diagnostic tests for CRC[5]. These tests detect the presence of haem or blood in stool, but have low sensitivity for CRC (61%-79% sensitivity at 86%-95% specificity)[6-8] and perform poorly for early disease detection (sensitivity of 27% and 50% for advanced neoplasia and Dukes Stage A, respectively)[7]. While colonoscopy and sigmoidoscopy have high specificity for CRC and are capable of early detection, they are highly invasive and costly procedures. Early stages of the disease (premalignant or Stage 1) are asymptomatic and it is estimated that up to 50% of patients already have invasive cancer or metastasis at presentation. Consequently, to reduce mortality from this disease, an improved sensitive and specific non-invasive screening test for CRC is urgently needed.
Early diagnosis, including detection of adenomas, is considered to be a key aspect for improving patient survival and prognostic or predictive biomarkers are essential for guiding patient therapy or monitoring treatment efficacy. However, the success of biomarker translation into the clinic has been limited and very few biomarkers have passed the steps necessary for routine clinical utility. The US Food and Drug Administration (FDA) has approved less than 30 cancer biomarkers, primarily to monitor response to therapy, over recent years despite the thousands of research papers published every year[9]. As yet, a diagnostic panel has not been identified for CRC despite extensive research efforts and numerous reports of potential multi-marker protein panels or gene signatures. These include multiple gene biomarker panels[10-15], individual protein biomarkers[16-19], metabolic markers[20], a stool DNA test[21], and the DNA methylation marker, septin 9 (mSEPT9)[22]. The most promising test to date is a stool DNA test comprised of a panel of four methylated genes (BMP3, NDRG4, vimentin, TFPI2), a mutant form of KRAS and α-actin as the internal reference control[21]. In a recent blinded multicentre trial, this panel was able to accurately detect Stage I-III CRC patients with 87% sensitivity at 90% specificity in a training set and with 78% sensitivity at 85% specificity in a test set (combined sensitivity of 85% at 90% specificity). More importantly, this test was also able to detect large polyps with a detection rate of 54% and 92% for polyps ≥ 1 cm and > 4 cm, respectively. This test is currently awaiting FDA approval.
Recently, mSEPT9 has emerged as a promising diagnostic marker for CRC[22-25]. mSEPT measured in plasma is reported to have higher sensitivity and specificity than either the guaiac faecal occult blood test (gFOBT) or carcinoembryonic antigen (CEA)[24]. Tóth et al[24] reported a sensitivity of 79.3% for mSEPT9 vs 68.2% and 51.8% for gFOBT and CEA, respectively (specificity of 84.8%, 70.6% and 85.2%, respectively). Warren et al[25] also recently reported 90% sensitivity at 88% specificity for all disease stages for mSEPT9, 87% for Stage I-II disease and a detection rate of 12% for adenomas. Based on these studies, a prospective study was conducted in an asymptomatic screening population aged 50 years and older and this study determined that the sensitivity for mSEPT9 was 48% at 91% specificity, indicating that performance of this test in a screening population may not be optimal[26]. Furthermore, when compared with the stool DNA test mentioned above, the sensitivity for CRC was 87% for the stool DNA panel vs 60% for plasma mSEPT9 and the authors also reported that the stool DNA test was markedly more sensitive for early stage disease and proximal cancers than mSEPT9[27]. Although mSEPT9 is considered highly promising, a recent cost-effectiveness study conducted by Ladabaum et al[28] revealed that current established screening modalities were still more effective than mSEPT9 and that testing of mSEPT9 yielded only an incremental benefit. This study highlights that in addition to high sensitivity and specificity, a diagnostic test must fulfil additional criteria to be successfully adopted by the community.
Amongst the many proteins that have been proposed as potential diagnostic biomarkers for CRC, two protein biomarkers have been extensively investigated: the tumour specific M2 isoform of pyruvate kinase (PKM2) and tissue inhibitor of matrix metalloproteinase 1 (TIMP1). PKM2 measured in plasma and stool show relatively high sensitivity for CRC diagnosis, with reported sensitivity of over 90% in stool in some studies[29-31]. Plasma TIMP1 is reportedly elevated in CRC in comparison to control populations, and prospective studies have been conducted to determine its utility as a biomarker for CRC[32,33] based on published data of retrospective studies reporting sensitivity and specificity of TIMP1 of 63% at 98%, respectively, for CRC overall, and 56% sensitivity for early stage disease (Dukes Stages A and B)[34]. The results of prospective studies to date have been disappointing. Based on the results of the recent study by Neilson et al[33] which included 4509 individuals who undertook sigmoidoscopy or colonoscopy, TIMP1 measured in plasma was not demonstrably better than CEA at detecting CRC. Another prospective study by the same group also determined that no difference in plasma TIMP1 levels was detectable between patients with adenomas, polyps or no colon pathology, indicating that TIMP1 is not suitable for detection of premalignant lesions[35]. Accordingly, plasma TIMP1 is believed to be more sensitive for late stage disease (Stage D) in comparison to Stages A, B or C, and higher pre-operative levels are associated with poor prognosis[36-39]. Additionally, when compared to FOBT, both PKM2 and TIMP1 are less sensitive for disease detection[18,40].
CEA measured in serum and carbohydrate antigen 19-9 (CA19-9), a gastrointestinal tumour marker, are two well documented blood-based protein biomarkers used for cancer detection[41,42]. Serum CEA is widely used as a cancer biomarker to monitor recurrence, however, it is not recommended for use as a diagnostic marker as it is not specific for CRC or cancer, can be elevated in response to other physiological conditions, and has low sensitivity for diagnosis of CRC[43]. The sensitivity of CEA for early stage disease is relatively low and is higher in the later stages of disease. Wang et al[44] reported elevated pre-operative CEA levels in less than 40% of patients diagnosed with Stage A and B disease, and in 70% of patients with Stage C disease. Similar to CEA, CA19-9 is non-specific for cancer and elevated levels are detected in benign inflammatory diseases, especially benign intestinal and liver disease[45]. The measurement of CA19-9 in serum has lower sensitivity than CEA for CRC diagnosis and like CEA, its greatest clinical utility is to monitor disease progression and prognosis once cancer has been diagnosed[43-47].
For detection of disease recurrence, genomic signatures have been most successful, e.g., MammaPrint, a 70-gene panel, has been approved by the US FDA as an in vitro diagnostic platform for breast cancer[48,49]. The clinical performance of platforms based on gene transcript signatures is still being evaluated for detection of recurrence for CRC but these appear to hold better promise as a stratification tool for Stage II or III CRC patients to determine those who are most likely to benefit from chemotherapy[10,12,14,50,51]. ColoGuideEx, a 13-gene classifier that appears more promising for stratification of Stage II patients and ColoGuidePro, which utilises the expression of 7 genes to predict prognosis of Stage III patients, are still in the research phase[10,51]. OncotypeDx, available commercially but as yet not assessed for clinical utility, is a 7-gene classifier developed from analysis of paraffin embedded CRC tissue[50] and ColoPrint, a test based on an 18-gene classifier in fresh frozen tissue, is currently recruiting patients for a Stage III clinical trial[12,14].
Identification of novel biomarkers requires knowledge of disease heterogeneity and pathophysiology and basic research is initially required to determine if specific biomolecules are differentially expressed between disease and non-disease tissues/biofluids. The ready availability of sequencing and array technologies (e.g., for DNA and RNA) and proteomic platforms enables many potential biomarker candidates to be identified using small numbers of samples and/or patients. Accordingly, once potential biomarkers are identified, robust validation studies on independent cohorts need to be performed to ensure only relevant biomarkers are carried forward into larger and more extensive case controlled studies using well-characterised cohorts. At this stage of the pipeline, major challenges remain where many factors need to be considered to determine the likely clinical success of candidate biomarkers including analytical variables, biomarker and biological variables and cohort composition (Table 1). It has been recognised that bias can be easily introduced in these early stages of the pipeline that may overestimate the likely performance of the biomarker being investigated[52]. Other factors to consider include invasiveness of the test, privacy, patient compliance and cost.
Table 1 Factors that can affect the outcome of biomarker studies.
Analytical variables
Use of standard operating procedures for sample collection and processing
Sample storage conditions (e.g., liquid nitrogen, -80 °C, aliquot size)
Assay performance and reproducibility
Biomarker/biological variables
Biomarker stability (e.g., over time, under different storage conditions)
Diurnal variation, fasting vs non-fasting
Comorbidities, medications, diet
Variability within a normal population
Cohort composition
Number of patients
Inclusion/exclusion criteria for controls and patient selection
Cohort balancing (e.g., age, gender matching)
In this review, we provide examples from initial pilot and case-controlled studies we have conducted as part of our efforts to identify novel blood-based protein biomarkers for CRC diagnosis. Our primary objective is to define a panel of protein biomarkers in blood, with better specificity and selectivity than the current FOBT, that can be used in a non-invasive test to diagnose early stage CRC. Additionally, the number of unnecessary colonoscopies currently being performed due to false positive results would be greatly reduced. We will use data for two potential protein biomarkers for CRC [insulin-like growth factor binding protein 2 (IGFBP2) and matrix metalloproteinase 9 (MMP9)] to demonstrate the potential impact of experimental, analytical and biological variables on the interpretation of biomarker results.
BIOMARKER STABILITY UNDER DIFFERENT STORAGE CONDITIONS
Sample collection, processing and storage of clinical samples have been identified as a potential source of bias that can confound the results of biomarker studies[53-56]. Although it is impossible to control for all variables in these procedures, standard operating procedures are absolutely essential to standardise sample collection and processing[55]. As part of our studies we have implemented stringent standard operating procedures for sample collection, processing and storage[57,58], based on the Human Proteome Organisation and Early Detection Research Network guidelines[54,55]. In many cases, decisions regarding storage conditions, however, are usually based on practical considerations such as cost, type of collection (i.e., retrospective or prospective collection), number of patient samples and laboratory facilities available. For biomarker studies, patient samples are typically collected and stored for a period of time (months or years) prior to analysis. In addition to collection and handling procedures, possible degradation of biomarkers over time due to factors such as storage conditions, aliquot size, or freeze/thaw cycles need to be considered. This is particularly important when measuring proteins that are present at low abundance in biological fluids and to ensure that experimental artefacts are not erroneously reported as specific to the disease[59]. Despite the general awareness of the potential impact of these confounders, there are few case-controlled protein biomarker studies reported in the literature that include assessment of these factors. Although necessary to ensure that the integrity of the protein is maintained, these studies are difficult to perform due to resource limitations and because each protein must be assessed independently due to the unique physiochemical properties of each protein that will govern its interactions with other biomolecules or surfaces, and affect its stability in biological matrices.
As part of our procedures, we determined the most suitable sample matrix for each biomarker (i.e., serum or plasma) based on the literature, manufacturers recommendations and our own preliminary investigations. We also assessed the stability of the biomarkers over an 18 mo period when stored in either liquid nitrogen or at -80 °C. Data for MMP9 and IGFBP2 are shown as exemplars (Figure 1). Protein levels in clinical samples were quantified using commercially available enzyme linked immunosorbent assay (ELISA) kits or reagents according to the manufacturers’ instructions. IGFBP2 was measured using ELISA kits from DSL Inc. (Texas, United States) or Mediagnost (Kiel, Germany). MMP9 was measured using ELISA kits purchased from Quantikine (R&D Systems, Minneapolis, United States). The Prism software package (version 5.04, Graphpad Software Inc., San Diego, United States) was used for statistical analysis.
Figure 1 Stability of insulin-like growth factor binding protein 2 and matrix metalloproteinase 9.
A: Standard curves for insulin-like growth factor binding protein 2 (IGFBP2) and matrix metalloproteinase 9 (MMP9) over an 18 mo period indicates that the assays were stable over time; B: IGFBP2 and MMP9 stability after storage for 18 mo in liquid nitrogen and at -80 °C (n = 10 patients); C: Stability of IGFBP2 and MMP9 following three freeze/thaw cycles. All data are represented as average ± standard deviation. F/T: Freeze/thaw cycles. aP < 0.05 when compared to samples measured immediately.
Figure 1 shows the stability of IGFBP2 and MMP9 (n = 10 patients) following 18 months storage at both -80 °C and in liquid nitrogen and the effect of multiple freeze/thaw cycles (n = 3). The assays themselves proved remarkably stable over this time period (Figure 1A). The concentration of IGFBP2 in serum samples was found to be stable over 18 mo, regardless of the storage conditions used (Figure 1B). The concentration of MMP9, however, decreased significantly when stored in liquid nitrogen, both overnight (13% ± 2%) and after 18 months (16% ± 3%) when compared to MMP9 measured immediately (P < 0.05) (Figure 1B). Both markers were found to be stable over multiple freeze/thaw cycles (Figure 1C). This suggests that for accurate measurement of MMP9, samples should be stored at -80 °C as storage in liquid nitrogen, both short and long term, resulted in protein losses.
We also determined the stability of markers in plasma or serum when using alternative collection tubes, to investigate possible losses by non-specific binding. Figure 2 shows the effect of these variables on IGFBP2 measurements. These data showed that IGFBP2 is best measured in serum following collection into serum separator tubes as this resulted in consistent measurements and also provided the highest yields for this biomarker. When measured in plasma with collection into either EDTA or citrate, IGFBP2 levels were significantly lower. Furthermore, this trend was consistent when IGFBP2 was measured immediately, or following overnight storage at 4 °C and -80 °C (Figure 2).
Figure 2 Comparison of insulin-like growth factor binding protein 2 measurements after collection into serum separator tubes, plasma/EDTA tubes and plasma/citrate tubes.
Data are represented as average ± SE of the mean for triplicate measurements. aP < 0.05; bP < 0.01.
Whilst actual clinical measurements are typically made on fresh samples soon after collection, biomarker stability under different sample collection and storage conditions is becoming increasingly important as large multi-site and/or multi-institutional specimen biobanks are established as a resource for the scientific community for discovery and evaluation of biomarkers[60,61]. These biobanks have been established with the intention of providing very large numbers of biospecimens (from > 100000 participants) which have been collected under stringent standard operating protocols and that are well-characterised in terms of clinical data and patient history with the potential for obtaining follow-up information for prospective studies[60,61]. The primary rationale is that the performance of biomarkers identified by different research groups can be directly compared using a standard reference set to eliminate variability associated with sample collection, handling and storage procedures and to facilitate clinical and translational research. Although these resources are clearly valuable, researchers must also use caution when accessing these samples. For example, based on our initial investigations, analysis of IGFBP2 in serum is preferred while degradation of MMP9 following short or long term storage in liquid nitrogen indicates that sourcing samples from biobanks such as the European Prospective Investigation into Cancer and Nutrition Biobank for further validation studies might be less appropriate as these blood samples (plasma and serum) are stored in liquid nitrogen[61].
COHORT COMPOSITION AND THE “CONTROL” POPULATION
Biomarker studies are often case controlled studies that compare the concentrations of an analyte(s) in non-diseased (i.e., normal or control) vs diseased populations. Clearly the results must be reproducible across independent cohorts. Also of importance are age/gender balance, and an accurate representation and understanding of what comprises the normal or control population for the disease being studied. It is recognised that cohort selection, in both control and disease cohorts, is a potential source of bias that can invalidate results of biomarker studies[52,62-64]. In many cases the choice of the control population is obvious. For example, to investigate biomarkers for breast cancer, the control cohort should be predominantly female, for prostate cancer the control cohort should be male, and when studying childhood diseases, the control cohort should consist of children of the appropriate age range. However, Ransohoff and Gourlay[64] have highlighted numerous examples in the literature where inappropriate selection of patients in the control cohort resulted in identification of biomarkers that were incorrectly associated with the disease conditions. In our own studies on CRC biomarkers, our target control population consists of males and females over the age of 50 years with no previous history of cancer. Additionally, we are also aiming to recruit a control cohort of people that have undergone colonoscopy and who do not have adenomas or colorectal polyps. This is consistent with the clinical distribution of sporadic disease where men and women > 50 years of age represent approximately 80% of all CRC diagnoses[5]. However, this group of aging patients will frequently be taking a number of medications and may have other underlying medical conditions. Indeed, it could be argued that a better control group would be younger patients where CRC itself is uncommon. Longitudinal studies, which involves repeated observations on the same person over long periods of time have been proposed as a better approach as they eliminate confounding invariant personal factors which may be found in cross-sectional studies[4,65]. The Aspirin in Reducing Events in the Elderly study, in which samples from 19000 healthy participants, both males and females, aged 65 years or older are being collected and followed for an average of 5 years may provide an invaluable resource for such studies[66].
An example of difficulties in assigning the correct control levels is shown in Figure 3, where variations between data for IGFBP2 levels in two independent control cohorts that were recruited from different sources was apparent. Cohort 1 (n = 52) consisted of two groups: staff, relatives and visitors of patients attending pre-admission clinical centres (n = 40) and patients who were diagnosed with minor medical conditions (orthopaedic clinic or vascular clinic, n = 12) and who did not have a previous history of gastrointestinal disease or cancer. For cohort 2 (n = 50), volunteers were blood donors recruited from Red Cross Blood Donation Centres. Each cohort was balanced for age and gender. Although both cohorts could be considered as representative of the normal population, the median IGFBP2 concentration and the concentration range differed significantly between these two control cohorts (348 ng/mL vs 491 ng/mL in cohort 1 and cohort 2, respectively, P < 0.002). This difference could not be ascribed to the 12 patients with medical conditions (P > 0.05 between patients and staff/visitors) and this result was not reproduced in a smaller independent study we conducted comparing volunteers recruited from the Red Cross Blood Donation Centres (n = 25) and patients from pre-admission clinical centres (n = 27, P > 0.05, Figure 3B). Furthermore, when we compared cohort 1 and 2 with the CRC group (n = 55), a significant difference in IGFBP2 expression was found with cohort 1 only (P < 0.05).
Figure 3 Insulin-like growth factor binding protein 2 measured in different control cohorts and compared to the colorectal cancer patient group.
A: Insulin-like growth factor binding protein 2 (IGFBP2) levels in the sera of patients from two different control cohorts and in a colorectal cancer cohort; B: IGFBP2 levels in the sera of control patients recruited from pre-admission clinics (n = 27) and the Red Cross Blood Donation Centre (n = 25). CRC: Colorectal cancer. aP < 0.05, bP < 0.01 between the median values.
Factors such as time of day sampling (i.e., diurnal variation), fasting vs non-fasting states, comorbities, medications, supplements, hormones, sampling methods and storage have also been identified as factors that can potentially affect biomarker concentrations. For example, there is evidence to indicate that IGFBP2 levels are not likely to be affected by fasting[67], but might be affected by diet[68] and may be a marker for metabolic syndrome[69]. Additionally, in a study investigating biomarkers for ovarian cancer, Thorpe et al[70] identified that prolactin levels were significantly affected by blood collection procedures where levels were elevated in patients who had blood collected at time of surgery vs those who did not (i.e., collected up to 39 d prior to surgery). After adjusting for the collection procedure, they determined that any difference in prolactin levels could be attributed entirely to blood sampling processes and not to malignancy. Similarly, Lomholt et al[71] identified that the temperature at which samples were handled and cellular contamination of plasma samples influenced TIMP1 levels in plasma. Although we were not able to definitively determine the source of variation in our control cohort, our data highlights the importance of using multiple control groups to identify possible factors that can affect biomarker measurements leading to potential erroneous results.
ANALYTICAL VARIABLES ASSOCIATED WITH COMMERCIALLY AVAILABLE REAGENTS
For our initial analyses, commercially available ELISA kits were sourced, and where possible, identical batch lots from the same manufacturer were used. Figure 4 demonstrates a potential problem associated with reliance on commercial kits for long term studies. ELISA kits for IGFBP2 were purchased from DSL Inc. until the manufacturer discontinued supply. Accordingly, kits were sourced from an alternate vendor (Mediagnost). To determine the potential impact of a change in supplier on the reproducibility of our preliminary results, we conducted a small study comparing the results obtained from identical patient samples (n = 8) and a quality control sample that was included in each assay (QC) using the two alternative kits (Figure 4). The QC sample consisted of pooled normal samples (n = 10). For six of these patient samples, there was a significant difference (DSL Inc. vs Mediagnost, P < 0.05) in the measurements obtained using the two different kits (Figure 4B). Although the correlation between the measured values reached 0.62, this was not significant (Spearman correlation, P > 0.05; Figure 4C). It should be noted, however, that the sample size was small (n = 9).
Figure 4 Insulin-like growth factor binding protein 2 measured in patient sera using enzyme-linked immunosorbent assay kits sourced from two different manufacturers.
A: Standard curves for insulin-like growth factor binding protein 2 (IGFBP2) enzyme-linked immunosorbent assays sourced from DSL Inc (Texas, United States) and Mediagnost (Kiel, Germany); B: Comparison of IGFBP2 levels in three colorectal cancer patients (P1-P3), five control patients (N1-N5) and a quality control sample consisting of 10 pooled samples; C: Correlation of measured values of IGFBP2 between the two different manufacturers. The correlation coefficient was 0.62 (Spearman correlation, P > 0.05). Data are represented as average ± standard deviation of three replicate measurements. aP < 0.05.
Studies by Basuyau et al[72], Hauffa et al[73], and Rymer et al[74] have demonstrated the potential impact of technical problems, such as that described above for IGFBP2, on the clinical utility of biomarkers. These authors highlight how discrepancies in the values obtained for clinical measurement of prostate specific antigen, CEA, and IGF1/IGFBP3 using different immunoassay methodologies can lead to misdiagnosis of patients[73,74]. Although the source(s) of the discrepancies could not be definitively determined, differences in calibration curves, calibrator standard used (“gold standard”) and antibody immunoreactivity were highlighted as potential causes. To understand the impact of changes in methodology, Basuyau et al[72] recommended that “known” patient samples be re-evaluated and Hauffa et al[73] discussed the importance of a common and well characterised “gold standard” for assay calibration between diagnostic laboratories.
To overcome technical variation due to unforeseen problems such as reproducibility of results between commercially available kits, we have established a pipeline to generate reagents (recombinant protein antigens and renewable high-affinity monoclonal antibodies[75]) for use in multiplexed sandwich ELISA assays for panels of biomarkers that appear to be promising in the initial preliminary phases of our studies. Due to the heterogeneous nature of CRC, and a significant overlap of cancer with other non-malignant pathologies, it is now recognized that the paradigm of a single biomarker to detect an individual cancer may not be realistic, and that panels of biomarkers, which reflect different aspects of the cancer biology, will be required[43,76]. Multiplexed analyses (e.g., Luminex, http://www.luminex.com) offer significant advantages in terms of overall assay time, reagent costs and, most importantly, reduced sample requirements[77]. To generate panels of monoclonal antibodies in mice or rats for ELISA development, soluble proteins are expressed in mammalian host cell lines to ensure the corresponding post-translational modifications found in endogenous proteins are present. The recombinant target proteins are rigorously analysed using tools such as mass spectrometry and amino acid analysis for protein sequence verification. The monoclonal antibodies generated are validated by ELISA, microarray Western blotting and surface plasmon resonance based technology [e.g., Biacore (http://www.biacore.com), Proteon (http://www.bio-rad.com)] for antibody/antigen selectivity, binding kinetics and epitope binding. Once established, the immunoassays are compared and assessed against the commercial kits that were used as part of the original analysis. Figure 5 shows the comparison between the calibration curves derived from commercial kits and from our own reagents for two of our markers. It can be seen that, in both cases, the assay sensitivity and standard curves generated are similar.
Figure 5 Comparison of calibration curves between commercially available enzyme-linked immunosorbent assay kits and reagents developed in-house for two protein biomarkers.
Data are represented as average ± SE of the mean for two replicate measurements.
CONCLUSION
The identification of panels of sensitive and specific blood-based protein markers for the early diagnosis and surveillance of CRC is recognised as being fundamental to improve survival for this disease. It is widely accepted that a panel of biomarkers that reflects the heterogeneity of the disease will be more successful at diagnosing CRC than a single biomarker. This is supported by the inability of the currently tested biomarkers to diagnose CRC with the sensitivity and specificity required for routine clinical use. Studies involving analyses of multiple biomarkers, such as that undertaken by us and other research groups worldwide, require consideration of many potential confounding issues, some of which unfortunately are impossible or difficult to control for. Of equal importance, and not discussed here, is the need for robust statistical analysis of the data. Implementation of strategies which can overcome and account for potentially confounding variables is essential to ensure robust verification and validation of potential biomarkers and their successful evaluation in large and meaningful clinical cohorts that are representative of the target population, ultimately with successful translation into the clinic.
ACKNOWLEDGMENTS
The authors would like to thank the Victorian Cancer Biobank and the Australian Red Cross for collection of samples.
Food, nutrition, physical activity, and the prevention of cancer: a global perspective.
Washington, DC: AICR 2007; .
[PubMed] [DOI][Cited in This Article: ]
Parra-Blanco A, Gimeno-García AZ, Quintero E, Nicolás D, Moreno SG, Jiménez A, Hernández-Guerra M, Carrillo-Palau M, Eishi Y, López-Bastida J. Diagnostic accuracy of immunochemical versus guaiac faecal occult blood tests for colorectal cancer screening.J Gastroenterol. 2010;45:703-712.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 83][Cited by in F6Publishing: 94][Article Influence: 6.7][Reference Citation Analysis (0)]
Maak M, Simon I, Nitsche U, Roepman P, Snel M, Glas AM, Schuster T, Keller G, Zeestraten E, Goossens I. Independent validation of a prognostic genomic signature (ColoPrint) for patients with stage II colon cancer.Ann Surg. 2013;257:1053-1058.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 84][Cited by in F6Publishing: 89][Article Influence: 8.1][Reference Citation Analysis (0)]
Bünger S, Haug U, Kelly FM, Klempt-Giessing K, Cartwright A, Posorski N, Dibbelt L, Fitzgerald SP, Bruch HP, Roblick UJ. Toward standardized high-throughput serum diagnostics: multiplex-protein array identifies IL-8 and VEGF as serum markers for colon cancer.J Biomol Screen. 2011;16:1018-1026.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 34][Cited by in F6Publishing: 41][Article Influence: 3.2][Reference Citation Analysis (0)]
Ritchie SA, Ahiahonu PW, Jayasinghe D, Heath D, Liu J, Lu Y, Jin W, Kavianpour A, Yamazaki Y, Khan AM. Reduced levels of hydroxylated, polyunsaturated ultra long-chain fatty acids in the serum of colorectal cancer patients: implications for early screening and detection.BMC Med. 2010;8:13.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 109][Cited by in F6Publishing: 111][Article Influence: 7.9][Reference Citation Analysis (0)]
Tóth K, Sipos F, Kalmár A, Patai AV, Wichmann B, Stoehr R, Golcher H, Schellerer V, Tulassay Z, Molnár B. Detection of methylated SEPT9 in plasma is a reliable screening method for both left- and right-sided colon cancers.PLoS One. 2012;7:e46000.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 134][Cited by in F6Publishing: 129][Article Influence: 10.8][Reference Citation Analysis (0)]
Church TR, Wandell M, Lofton-Day C, Mongin SJ, Burger M, Payne SR, Castaños-Vélez E, Blumenstein BA, Rösch T, Osborn N. Prospective evaluation of methylated SEPT9 in plasma for detection of asymptomatic colorectal cancer.Gut. 2014;63:317-325.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 486][Cited by in F6Publishing: 538][Article Influence: 53.8][Reference Citation Analysis (0)]
Hardt PD, Toepler M, Ngoumou B, Rupp J, Kloer HU. Measurement of fecal pyruvate kinase type M2 (tumor M2-PK) concentrations in patients with gastric cancer, colorectal cancer, colorectal adenomas and controls.Anticancer Res. 2003;23:851-853.
[PubMed] [DOI][Cited in This Article: ]
Nielsen HJ, Brünner N, Frederiksen C, Lomholt AF, King D, Jørgensen LN, Olsen J, Rahr HB, Thygesen K, Hoyer U. Plasma tissue inhibitor of metalloproteinases-1 (TIMP-1): a novel biological marker in the detection of primary colorectal cancer. Protocol outlines of the Danish-Australian endoscopy study group on colorectal cancer detection.Scand J Gastroenterol. 2008;43:242-248.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 30][Cited by in F6Publishing: 32][Article Influence: 2.0][Reference Citation Analysis (0)]
Holten-Andersen MN, Christensen IJ, Nielsen HJ, Stephens RW, Jensen V, Nielsen OH, Sørensen S, Overgaard J, Lilja H, Harris A. Total levels of tissue inhibitor of metalloproteinases 1 in plasma yield high diagnostic sensitivity and specificity in patients with colon cancer.Clin Cancer Res. 2002;8:156-164.
[PubMed] [DOI][Cited in This Article: ]
Holten-Andersen MN, Stephens RW, Nielsen HJ, Murphy G, Christensen IJ, Stetler-Stevenson W, Brünner N. High preoperative plasma tissue inhibitor of metalloproteinase-1 levels are associated with short survival of patients with colorectal cancer.Clin Cancer Res. 2000;6:4292-4299.
[PubMed] [DOI][Cited in This Article: ]
Pellegrini P, Contasta I, Berghella AM, Gargano E, Mammarella C, Adorno D. Simultaneous measurement of soluble carcinoembryonic antigen and the tissue inhibitor of metalloproteinase TIMP1 serum levels for use as markers of pre-invasive to invasive colorectal cancer.Cancer Immunol Immunother. 2000;49:388-394.
[PubMed] [DOI][Cited in This Article: ]
Kim HJ, Yu MH, Kim H, Byun J, Lee C. Noninvasive molecular biomarkers for the detection of colorectal cancer.BMB Rep. 2008;41:685-692.
[PubMed] [DOI][Cited in This Article: ]
Duffy MJ, van Dalen A, Haglund C, Hansson L, Klapdor R, Lamerz R, Nilsson O, Sturgeon C, Topolcan O. Clinical utility of biochemical markers in colorectal cancer: European Group on Tumour Markers (EGTM) guidelines.Eur J Cancer. 2003;39:718-727.
[PubMed] [DOI][Cited in This Article: ]
Wang WS, Lin JK, Chiou TJ, Liu JH, Fan FS, Yen CC, Lin TC, Jiang JK, Yang SH, Wang HS. Preoperative carcinoembryonic antigen level as an independent prognostic factor in colorectal cancer: Taiwan experience.Jpn J Clin Oncol. 2000;30:12-16.
[PubMed] [DOI][Cited in This Article: ]
Reiter W, Stieber P, Reuter C, Nagel D, Lau-Werner U, Lamerz R. Multivariate analysis of the prognostic value of CEA and CA 19-9 serum levels in colorectal cancer.Anticancer Res. 2000;20:5195-5198.
[PubMed] [DOI][Cited in This Article: ]
O’Connell MJ, Lavery I, Yothers G, Paik S, Clark-Langone KM, Lopatin M, Watson D, Baehner FL, Shak S, Baker J. Relationship between tumor gene expression and recurrence in four independent studies of patients with stage II/III colon cancer treated with surgery alone or surgery plus adjuvant fluorouracil plus leucovorin.J Clin Oncol. 2010;28:3937-3944.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 220][Cited by in F6Publishing: 238][Article Influence: 17.0][Reference Citation Analysis (0)]
Olson J, Whitney DH, Durkee K, Shuber AP. DNA stabilization is critical for maximizing performance of fecal DNA-based colorectal cancer tests.Diagn Mol Pathol. 2005;14:183-191.
[PubMed] [DOI][Cited in This Article: ]
Rai AJ, Gelfand CA, Haywood BC, Warunek DJ, Yi J, Schuchard MD, Mehigh RJ, Cockrill SL, Scott GB, Tammen H. HUPO Plasma Proteome Project specimen collection and handling: towards the standardization of parameters for plasma proteome samples.Proteomics. 2005;5:3262-3277.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 432][Cited by in F6Publishing: 440][Article Influence: 23.2][Reference Citation Analysis (0)]
Tuck MK, Chan DW, Chia D, Godwin AK, Grizzle WE, Krueger KE, Rom W, Sanda M, Sorbara L, Stass S. Standard operating procedures for serum and plasma collection: early detection research network consensus statement standard operating procedure integration working group.J Proteome Res. 2009;8:113-117.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 465][Cited by in F6Publishing: 506][Article Influence: 33.7][Reference Citation Analysis (0)]
Gast MC, van Gils CH, Wessels LF, Harris N, Bonfrer JM, Rutgers EJ, Schellens JH, Beijnen JH. Influence of sample storage duration on serum protein profiles assessed by surface-enhanced laser desorption/ionisation time-of-flight mass spectrometry (SELDI-TOF MS).Clin Chem Lab Med. 2009;47:694-705.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 20][Cited by in F6Publishing: 27][Article Influence: 1.8][Reference Citation Analysis (0)]
Feng Z, Kagan J, Pepe M, Thornquist M, Ann Rinaudo J, Dahlgren J, Krueger K, Zheng Y, Patriotis C, Huang Y. The Early Detection Research Network’s Specimen reference sets: paving the way for rapid evaluation of potential biomarkers.Clin Chem. 2013;59:68-74.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 39][Cited by in F6Publishing: 43][Article Influence: 3.6][Reference Citation Analysis (0)]
Nelson M, Reid C, Beilin L, Donnan G, Johnston C, Krum H, Storey E, Tonkin A, McNeil J. Rationale for a trial of low-dose aspirin for the primary prevention of major adverse cardiovascular events and vascular dementia in the elderly: Aspirin in Reducing Events in the Elderly (ASPREE).Drugs Aging. 2003;20:897-903.
[PubMed] [DOI][Cited in This Article: ]
Clemmons DR, Snyder DK, Busby WH. Variables controlling the secretion of insulin-like growth factor binding protein-2 in normal human subjects.J Clin Endocrinol Metab. 1991;73:727-733.
[PubMed] [DOI][Cited in This Article: ]
Young NJ, Metcalfe C, Gunnell D, Rowlands MA, Lane JA, Gilbert R, Avery KN, Davis M, Neal DE, Hamdy FC. A cross-sectional analysis of the association between diet and insulin-like growth factor (IGF)-I, IGF-II, IGF-binding protein (IGFBP)-2, and IGFBP-3 in men in the United Kingdom.Cancer Causes Control. 2012;23:907-917.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 26][Cited by in F6Publishing: 26][Article Influence: 2.2][Reference Citation Analysis (0)]
Hauffa BP, Lehmann N, Bettendorf M, Mehls O, Dörr HG, Stahnke N, Steinkamp H, Said E, Ranke MB. Central laboratory reassessment of IGF-I, IGF-binding protein-3, and GH serum concentrations measured at local treatment centers in growth-impaired children: implications for the agreement between outpatient screening and the results of somatotropic axis functional testing.Eur J Endocrinol. 2007;157:597-603.
[PubMed] [DOI][Cited in This Article: ][Cited by in Crossref: 4][Cited by in F6Publishing: 7][Article Influence: 0.4][Reference Citation Analysis (0)]
Rymer JC, Sabatier R, Daver A, Bourleaud J, Assicot M, Bremond J, Rapin J, Salhi SL, Thirion B, Vassault A. A new approach for clinical biological assay comparison and standardization: application of principal component analysis to a multicenter study of twenty-one carcinoembryonic antigen immunoassay kits.Clin Chem. 1999;45:869-881.
[PubMed] [DOI][Cited in This Article: ]