Systematic Reviews Open Access
Copyright ©The Author(s) 2021. Published by Baishideng Publishing Group Inc. All rights reserved.
World J Psychiatr. Sep 19, 2021; 11(9): 635-658
Published online Sep 19, 2021. doi: 10.5498/wjp.v11.i9.635
Thinking about worry: A systematic review and meta-analysis on the assessment of metacognitions in children and adolescents
Laura M Köcher, Hanna Christiansen, Department of Psychology, University of Marburg, Marburg 35037, Germany
Kai Schneider, Department of Clinical Child and Adolescent Psychology, University of Landau, Landau 76829, Germany
ORCID number: Laura M Köcher (0000-0002-1546-038X); Kai Schneider (0000-0002-9450-7843); Hanna Christiansen (0000-0002-8104-0711).
Author contributions: Köcher LM and Christiansen H designed the research; Köcher LM performed the research; Köcher LM and Schneider K analyzed the data; Köcher LM wrote the paper; Christiansen H and Schneider K supervised the paper; All authors read and approved the final manuscript.
Conflict-of-interest statement: None of the authors has any conflict of interest to declare.
PRISMA 2009 Checklist statement: The authors have read the PRISMA 2009 Checklist, and the manuscript was prepared and revised according to the PRISMA 2009 Checklist.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/Licenses/by-nc/4.0/
Corresponding author: Laura M Köcher, MSc, Research Associate, Department of Psychology, University of Marburg, Frankfurter Straße 35, Marburg 35037, Germany. laura.koecher@uni-marburg.de
Received: February 25, 2021
Peer-review started: February 25, 2021
First decision: April 21, 2021
Revised: May 4, 2021
Accepted: July 27, 2021
Article in press: July 27, 2021
Published online: September 19, 2021
Processing time: 202 Days and 1.8 Hours

Abstract
BACKGROUND

The metacognitive model of generalized anxiety disorder identifies three forms of metacognition: Positive metacognitive beliefs about worry (POS), negative metacognitive beliefs about worry (NEG), and meta-worry. Though this model was originally developed relying on adult samples, it has since been applied to children and youth in different studies, and results mostly support its validity for this group. As the roles of POS, meta-worry, and age-effects do not appear to be fully clarified for children and adolescents yet, an integration of studies on children and adolescents and the metacognitive model is both timely and worthwhile.

AIM

To summarize the current research on relationships, age-effects, and measurements for POS, NEG, and meta-worry in childhood and youth.

METHODS

We carried out a literature search in the electronic databases PsycINFO, PubMed, PSYNDEX, and ERIC in 2017 and updated in 2020. Empirical research in German or English language on metacognition was included with child and adolescent samples diagnosed with anxiety disorders or healthy controls if POS, NEG, or meta-worry were measured. Studies were included for meta-analysis if they reported correlations between these metacognitions and anxiety or worry. Consensus rating for eligibility was done for 20.89% of full-texts with 90.32% agreement. Risk of bias was assessed with the appraisal tool for cross-sectional studies and consensus rating of appraisal tool for cross-sectional studies for 20.83% of included studies attaining agreement of intraclass correlation = 0.898. Overall, correlations between metacognitions, anxiety and worry were calculated with RevMan 5.4.1, assuming random-effects models. Meta-regressions with mean age as the covariate were performed via the online tool MetaMar 2.7.0. PROSPERO-ID: CRD42018078852.

RESULTS

Overall, k = 763 records and k = 78 additional records were identified. Of those, k = 48 studies with 12839 participants were included and of those, k = 24 studies were included for meta-analysis. Most studies showed consistent NEG correlations with worry and anxiety, as well as higher values for clinical than for non-clinical samples. POS findings were less consistent. Meta-analysis revealed large effects for NEG correlating with worry and anxiety, small to medium effects for POS correlating with worry and anxiety, as well as small to medium effects for POS correlating with NEG. Meta-regressions did not reveal mean age as a significant covariate. Meta-worry was assessed in only one study. We identified eight questionnaires and one interview-format that assess metacognition about worry in children and adolescents.

CONCLUSION

POS and NEG are measurable from the age of seven upwards and correlate with anxiety and worry without influences by age. Meta-worry requires further investigation.

Key Words: Metacognition; Anxiety; Child; Adolescent; Measures; Meta-analysis

Core Tip: Systematic review and meta-analysis showed that positive metacognitive beliefs about worry and negative metacognitive beliefs about worry correlate with worry and anxiety, as claimed in the metacognitive model of generalized anxiety disorder. Studies tended not to report significant correlations between age and positive metacognitive beliefs about worry or negative metacognitive beliefs about worry. Mean age was not a significant covariate in meta-regressions. No conclusions about meta-worry’s influence can be drawn. We need an adequate measurement of meta-worry, and measurements applying to young children should undergo further investigation. Studies showed moderate to large heterogeneity, and the power of meta-regression might have been low. As mostly cross-sectional data were collected, no causal conclusions can be drawn.



INTRODUCTION

Anxiety disorders in children and adolescents reveal a 6.5% prevalence, making them the most prevalent mental disorder in this age group worldwide[1]. They are associated with various negative effects, e.g., impaired school performance, sleep and social functions, increased risk of comorbidities (such as depression or other anxiety disorders), and persistence into adulthood[2-5]. A key feature of anxiety is worry. Worries are understood as repetitive, chained thoughts about potentially negative future events, and they are fear-related[6,7]. These thoughts are common, occurring in 60.1% of children and adolescents[8]. Almost every second preschooler has worries, and even more children worry as they grow older[9]. Worry is associated with anxiety symptoms in community samples as well as in samples consisting of children with anxiety disorders[10,11]. Children with anxiety disorders suffer more intense worries than healthy children[12]. The frequency of worry itself, however, does not seem to be problematic. However, worries seem to become pathological when they are experienced as intense and uncontrollable[13]. Excessive worry is a core criterion of general anxiety disorder (GAD)[14], and domain-specific worries are a diagnostic criterion of separation anxiety disorder (SAD)[13]. When compared specifically, children with diagnosed anxiety disorders reveal significantly more self-reported worry than healthy children, and children with GAD scored higher on worry assessments than children suffering from other anxiety disorders[11]. Worry is thus a central feature of anxiety in childhood and youth.

In line with the importance of evaluating worries as intense and uncontrollable, both worry itself and "thinking about worry" play key roles in anxiety disorders. Such higher-level thinking is described as metacognition, a concept first defined by Flavell[15] as "knowledge and cognition about cognitive phenomena" (S. 906). Metacognitions are known to be involved in the development and maintenance of mental disorders such as depression and anxiety or obsessive-compulsive disorders (OCD)[16-20]. For pathological worries to develop, Wells[19-21] emphasizes three forms of metacognition that play decisive roles: Positive metacognitive beliefs about worry (POS), negative metacognitive beliefs about worry (NEG), and meta-worry. POS refer to the usefulness of various thoughts (e.g., "Worrying helps me to avoid problems in the future"[22]). NEG can be understood as trait-beliefs that a person generally holds about worries[21]. They include the appraisal of one’s own thoughts as uncontrollable and imply negative consequences of worries (e.g., "Worrying is dangerous for me"[22]). Meta-worry can be described as the state of worrying about worry[21]. Wells describes his assumptions about how these metacognitive constructs interact with each other and with worry, behavior, thought control strategies, and emotion in the metacognitive model of GAD[19-21].

The metacognitive model of GAD postulates that an intense, negative thought is what initially triggers worry. Worrying is then especially likely to become a coping strategy when someone tends to think about worry’s usefulness (POS). If general beliefs that worry is dangerous or uncontrollable (NEG) have been activated, one starts to worry about current worries (meta-worry). Meta-worry provokes emotions such as anxiety, which only exacerbates worry and meta-worry. Anxiety is misattributed as a consequence of the worries themselves, which in turn reinforces NEG. As this thought spiral continues, meta-worry triggers coping strategies such as reassurance, avoidance behavior, or substance abuse. As these dysfunctional attempts prevent the person from experiencing that worries are controllable and harmless, meta-worry and NEG about the danger of worries are reinforced. Meta-worry can also lead to thought-control strategies such as suppression, and if these fail, meta-worry and NEG will persist (for details and figural display of the metacognitive model of GAD see Wells[21]).

The metacognitive model has been investigated in children and adolescents in different studies. Esbjørn et al[23] showed that metacognitive processes, in addition to the effects of gender, age, and anxiety, account for 14% of the variance of worry and an additional 11% of the variance of anxiety in a healthy sample of children. In a second study, patients with GAD reported more POS and NEG than children with other anxiety disorders or healthy controls, and children with anxiety disorders reported more NEG than healthy controls[23]. Another study by Ellis and Hudson[24] also showed that adolescents with anxiety disorders described more POS and NEG than a control group. These findings support assumptions of the metacognitive model of GAD and support its validity in childhood and youth. However, there are also contradictory findings that question this validity. For example, some studies failed to detect any significant relationships between POS and worry or anxiety in children[25,26] or found no differences in either POS or NEG between clinical and non-clinical participants[27,28].

In addition, the question arises as to the age that these metacognitions about worry develop and whether they change with age. Ellis and Hudson[29] noted that few studies on the metacognitive model included children under 12 years of age. There have also been mixed results about the relationship with age, as some studies show correlations between metacognitions and age[24] while other studies do not[30]. When transferring adult models like the metacognitive model of GAD to children, the experience and cognitive skills of children must be taken into account[24]. Metacognitive skills are assumed to be gradually acquired[31]: At 3 years of age, children can name mental processes and distinguish them from the external environment[32,33]. From the age of four, children understand that thoughts can refer to non-real or non-present things[34]. Seven-year-old children know when, what, and at what frequency they themselves or others are thinking[33-35]. However, more recent results indicate that already 3- to 5-year-old children can demonstrate metacognitive knowledge when measured with an age-appropriate interview[36].

To evaluate the age at which children first think about their worries (i.e. metacognition about worry), an age-appropriate assessment is needed. Many studies use questionnaires to measure metacognition in children[23,24,27]. However, a recent review’s authors concluded that questionnaires for younger children yield mixed results for factor structure, internal consistency, and age-appropriateness, and they emphasize the need for further development and psychometric analysis of assessments for metacognition in childhood[37].

The present systematic review synthesizes the latest findings about metacognition on worry in children and adolescents. Current knowledge for POS, NEG, and meta-worry as well as their development is summarized, as are available assessments of POS, NEG, and meta-worry for children and adolescents. In so doing, we posed the questions below:

What evidence is there for positive relationships between POS, NEG, and meta-worry with each other and with worry and anxiety in children and adolescents?

At what age do children report POS, NEG, and meta-worry, and does age play any role in relationships with worry and anxiety?

Which methods are currently applicable to assess POS, NEG, and meta-worry in childhood and youth?

To answer these questions, we conducted a systematic review of the recent literature. We synthesized the tested relationships between POS, NEG, meta-worry with each other, worry, and anxiety in order to compare those results with the postulated relationships in the metacognitive model of GAD. For further validation, we compared non-clinical samples and clinical samples consisting of children and adolescents with anxiety disorders, as the latter are likely to exhibit more NEG and meta-worry according to the metacognitive model of GAD, while that does not necessarily apply to POS (compare Wells[21]). To assess potential age effects, we summarized results for age of onset and developmental patterns for POS, NEG, and meta-worry. Different methods of assessing POS, NEG, and meta-worry and reported reliability measures, their usage in age-ranges, and the numbers of studies are resumed.

Depending on the studies identified, we conducted additional meta-analysis based on effect sizes of POS, NEG, and meta-worry correlations with each other and with anxiety and worry. Whenever possible, we performed meta-regressions to analyze whether age is a significant covariate for these relationships.

MATERIALS AND METHODS
Literature search

This systematic review was registered with PROSPERO (International prospective register of systematic reviews, PROSPERO-ID: CRD42018078852, last update: January 26, 2021) and is based on the PRISMA Statement[38] and the PRISMA-P Statement[39]. The literature search was first run on September 24, 2017 and updated on February 6, 2020.

The search string "(children OR adolescents*) AND (meta cognition* OR metacognition* OR meta-cognitive belief* OR meta cognitive belief*) AND (anxiety OR worry OR phobia)" was used in the following databases: PsycINFO, PubMed, and PSYNDEX. In addition, available full-texts of the database ERIC were searched with the same search string. In the first search (2017), we set no limitations to obtain a preferably broad impression of the state of research. In the second search (2020), the period was limited to publication dates between 2017 and 2020. We identified additional studies through a backward search of reference lists by screening additive publications of research groups and, to include the gray literature, the screening of doctoral theses. After identifying records through the databases and additional searches, duplicates were removed. Afterwards, titles, key words, and abstracts in all records were screened by the first author. The full-text versions of the remaining records were analyzed for eligibility. Doctoral theses were only included if the data had not been published in a journal. In case of the latter, the publication was included and the doctoral thesis was excluded from analysis. The study selection process was conducted by one reviewer (Köcher LM). Additionally, 20.89% (k = 33) of the full-texts were independently rated for eligibility by another reviewer (Schneider K). Overall, 90.32% of the ratings were in agreement. In case of discrepancies, a third reviewer (Christiansen H) was consulted, and consensus was reached for the remaining 9.68% (k = 3) of records.

Study selection

Empirical studies reporting quantitative data were included in the systematic review, which fulfilled the following criteria: (1) Participants were 18 years of age or younger; (2) Non-clinical samples and/or clinical samples with anxiety disorders were investigated. We followed the classification for anxiety disorders in the fifth edition of the “Diagnostic and Statistical Manual of Mental Disorders” (DSM-5)[40], including the following diagnoses: GAD, SAD, social anxiety disorder (SoD), specific phobia, agoraphobia, and panic disorder; (3) POS, NEG, and/or meta-worry were assessed as an outcome variable; (4) The study was published in English or German language; and (5) The study had been published by February 6, 2020.

To be included in our meta-analysis, studies also had to fulfill these criteria: (6) Bivariate correlation coefficients for relationships between POS/NEG/meta-worry with each other/anxiety/worry were reported; and (7) Data were not reported in a study that had already been included in our meta-analysis.

Data extraction

The first author extracted the following information from the included studies: Author(s), year of publication, title, country, study design, sample size, study population (non-clinical and/or clinical, and related diagnoses), participants’ age range and/or mean age, gender distribution, measurement of POS/NEG/meta-worry and reliability, anxiety measurement, worry measurement, relationship of POS/NEG/meta-worry with each other/anxiety/worry/age, and group differences between clinical and non-clinical subgroups in POS/NEG/meta-worry.

The study characteristics coded for meta-analysis and meta-regression by the first author were: Effect sizes of correlations between POS/NEG/meta-worry with each other/anxiety/worry, sample size, and mean age. If studies reported correlational coefficients split for different subgroups such as male or female participants, or clinical or non-clinical participants, correlations were coded separately for subgroups and then combined to a single correlation according to the following procedure: Correlations were transformed into Fisher‘s z scores and weighted by subsample size, then the mean of both values was inversely z-transformed into product-moment-correlation coefficients. If a study reported a subsample’s data in a previous study that we had already included in the meta-analysis, only the other subsample’s data were coded for this study. For meta-regressions, studies were only included if they reported the mean age of their samples. If mean age was reported for split subgroups, values were coded for each of these subgroups and mean of the mean ages, weighted by subsample sizes, was calculated and used for meta-regression.

Risk of bias

To assess the risk of bias, each study was rated on the Appraisal tool for Cross-Sectional Studies (AXIS)[41] by one reviewer (Köcher LM). AXIS-scores range between 0 and 20 and were clustered in the categories high (0-6), moderate (7-13), and low risk of bias (14-20) for a global rating. Additionally, 20.83% of studies (k = 10) were rated by an independent reviewer in our working group. Our interrater agreement (intraclass correlation = 0.898) can be considered as good[42].

Statistical analysis

Statistical analysis was performed by the first author and reviewed by the third author at the Department of Psychology, Philipps University Marburg. Coded correlation coefficients were transformed into Fisher’s z scale for meta-analysis. For reports of summary correlations, all summary Fisher’s z were back-transformed into Pearson’s product-moment correlations. Cohen’s criteria[43] were used to interpret overall effect sizes. Random-effect models were used for analysis because of assumed heterogeneity in addition to sampling error. Calculations were computed using the computer program RevMan, version 5.4.1[44]. To show actual dispersion of overall effects, prediction intervals are reported in addition to CIs, as proposed by IntHout et al[45], and calculated based on the T2-estimate[46]. Heterogeneity was tested using Q-statistic and I2. Interpretations of I2 are based on benchmarks proposed by Higgins et al[47]. Results of each meta-analysis are graphically illustrated in forest plots. A set of meta-regressions was conducted to test whether mean age of the included studies moderated the analyzed correlations significantly. Other potential covariates such as sample type (clinical vs non-clinical) were not examined due to the low number of k = 1 study[25] included in the meta-analysis with a clinical sample only. Meta-regressions were run using the free online meta-analysis tool Meta-Mar, version 2.7.0[48].

RESULTS
Study selection

Figure 1 shows this review’s selection process divided into the first search in 2017 and the search updated in 2020. Overall, k = 763 records were identified through database searching. A total of k = 78 additional records were identified through other sources. Initially, a total of k = 110 duplicates were removed. Next, the first author screened the titles and abstracts of the identified studies. k = 158 records remained in the selection process after screening. Overall, k = 46 records fulfilled our inclusion criteria. Of those, each of two records reported two studies[23,49], resulting in k = 48 studies overall included in this systematic literature review. In two cases, working groups analyzed the same datasets in two independently published records[27,28,50,51]. For quantitative synthesis, k = 24 studies fulfilled our inclusion criteria and were included in meta-analysis.

Figure 1
Figure 1 Adapted PRISMA Flowchart for study selection in this systematic review and meta-analysis.
Characteristics of studies included in this systematic review

An overview of the included studies and study characteristics is found in Table 1. They contain k = 47 published studies carried out in Australia, Canada, Denmark, Germany, Italy, Iran, Turkey, the United Kingdom or Ireland, and United States between 2003 and 2020. The k = 1 remaining study is characterized as gray literature and was submitted in 2014 to qualify for a doctorate degree at a German university.

Table 1 Overview of studies included in the systematic review.
Ref.
Sample
n
Female (%)
Age in year (range), mean ± SD
Risk of bias
POS/NEG/meta-worry
Worry
Anxiety
Babaei et al[55]NC200NANAMod (9)MCQ-30-GHQ-scale
Bacow et al[27]Total/C1,2,3,4/NC98/78/20NA/63%/65%(7-17) NA/(NA) 11.9 ± 3.1/(NA) 12.4 ± 3.0Low (14)MCQ-CADIS-C-sectionADIS-C/P
Bacow et al[28]Total/C1,2,3,4/NC98/78/20NA/63%/65%(7-17) NA/(NA) 11.9 ± 3.1/(NA) 12.4 ± 3.0Low (14)MCQ-CPSWQ-C; ADIS-C-sectionADIS-C/P
Benedetto et al[64]NC18453%(11-13) 12.0 ± 0.9Mod (13)MCQ-CPSWQ-CRCMAS-2
Benedetto et al[49], study1NC19149%(13-18) 16.4 ± 1.76aMod (13)MCQ-C-RCMAS-2
Benedetto et al[49], study2C1,5/NCb14/1457%/NA(12-17) 14.9 ± 1.6/NALow (14)MCQ-C-RCMAS-2
Boysan et al[92]NC80549%(11-17) 13.9 ± 1.4Low (14)MCQ-C-STAI-C
Carr and Szabó[72]NC9348%(7-12) 10.0 ± 1.2Low (16)MCQ-CCAWS-
Cartwright-Hatton et al[53]C6/NC(11)/166(64%)/66%NA/(13-17) 15.3 ± NAMod (12)MCQ-A-RCMAS
Donovan et al[80]Total/C1/NC50/25/2560%/NA/NA(7-12) 9.9 ± 1.5/NA/NALow (14)MCQ-CPSWQ-CADIS-C
Donovan et al[65]NC11451%(8-12) 9.9 ± 1.3Low (15)MCQ-CPSWQ-C-
Ellis and Hudson[24]Total/C1,5/NC123/81/42NA/57%/52%(12-17) NA/(NA) 14.1 ± 1.5/(NA) 13.7 ± 1.4Low (15)MCQ-APSWQADIS-C/P; SCAS-C/P
Esbjørn et al[23], study1NC58755%(9-17) 12.5 ± 0.9aMod (12)MCQ-C30PSWQ-CSCARED-R
Esbjørn et al[23], study2Total/C1,4,7,3/NC93/50/43NA/NA/NA(7-12) 9.8 ± 1.6/NA/NAMod (13)MCQ-C30-ADIS-C/P
Esbjørn et al[93]NC11164%(8-12) 10.1 ± 1.4Low (15)MCQ-C30PSWQ-CADIS-C/P; RCADS
Esbjørn et al[66]NC97455%(9-17)Low (15)MCQ-C30PSWQ-CSCARED-R
Esbjørn et al[56]C14450%(7-13) 9.7 ± 1.6Low (15)MCQ-C30PSWQ-CADIS; RCADS
Fergus and Limbers[57]NC (TG)/NC (CG)39/3462%/71%(NA) 13.8 ± 0.5/(NA) 13.8 ± 0.7Low (17)MCQ-C-CTAS
Fisak et al[73]NC17566%(11-18) 13.9 ± 1.5Mod (12)MCQ-C;MWQPSWQ-C-
Francis et al[50]NC31255%(9-15) 11.9 ± 1.2Low (15)MCQ-CPSWQ-CSCAS;MASC
Francis et al[51]NC31255%(9-15) 11.9 ± 1.2Mod (14)MCQ-CPSWQ-C-
Gallagher and Cartwright-Hatton[94]NC16885%(16-18) 17.2 ± 0.9Mod (11)MCQ-30-STAI-T
Gini et al[67]NC116948%(14-17) 15.8 ± 1.1Mod (11)MCQ-30PSWQ-CGAD7
Hearn et al[25]C312660%(8-17) 11.3 ± 2.7Mod (13)MCQ-CPSWQ-C(SF)ADIS;SPAI-10-C/P
Hearn et al[74]Total/C1,3/NC60/40/2070%/NA/NA(8-12) 9.9 ± 1.3/NA/NALow (15)MCQ-CPSWQ-C(SF)ADIS; SCAS
Hearn et al[26]Total/C3(TG)/C3(WL)125/95/3060%/NA/NA(8-17) 11.3 ± 2.7/NA/NALow (17)MCQ-CPSWQ-C(SF)ADIS; SPAI-10
Holmes et al[59]C110%10Low (16)MCQ-CPSWQ-CADIS-C/P;SCAS-C/P
Holmes et al[58]Total/C1(TG)/C1(WL)42/20/2267%/NA/NA(7-12) 9.6 ± 1.4/NA/NALow (17)MCQ-CPSWQ-CADIS-C/P;SCAS-C/P
Irak[78]NC47044%(8-17) 12.2 ± 2.8Mod (12)MCQ-C-STAI-C
Kertz and Woodruff-Borden[75]NC8071%(8-12) 9.6 ± 1.1Mod (12)MCQ-CPSWQ-C(SF)RCMAS
Laugesen et al[71]NC52849%(14-18) 15.6 ± 0.9Low (15)WW-IIPSWQ-CWAQ
Lønfeldt et al[76]NC18866%(7-12) 10.0 ± 1.4Low (14)MCQ-C30-ADIS-P; RCADS
Lønfeldt et al[77]NC106255%(9-17) 12.3 ± 1.7Low (14)MCQ-C30-SCARED-R
Mather and Cartwright-Hatton[95]NC16666%(13-17) 15.1 ± 1.4Mod (12)MCQ-A-RCMAS
Matthews et al[81]NC22356%(13-16) NAMod (13)MCQ-A--
Naumann[68]NC97252%(7-14) 10.6 ± 1.5Low (14)MKF-KPSWQ-CSCAS
Normann et al[60]C1,4,3,74450%(7-12) 9.9 ± 1.6Low (14)MCQ-C30-ADIS-C/P; SCARED-R
Reinholdt-Dunne et al[79]C1,4,3,7/NC169/18253%/55%(7-14) 9.9 ± 1.8/(7-12) 10.0 ± 1.4Low (16)MCQ-C30-RCADS
Sanger and Dorjee[61]NC (TG)/NC (CG)20/2550%/68%(16-18) 16.6 ± 0.6/(16-18) 17.1 ± 0.6Mod (12)MCQ-A--
Simons and Vloet[62]C73100%(14-17) 15.3 ± 1.5Mod (13)MCQ-ASCAS-scaleSCAS
Smith and Hudson[52]Total/C1,3,2,7,4,8/NC83/49/3460%/NA/NA(7-12) 9.2 ± 1.6/NA/NAMod (13)MCQ-C-ADIS-C/P; SCAS
Thorslund et al[63]C1,3,91070%(14-17) 15.2 ± NALow (14)MCQ-CPSWQ-CMINIKid
White and Hudson[30]NC18731%(7-12) 10.6 ± 1.7Low (15)MCQ-CRPSWQ-CSCAS
Wilson et al[82]NC7254%(11-16) 13.2 ± 1.0Mod (13)MCQ-APSWQ-CMASC
Wilson and Hall[69]NC15156%(13-16) 15.1 ± 1.0Mod (12)MCQ-ATCQ-scale-
Wilson and Hughes[70]NC5761%(6-10) NAMod (12)InterviewPSWQ-CMASC
Yavuz et al[96]NC181754%(14-17) 15.4 ± 1.1Mod (12)MCQ-C-NMP-Q
Zimmermann et al[54]NC22155%(13-17) 14.9 ± 1.4Mod (12)MCQ-A-SBB-ANZ

A total of n = 12839 participants were examined in the included studies. Median sample size was n = 138.50 per study, range n = 1 to n = 1817. Gender distribution was reported in k = 46 studies. Overall, a mean of 56.84% of participants per study described themselves as female, ranging from 0% to 100% per study. The age of participants ranged from 6 to 18 years. k = 30 studies involved a non-clinical sample, k = 8 studies involved a purely clinical sample, and k = 10 studies included both a clinical group and a non-clinical group. The non-clinical samples were usually convenience samples recruited from schools. Studies with clinical samples included the primary diagnoses GAD, SAD, SoD, panic disorder/agoraphobia, and specific phobia. In three studies, OCD or post-traumatic stress disorder were classified as anxiety disorders[27,28,52]. Patients with these primary disorders represented a percentage of 8.1% to 18.4% of patients included with anxiety disorders. Most studies revealed a cross-sectional design. Three studies included a retest-measurement to assess test-retest correlations for validating different questionnaires[53-55]. Nine studies followed a longitudinal design in the form of intervention studies with pre-post- (and follow-up) measurement points[26,56-63].

Risk of bias

We used the AXIS-tool to assess the risk of bias. Most of the studies were classified as low risk of bias (k = 25) and moderate risk of bias (k = 23), whereas no study was classified as having a high risk of bias (see Table 1).

What evidence is there for positive relationships between POS, NEG, and meta-worry with each other, worry, and anxiety for children and adolescents?

Relationships between POS, NEG, meta-worry, and worry: Table 2 provides an overview of the relationships reported in the included studies. In total, k = 18 studies researched the relationships between POS, NEG, and worry. Most thereof demonstrated correlations between worry and both POS and NEG[24,51,64-70]. Moreover, two studies collected POS exclusively and reported significant correlations between worry and POS[71,72]. Two studies showed that POS and NEG contribute to worry as unique predictors[23,73], and another study that exclusively measured POS identified it as a unique predictor of worry[72]. However, other studies found that worry correlated only with NEG, not with POS[26,30,74,75]. Another study detected a correlation between POS and worry that disappeared after the authors controlled for worry contents, while worry nevertheless continued to correlate with NEG[28]. One study detected no group differences in worry between participants who described POS or NEG verbally in open-ended questions and those who did not[70]. Only one study investigated the relationship between meta-worry and worry and observed positive correlations between them[73].

Table 2 Extracted correlational coefficient on measures of positive beliefs about worry/negative beliefs about worry and worry/anxiety.
Ref.Worry

Anxiety

POS
Age


POS
NEG
POS
NEG
NEG
POS
NEG
Babaei et al[55]---0.053-0.303b0.21b--
Bacow et al[27]-----NANA
Bacow et al[28]0.21a0.55b-----
Benedetto et al[64]0.23b0.70b0.29b0.65b0.30b
Benedetto et al[49], study1--0.203,a; 0.014 0.563,b; 0.484,b0.173; 0.314,b--
Benedetto et al[49], study2---0.681,a; 0.382 0.561,a; 0.422 -0.411; 0.692,b --
Boysan et al[92]-------
Carr and Szabó[72]0.35c----0.02 -
Cartwright-Hatton et al[53]--0.32c0.67c---
Donovan et al[80]-------
Donovan et al[65]0.22a0.72b--0.20a--
Ellis and Hudson[24]0.49b0.84b0.46b0.72b-0.16 0.16
Esbjørn et al[23], study1-------
Esbjørn et al[23], study2-------
Esbjørn et al[93]-------
Esbjørn et al[66]0.25c0.31c0.17c0.55c0.25c--
Esbjørn et al[56]-------
Fergus and Limbers[57]-------
Fisak et al[73]-------
Francis et al[50]-------
Francis et al[51]0.39b0.69b--0.31b--
Gallagher and Cartwright-Hatton[94]-----
Gini et al[67]0.32c0.65c0.22c0.60c0.16c--
Hearn et al[25]0.16 0.50b0.02 0.39b0.08--
Hearn et al[74]-------
Hearn et al[26]0.02 0.48b0.01 0.36b---
Holmes et al[59]-------
Holmes et al[58]-------
Irak[78]--0.194c0.412c---
Kertz and Woodruff-Borden[75]0.14 (P) 0.53c (P)-----
Laugesen et al[71]0.37c (P)------
Lønfeldt et al[76]--0.31b0.57b0.30b0.10 0.06
Lønfeldt et al[77]--0.19a0.58a0.23c-0.01 -0.08a
Mather and Cartwright-Hatton[95]-------
Matthews et al[81]----0.47a-0.05 -0.18b
Naumann[68]0.20b0.63b0.20b0.55b0.07--
Normann et al[60]-------
Reinholdt-Dunne et al[79]--0.091; 0.362,b0.621,b; 0.682,b0.051; 0.292,b0.101; -0.10201; 02
Sanger and Dorjee[61]-------
Simons and Vloet[62]-------
Smith and Hudson[52]--0.30b0.47b0.36b--
Thorslund et al[63]-------
White and Hudson[30]0.08 0.65b0.20b0.56b0.27a0.06 0.07
Wilson et al[82]0.35b0.74b0.19 0.51aNA< 0.16 < 0.16
Wilson and Hall[69]0.33c0.51c--0.29c--
Wilson and Hughes[70]-------
Yavuz et al[96]-------
Zimmermann et al[54]--0.22b0.57b-0.16a0.12

Results of meta-analysis: Table 3 shows our meta-analysis results. Meta-analysis (k = 13) for correlation between POS and worry resulted in an overall small to medium effect size [r = 0.27 (0.22, 0.33), P < 0.001]. Q-Test for heterogeneity was significant (Q = 36.14, P < 0.001), and inconsistency can be described as moderate to high (I2 = 67%). For correlation between NEG and worry (k = 12), the overall correlation coefficient was r = 0.64 (0.55, 0.72), P < 0.001, indicating a large effect. Heterogeneity tests resulted in significant and substantial inconsistency: I2 = 95%, Q = 233.90, P < 0.001. Forest plots for meta-analysis are depicted in Figures 2 and 3. As only one study examined meta-worry[73], we could not conduct a meta-analysis for a correlation with worry.

Figure 2
Figure 2 Meta-analysis forest plot on the correlation between measures of positive metacognitive beliefs about worry and worry. CI: Confidence interval; SE: Standard error.
Figure 3
Figure 3 Meta-analysis forest plot on the correlation between measures of negative metacognitive beliefs about worry and worry. CI: Confidence interval; SE: Standard error.
Table 3 Summary of results for random effect models for meta-analysis on correlational coefficient on measures of positive beliefs about worry/negative beliefs about worry and worry/anxiety.
Overall effectHeterogenity test
Meta-analysis
k
r
95%CI, r
95%PI, r
Fisher‘s z
95%CI, z
Z
Q
I2
T2
POS and worry130.27(0.22, 0.33)(0.08, 0.45)0.28 (0.22, 0.34)9.56, P < 0.00136.14, P < 0.00167 %0.01
NEG and worry120.64(0.55, 0.72)(0.27, 1.25)0.76 (0.62, 0.90)10.49, P < 0.001233.90, P < 0.00195 %0.06
POS and anxiety180.20(0.16, 0.25)(0.00, 0.38)0.20 (0.16, 0.25)8.54, P < 0.00152.11, P < 0.00167 %0.01
NEG and anxiety180.53(0.46, 0.60)(0.19, 0.76)0.59 (0.50, 0.69)12.32, P < 0.001234.07, P < 0.00193 %0.04
POS and NEG170.24(0.18, 0.28)(0.04, 0.41)0.24(0.18, 0.29)8.49, P < 0.00166.44, P < 0.00176 %0.01

Relationships between POS, NEG, meta-worry, and anxiety: k = 21 studies analyzed the association between POS and NEG and anxiety symptoms. Correlations between POS, NEG, and anxiety were demonstrated in the majority of studies[24,30,52-54,64,66-68,76-78]. However, other study findings contradict those results. Three studies revealed correlations between anxiety and NEG, while anxiety failed to correlate with POS[25,26,70]. NEG contributed to anxiety as a unique predictor in one study, while POS did not predict anxiety significantly[23]. In study 1 by Benedetto et al[49], anxiety did correlate with NEG in female and male participants, whereas POS and anxiety correlated significantly in female subjects only. In study 2, those two correlations were proven in adolescents with an anxiety disorder only but not in a non-clinical sample[49]. Another study showed that NEG correlated with anxiety in clinical and non-clinical groups, while POS were only associated with anxiety in a clinical group[79]. In the study by Wilson and Hughes[70], children’s anxiety scores did not differ as to whether they reported NEG or POS. One study even identified a negative correlation between NEG and anxiety, while POS did not correlate with anxiety[55]. No study examined whether meta-worry was related to anxiety. Extracted relationships are shown in Table 2.

Results of meta-analysis: For the correlation between POS and anxiety, we identified k = 18 studies for meta-analysis. The overall effect size was small [r = 0.20, 95%CI (0.16, 0.25), P < 0.001]. Q-Test for heterogeneity was significant (Q = 52.11, P < 0.001) and the amount of inconsistency is moderate to high (I2 = 67%). Testing of overall-effect size when correlating NEG and anxiety (k = 18) resulted in a large effect [r = 0.53 (0.46, 0.60), P < 0.001]. With respect to heterogeneity, the Q-statistic is significant (Q = 234.07, P < 0.001), and results speak for inconsistency (I2 = 93%). Our meta-analysis results are displayed in Table 3, the forest plots in Figures 4 and 5. No meta-analyses for correlations between worry and meta-worry were possible as no study investigated potential relationships between those variables.

Figure 4
Figure 4 Meta-analysis forest plot on the correlation between measures of positive metacognitive beliefs about worry and anxiety. CI: Confidence interval; SE: Standard error.
Figure 5
Figure 5 Meta-analysis forest plot on the correlation between measures of negative metacognitive beliefs about worry and anxiety. CI: Confidence interval; SE: Standard error.

Clinical vs non-clinical groups: A total of k = 10 studies included both clinical and non-clinical samples. Three studies showed that their clinical sample held significantly higher POS and NEG than the non-clinical group[24,52,79]. In other studies, clinical participants reported more NEG than non-clinical participants, POS revealed no group difference[49,53,74,80]. One study found that both investigated clinical samples (GAD, other anxiety disorders) held significant higher NEG than a non-clinical group, but only patients with GAD differed from healthy controls in case of POS[23]. Two studies failed to demonstrate significant differences between a non-clinical sample and patients with anxiety disorders for POS or NEG[27,28]. Furthermore, k = 4 studies compared different anxiety disorders with each another specifically. The findings by Bacow et al[27] indicate that children and adolescents with OCD, SAD, SoD, and non-clinical controls do not differ in POS or NEG. Another study reported no group differences between patients with GAD and patients with SoD for POS or NEG[74]. Ellis and Hudson[24] detected no differences either between their sample with GAD and one with other anxiety disorders. Nevertheless, in their study 2, Esbjørn et al[23] demonstrated that patients with GAD had higher NEG than those with other anxiety disorders, whereas POS did not differ between groups.

Relationships between POS, NEG, and meta-worry: Correlations between POS and NEG were explored in k = 19 studies, as shown in Table 2. Most studies identified a positive correlation between POS and NEG[30,51,52,55,64-67,69,76,77,81]. In Benedetto et al[49] study 1, POS and NEG correlated positively with each other for male but not female participants. In their second study, a correlation between POS and NEG only became evident in a non-clinical sample, not a clinical one. Reinholdt-Dunne et al[79] reported the same result. Still other working groups failed to demonstrate any significant correlation between POS and NEG[25,26,68,82], and none analyzed relationships between POS and NEG with meta-worry.

Results of meta-analysis: We excluded one study from meta-analysis that showed a correlation between POS and NEG since they reported no effect size for correlation[82]. Overall effect size for the POS with NEG correlation (k = 17) was small to medium, r = 0.24 (0.18, 0.28), P < 0.001. Heterogeneity was shown to be significant (Q = 66.44, P < 0.001), and inconsistency was high (I2 = 76%). Results are displayed in Table 3 and Figure 6.

Figure 6
Figure 6 Meta-analysis forest plot on the correlation between measures of positive metacognitive beliefs about worry and negative metacognitive beliefs about worry. CI: Confidence interval; SE: Standard error.
At what age do children report POS, NEG, and meta-worry, and does age play a role in relationships with worry and anxiety?

Onset of metacognitive beliefs about worry: k = 31 studies examined metacognitive beliefs in children under the age of 12 years, and k = 14 studies included populations from age 7 years upwards. Only one study investigated metacognition in children as young as six[70]. Those authors asked children between 6 and 10 years of age to fill out open-ended questions about POS and NEG. Fifty-six percent of children expressed one or more POS, and 77% of children expressed one or more NEG; they observed no age-related differences in the numbers who named POS or NEG[70]. Six-year-old children thus do not seem to differ from older children in their POS and NEG. Other studies analyzed how well young children understand metacognitive questionnaires. Smith and Hudson[52] found that six items on the often used Metacognitions Questionnaire for Children[28] were not adequately understood by 35.8% to 78.6% of the 7- and 8-year-olds they investigated. White and Hudson[30] changed those six items and included a fifth answer option, "I don’t understand". Their new instrument, the Revised Metacognitions Questionnaire for Children[30], was tested in a sample of 187 7- to 12-year-old children. No item, including the six newly changed items, was marked as "I don’t understand" by more than 25% of 7-year-olds and 17% of 8-year-olds, indicating that the vast majority of this age group (75%-83%) was indeed able to rate their POS and NEG[30]. A small negative correlation was found between age and the number of not-understood items, and a similar significant group difference between 7- to 8-year-olds and 9- to 12-year-olds appeared, indicating that children understand POS and NEG better as they age[30].

Relationship between age and metacognition about worry: Table 2 contains an overview of extracted relationships. Of all included studies, only a minority investigated whether metacognitive beliefs change with age (k = 12). Most of those studies did not detect any correlation between POS and NEG, neither with participants’ age nor age-related differences[24,27,28,30,72,77,79,82]. In the open-ended questions asked verbally by Wilson and Hughes[70], 56% of children claimed to have at least one POS and 77% at least one NEG. The authors revealed no age-related difference in these answers from children aged 6 to 10 years. In contrast, another study’s results suggest that NEG may decline with age, as age did not correlate with POS, but NEG did correlate with age (with a small negative effect[76]). Interestingly, another study identified a small positive correlation between POS and age, but no significant correlation between NEG and age[54]. Another study also demonstrated a significant age effect for POS but none for NEG[78].

Results of meta-regressions with age as covariate: Results of the meta-regressions with mean age as covariate are presented in Table 4. Z-tests for latitudes did not reach significance in any meta-regression, therefore the null hypothesis of no effect cannot be rejected. We therefore found that mean age was not a significant covariate in any of the tested correlations.

Table 4 Results of meta-regressions on correlational coefficient on measures of positive beliefs about worry/negative beliefs about worry and worry/anxiety with mean age as covariate.
Meta-regression

B
SEB
95%lower
95% upper
Z
P
POS and Intercept0.50820.356-0.2541.2711.4290.175
Anxiety1Latitude-0.02650.028-0.0860.033-0.9580.354
POS and Intercept-0.09050.195-0.5250.344-0.4640.652
Worry2Latitude0.03020.016-0.0050.0651.9110.085
NEG and Intercept0.44270.1280.1680.7183.4500.004b
Anxiety3Latitude0.00940.010-0.0120.0310.9400.363
NEG and Intercept0.64820.2250.1391.1572.8810.018a
Worry4Latitude0.00040.018-0.0400.0410.0210.984
POS andIntercept0.52560.260-0.0421.0932.0190.066
NEG5Latitude-0.02860.021-0.0740.017-1.3570.200
Which methods are currently applicable to assess POS, NEG, and meta-worry in childhood and youth?

In total, the authors administered six different questionnaires to assess POS and NEG together. These include the Metacognitions Questionnaire-30-Item Version (MCQ-30)[83], MCQ - Adolescent Version[53], and MCQ for Children (MCQ-C)[28]. The Revised MCQ for Children (MCQ-CR)[30], MCQ for Children-30-Item version (MCQ-C30)[66], and Metakognitionsfragebogen für Kinder[68] are more recent adaptations. All those questionnaires are variations of the MCQ developed by Cartwright-Hatton and Wells[22]. Despite POS and NEG, it also covers cognitive confidence, the need for control, and cognitive self-consciousness[22]. Furthermore, with Why Worry-II[84], we extracted one questionnaire that exclusively measures POS. Only one study assessed meta-worry[73]. Its authors administered the meta-worry questionnaire[21] for this purpose.

Of the studies included, only one assessed POS and NEG in children as young as 6 years of age[70]. Due to the lack of reading skills at this age, the children were orally asked these open-ended questions: "Worry can sometimes be helpful and good. Tell me some reasons why worry is good" and "Worry can sometimes be unhelpful and bad. Tell me some reasons why worry is bad"[70]. The authors assigned the children's responses to the categories POS (e.g., solves problems, motivates you, keeps you safe) and NEG (e.g., impacts on activity, is uncontrollable, makes you unwell). An overview of the measurements used in these studies is found in Table 5.

Table 5 Measurements of metacognitive beliefs about worry and meta-worry.
Measure
Items
Scales
Answer format
Values for reliability
Age
k
MCQ-C 24 4Do not agree (1) to agree very much (4)POS: α = 0.46 - 0.89, rtt = 0.82; NEG: α = 0.60 - 0.95, rtt = 0.76[25-28,49,51,52,57,64,65,72,73,74,78]7-17 22
MCQ-A 30 5Do not agree (1) to agree very much (4)POS: α = 0.80 - 0.90, rtt = 0.66; NEG: α = 0.80 - 0.87, rtt = 0.71[24,53,54,81,82]11-17 9
MCQ-C30305Not at all (1) to completely (4)POS: α = 0.64 - 0.73; NEG: α = 0.71 - 0.79[23,76,93]7-178
MCQ-30 305Do not agree (1) to agree very much (4)POS: α = 0.88; NEG: α = 0.77[67]15-18 3
MCQ-CR 305Not true (1) to Very true (4); I do not understandPOS: α = 0.77; NEG: α = 0.80[30]7-121
MKF-K 304Not at all (1) to completely (4)POS: α = 0.73; NEG: α = 0.70[68]7-141
MWQ72Never (1) to almost always (4)α = 0.80 - 0.82[73]11-181
WW-II255Not at all (0) to incapacitating (4)α = 0.90[71]7-181
Interview22Open questionsκ = 0.61[70]6-101
DISCUSSION

To the best of our knowledge, this review is the first to describe systematically measuring instruments for POS and NEG as well as results on the validity of the metacognitive model by meta-analysis on correlations between POS and NEG with each other, worry, and anxiety. Presenting 48 studies, we provide a broad overview of this topic, upon which future research can build. We conducted a consensus rating of 20.89% of full-texts with agreement in 90.32%. Good interrater agreement was attained regarding the risk of bias assessment. No study was rated as showing a high risk of bias. Data from 24 studies could be included in quantitative synthesis to meta-analyze the strength of effect sizes. We were also able to analyze mean age as a moderator in meta-regressions and identify various measurement instruments for different age ranges and newer adaptations like MCQ-CR and MCQ-C30 that enable better coverage of POS and NEG in younger children. The use of orally posed open questions reveals another approach for assessing POS and NEG in even younger children, thus enabling us to investigate the onset of such beliefs about worry[70].

What evidence is there for positive relationships between POS, NEG, and meta-worry with each other, worry, and anxiety in children and adolescents?

NEG correlated in all 14 studies[24,25,26,28,30,51,64-69,75,82] with worry and proved to be an independent predictor of worry in three[23,65,73] out of three studies. Meta-analysis showed large overall correlation between NEG and worry.

NEG also correlated with anxiety in 17[24-26,30,52-55,64,66-68,76-79,82] of 19 studies. Benedetto et al[49] study 2 revealed a correlation in their clinical sample only. Surprisingly, another study showed a significant negative relationship of medium effect size between NEG measured with MCQ-30 and anxiety in high school students[55]. The questionnaires used had not been adapted or evaluated for use in adolescents; their contradictory result may be attributable to their not mentioning any specific age range[55]. Overall, the correlation between NEG and anxiety in our meta-analysis revealed was large. NEG predicted anxiety uniquely in three[23,68,75] out of four studies. One study found that NEG was not a significant predictor of anxiety, however[25]. Eight[23,24,49,52,53,74,79,80] out of 10 studies that compared clinical and non-clinical samples showed higher NEG in participants with anxiety disorders, a finding that also supports the metacognitive model. Two studies[27,28] detected no significant group differences.

For POS, 12[24,28,51,64-69,71,72,82] out of 16 studies showed a significant positive relationship with worry, while correlations failed to reach significance in four studies[26,30,48,74]. Meta-analysis resulted in a small overall effect size for the correlation between POS and worry. POS predicted worry in three[23,71,73] out of four studies, while it was not significant in one study[65].

POS correlated with anxiety in 12[24,30,52-54,64,66-68,76-78] out of 19 studies. Studies 1 and 2 of Benedetto et al[49] did identify significant correlations but only in their clinical subgroup, while Reinholdt-Dunne et al[79] detected a significant correlation in their non-clinical subgroup. In fact, four studies[25,26,55,82] failed to indicate any significant correlations between POS and anxiety. Meta-analysis demonstrated a small to medium effect size for the correlation between POS and anxiety. POS proved to be unique predictors of anxiety in one[68] of three studies, while two studies[73,80] failed to prove POS as a significant predictor. Clinical groups scored higher on POS than non-clinical groups in four[23,24,52,79] out of 10 studies, while six[27,28,49,53,74,80] studies revealed no significant group differences.

Correlations between POS and NEG were reported as significant in 12[30,51,52,55,64-69,76,77,81] out of 19 studies, whereas that finding applied to only one of two subgroups in Studies 1 and 2 of Benedetto et al[49] and a study by Reinholdt-Dunne et al[79]. Meta-analysis demonstrated a small to medium effect size.

These mixed results partly support the metacognitive model as well, but NEG seem to have a generally more stable effect on worry and anxiety than POS. POS correlations were quite smaller (small to medium effect sizes) while NEG correlations were large. This is not surprising since NEG revealed medium to large correlations with anxiety and worry in adults, while POS result in small to medium correlations with anxiety and worry[83,85,86]. Meta-analysis revealed a smaller effect for the correlation between POS and NEG (small to medium), while correlations for NEG with anxiety and worry are large - evidence that concurs with studies from adult research[83,85,86]. To evaluate conclusively the causal claims of the metacognitive model for children, longitudinal studies are needed. However, most of the studies we included applied a cross-sectional design that precludes such conclusions. Only 10 studies compared clinical to non-clinical samples. Future studies should compare POS, NEG, and meta-worry in clinical and non-clinical samples to validate further the metacognitive model of GAD in childhood and youth. For more information about the specific influence of NEG and meta-worry in the development of GAD, patients presenting different anxiety disorders should be compared also, since the results here are far from clear. In total, the overall situation that this systematic review and meta-analysis portrays indicates that NEG play an especially relevant role in worry and anxiety in children and adolescents, and that there is ample evidence from studies that supports the applicability of the metacognitive model of GAD in childhood and youth.

At what age do children report POS, NEG, and meta-worry, and does age play a role in the relationships with worry and anxiety?

Fourteen studies in total included samples of children aged 7 years and upwards. None of those studies investigated the age of onset of metacognition about worry explicitly. To explore how well children understand questionnaire items, White and Hudson[30] added a response option for not-understanding in the MCQ-CR, and their results support an improvement in how well items are understood from the age 7 to 12 years. Nevertheless, at least 75% of 7- to eight-year-olds understood every MCQ-CR item. Only one study investigated even younger children[70]. The authors posed open-ended questions verbally to assess POS and NEG in 6-year-olds and concluded that these children are capable of understanding and can describe beliefs about worry, as more than half of the 6- to 10-year-olds stated POS, and almost 8 out of 10 children stated NEG. Response frequencies did not differ with age. Although children are less capable of introspection at 5 years of age than 7- or 8-year-olds[33,35], this result implicates that the metacognitive abilities needed to perceive and describe when worry arises and what feelings and thoughts are associated with it are already developed by the age of 6 years. It thus seems possible that we are underestimating the metacognitive ability of young children[36]. This could also be because POS and NEG are usually surveyed using questionnaires.

Most of the included studies revealed no significant associations between the participants’ age and NEG[24,27,30,54,76,79,82] or POS[24,27,30,72,76,77,79,81,82]. Two studies even demonstrated negative correlations between age and NEG[77,81]. We cannot therefore assume any increase in POS and NEG with rising age. However, one study[54] did show a positive correlation between POS and age. We analyzed mean age as a covariate in meta-regressions as a potential source of variance, but the results were not significant, thus we cannot assume that mean age is a relevant source of variance. Because of the rather small number of included studies in meta-regressions (range: k = 11-16) and the substantial heterogeneity as demonstrated by Q- and I2-statistics, there might be insufficient power to demonstrate mean age’s moderating effect[87]. Our results therefore do not allow us to assume that mean age has a zero-effect on correlations between POS and NEG with each other, worry, and anxiety. Nevertheless, our overall results suggest that POS and NEG do not vary much with age and that the metacognitive model of GAD can be applied to a broad age range of seven to 18 years.

Which methods are currently applicable to assess POS, NEG, and meta-worry in childhood and youth?

The studies included in this review indicate that MCQ-family of questionnaires are the ones most widely used in research and clinical practice to measure metacognitive beliefs in childhood and youth. We identified six derivates of the MCQ in this review. The MCQ-C, applied in 22 studies, was most frequently administered in children and adolescents aged 7 to 18 years. For youth between 11 and 17 years, the MCQ - Adolescent Version was used in nine studies. MCQ-C30 was also used in 7- to 17-year-olds in eight studies. Since each study we included originated from a single research group, we may have overestimated the frequency of use. The MCQ-30, designed for adults, was administered by three study groups in adolescents between 15 and 18 years of age without any adaptations for that age group. Other MCQ-derivates were only used in one study each. The MCQ-CR was especially designed to be better understandable for 7- and 8-year-olds[30] but was not distributed further. One study used the German questionnaire Metakognitionsfragebogen für Kinder[68]. To measure exclusively POS, Why Worry-II was used without pretesting or adaptation in a sample of 7- to 18 year-olds[71].

One study posed open-questions to assess verbally POS and NEG in children from the age of 6 to 10 years but detected no age-related differences in POS or NEG[70]. Such interview approaches represent an alternative method when surveying young children who may not yet be able to read well enough. To define the onset of POS and NEG more specifically, future research should also attempt to replicate the results of Wilson and Hughes[70] with a larger sample and perhaps include even younger children. An interview-format was also applied in the dissertation of Bacow[88], the MCQ-C author who designed the "Evaluations of Worries and Thoughts Interview for Children" (EWTI-C) to survey worry and associated beliefs. While the MCQ-C’s results were covered in the paper of Bacow et al[28], no EWTI-C data have been published yet. Interestingly, when measured with the EWTI-C, POS and NEG did not correlate with worry at all, and participants with anxiety disorder reported more NEG, but not POS, than non-clinical controls[88]. This indicates a need for valid and reliable methods to measure metacognition in childhood and youth. More recently, thanks to the availability of the MCQ-CR and MCQ-C30, two promising adaptations of the MCQ have been added and should be further investigated. Although meta-worry plays an important role in the metacognitive model, only one study investigated this construct using the meta-worry questionnaire with children aged 11 years[73]. This questionnaire has not yet been validated or adapted for children and adolescents. We need to improve and modify suitable instruments for measuring meta-worry, and it deserves more attention in future research.

Limitations

Some limitations need to be considered: First, the results we extracted are mainly cross-sectional and thus preclude any causal conclusions. Longitudinal studies are needed to support the metacognitive model’s causal assumptions despite the overall relationship trends the cross-sectional data from this review has revealed so far.

Second, the broad heterogeneity revealed across the various meta-analyses we conducted should be considered a limitation. The amount of genuine variance not attributable to chance was medium to large, as the heterogeneity values indicate (I2 = 67% and 95%). Mean age was assessed as a covariate by meta-regression to see whether age plays a role in relationships between POS and NEG with worry and anxiety, but it did not explain variance. Other sources of variance might include differences in assessment methods for POS, NEG, anxiety and worry, sample types (clinical vs non-clinical), percentage of comorbid disorders in clinical samples, and gender distribution. Additional meta-regressions for these potential covariates could help to explain the amount of variance among the included studies.

Third, some studies covered a broad age range[28,51,69,78,79], limiting specific interpretations of potential developmental patterns specific to different age groups. We chose mean age as a covariate for meta-regression, but the ages of all participants might not have been accurately represented. Our results can thus only reflect the mean age of the samples and must be interpreted with caution for aggregation bias[89].

Fourth, only studies with clinical samples were included if they exclusively assessed patients with DSM-5[40] listed anxiety disorders, but three studies[27,28,52] contained clinical subgroups with post-traumatic stress disorder or OCD, as they had been included in anxiety disorders in the DSM’s earlier fourth edition[90]. Moreover, 60% of non-clinical participants in one study presented subclinical anxiety symptoms[28].

Fifth, to measure POS and NEG, some Cronbach’s alpha values for the MCQ-C[25,27,28,52,57,64,65,72,73] and MCQ-C30[60,76] fell below the recommended level of 0.70 for exploratory research as recommended by Nunnaly and Bernstein[91]. Moreover, the MCQ-C does not seem to be ideally suitable for use in younger children, as 35.8% to 78.6% of children aged 7 to 8 years did not fully understand six items[52]. As the MCQ-C was used in k = 22 studies and the MCQ-C30 in k = 8 studies, this factor should be considered a limitation.

Sixth, we could include only one unpublished study as gray literature[68], therefore the risk of publication bias should be considered a limiting factor.

CONCLUSION

In conclusion, the studies included in this review demonstrate that POS and NEG are measurable by administering questionnaires in children from 7 years of age upwards, and even children aged as young as 6 years can already name them verbally. Furthermore, POS and NEG do not seem to vary with age in childhood and youth. NEG shows strong overall correlations with worry and anxiety over different age groups, highlighting their relevance in the development and maintenance of anxiety disorders and confirming the metacognitive model’s implications. POS’ smaller effect sizes and inconsistent findings suggest that these play a subordinate role, in line with the evidence from adult studies[83,85,86]. The current research data reveal quite large heterogeneity between studies that cannot be attributed to the influence of mean age. Nor can any conclusions about the influence of meta-worry on anxiety disorders be drawn. Measurements of meta-worry in children and adolescents are thus needed, and measurements of POS and NEG for young children require further research. Longitudinal studies could enable clearer conclusions to be made on causal relationships between the metacognitive model’s relevant constructs.

ARTICLE HIGHLIGHTS
Research background

The metacognitive model of generalized anxiety disorder has been applied to children and youth in different studies. Results mostly support its validity, but the roles of positive metacognitive beliefs about worry (POS), meta-worry, and age-effects do not appear to be fully clarified yet.

Research motivation

Summarizing the current research on relationships, age-effects, and measurements for POS, negative metacognitive beliefs about worry (NEG) and meta-worry in childhood and youth are both timely and worthwhile.

Research objectives

Relationships between POS, NEG, and meta-worry with each other, worry, and anxiety, and possible age-effects for these relationships were analyzed. Assessment methods POS, NEG and meta-worry for children and adolescents were examined.

Research methods

A literature search was carried out in the electronic databases PsycINFO, PubMed, PSYNDEX, and ERIC in 2017 and updated in 2020. Empirical research in German or English language on metacognition was included with child and adolescent samples diagnosed with anxiety disorders or healthy controls if POS, NEG, or meta-worry was measured. Meta-analysis for reported correlations between these metacognitions and anxiety or worry was carried out with RevMan 5.4.1, assuming random-effects models. Meta-regressions with mean age as the covariate were performed via the online tool MetaMar 2.7.0.

Research results

Overall, we included k = 48 studies in this systematic literature review and of those, k = 24 studies fulfilled our inclusion criteria for meta-analysis. Systematic review and meta-analysis showed that POS and NEG correlate with worry and anxiety. Mean age was not a significant covariate in meta-regressions. Only one study measured meta-worry. We identified eight questionnaires and one interview approach for assessment of metacognitive beliefs.

Research conclusions

Our overall results support the applicability of the metacognitive model of generalized anxiety disorder in childhood and youth. NEG play an especially relevant role in worry and anxiety in children and adolescents, while conclusions about meta-worry’s influence cannot be drawn. Most included studies used a cross-sectional design and thus preclude causal conclusions. Metacognitive beliefs do not seem to vary with age and appear to be measurable in children from 7 years upwards.

Research perspectives

Longitudinal studies and research on the impact and measurement of meta-worry would be beneficial. Measurements applying to young children should undergo further investigation.

ACKNOWLEDGEMENTS

The authors wish to thank Hannah Grote for help with risk of bias rating and all members of the working unit Clinical Child and Adolescent Psychology (Department of Psychology, University of Marburg) for their support throughout this study.

Footnotes

Manuscript source: Invited manuscript

Specialty type: Psychology

Country/Territory of origin: Germany

Peer-review report’s scientific quality classification

Grade A (Excellent): 0

Grade B (Very good): B

Grade C (Good): 0

Grade D (Fair): 0

Grade E (Poor): 0

P-Reviewer: Moradi L S-Editor: Liu M L-Editor: Filipodia P-Editor: Wang LYT

References
1.  Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry. 2015;56:345-365.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1917]  [Cited by in F6Publishing: 2069]  [Article Influence: 229.9]  [Reference Citation Analysis (0)]
2.  Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R. Prior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort. Arch Gen Psychiatry. 2003;60:709-717.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1383]  [Cited by in F6Publishing: 1301]  [Article Influence: 62.0]  [Reference Citation Analysis (0)]
3.  Woodward LJ, Fergusson DM. Life course outcomes of young people with anxiety disorders in adolescence. J Am Acad Child Adolesc Psychiatry. 2001;40:1086-1093.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 662]  [Cited by in F6Publishing: 581]  [Article Influence: 25.3]  [Reference Citation Analysis (0)]
4.  Hill C, Waite P, Creswell C. Anxiety disorders in children and adolescents. Paediatr Child Health. 2016;26:548-553.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 13]  [Cited by in F6Publishing: 7]  [Article Influence: 0.9]  [Reference Citation Analysis (0)]
5.  Ford T, Goodman R, Meltzer H. The British Child and Adolescent Mental Health Survey 1999: the prevalence of DSM-IV disorders. J Am Acad Child Adolesc Psychiatry. 2003;42:1203-1211.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 829]  [Cited by in F6Publishing: 867]  [Article Influence: 41.3]  [Reference Citation Analysis (0)]
6.  Borkovec TD, Robinson E, Pruzinsky T, DePree JA. Preliminary exploration of worry: some characteristics and processes. Behav Res Ther. 1983;21:9-16.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 840]  [Cited by in F6Publishing: 736]  [Article Influence: 18.0]  [Reference Citation Analysis (0)]
7.  Watkins ER. Constructive and unconstructive repetitive thought. Psychol Bull. 2008;134:163-206.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1457]  [Cited by in F6Publishing: 1263]  [Article Influence: 78.9]  [Reference Citation Analysis (0)]
8.  Muris P, Merckelbach H, Meesters C, Van Den Brand K. Cognitive development and worry in normal children. Cognit Ther Res. 2002;26:775-787.  [PubMed]  [DOI]  [Cited in This Article: ]
9.  Muris P, Merckelbach H, Gadet B, Moulaert V. Fears, worries, and scary dreams in 4- to 12-year-old children: their content, developmental pattern, and origins. J Clin Child Psychol. 2000;29:43-52.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 186]  [Cited by in F6Publishing: 150]  [Article Influence: 6.3]  [Reference Citation Analysis (0)]
10.  Weems CF, Silverman WK, La Greca AM. What do youth referred for anxiety problems worry about? J Abnorm Child Psychol. 2000;28:63-72.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 89]  [Cited by in F6Publishing: 91]  [Article Influence: 3.8]  [Reference Citation Analysis (0)]
11.  Esbjørn BH, Reinholdt-Dunne ML, Caspersen ID, Christensen LB, Chorpita BF. Penn State Worry Questionnaire: Findings Form Normative and Clinical Samples in Denmark. J Psychopathol Behav Assess. 2013;35:113-122.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 20]  [Cited by in F6Publishing: 20]  [Article Influence: 1.7]  [Reference Citation Analysis (0)]
12.  Perrin S, Last CG. Worrisome thoughts in children clinically referred for anxiety disorder. J Clin Child Psychol. 1997;26:181-189.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 43]  [Cited by in F6Publishing: 44]  [Article Influence: 1.6]  [Reference Citation Analysis (0)]
13.  Wilson C. Pathological Worry in Children: What is Currently Known? J Exp Psychopathol. 2010;1:6-33.  [PubMed]  [DOI]  [Cited in This Article: ]
14.  Remschidt H, Schmidt M, Poustka F.   Multiaxiales Klassifikationsschema für psychische Störungen des Kindes- und Jugendalters nach ICD-10 der WHO: Mit einem synoptischen Vergleich von ICD-10 und DSM-IV. 7th ed. Bern: Hogrefe, 2017.  [PubMed]  [DOI]  [Cited in This Article: ]
15.  Flavell JH. Metacognition and cognitive monitoring: A new area of cognitive-developmental inquiry. Am Psychol. 1979;34:906-911.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4026]  [Cited by in F6Publishing: 4137]  [Article Influence: 91.9]  [Reference Citation Analysis (0)]
16.  Fisher PL, Wells A. Experimental modification of beliefs in obsessive-compulsive disorder: a test of the metacognitive model. Behav Res Ther. 2005;43:821-829.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 85]  [Cited by in F6Publishing: 70]  [Article Influence: 3.5]  [Reference Citation Analysis (0)]
17.  Papageorgiou C, Wells A. Metacognitive beliefs about rumination in recurrent major depression. Cogn Behav Pract. 2001;8:160-164.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 214]  [Cited by in F6Publishing: 213]  [Article Influence: 9.3]  [Reference Citation Analysis (0)]
18.  Papageorgiou C, Wells A. An empirical test of a clinical metacognitive model of rumination and depression. Cognit Ther Res. 2003;27:261-273.  [PubMed]  [DOI]  [Cited in This Article: ]
19.  Wells A. Meta-Cognition and Worry: A Cognitive Model of Generalized Anxiety Disorder. Behav Cogn Psychother. 1995;23:301-320.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 483]  [Cited by in F6Publishing: 486]  [Article Influence: 32.4]  [Reference Citation Analysis (0)]
20.  Wells A. A cognitive model of generalized anxiety disorder. Behav Modif. 1999;23:526-555.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 83]  [Cited by in F6Publishing: 74]  [Article Influence: 3.0]  [Reference Citation Analysis (0)]
21.  Wells A. The metacognitive model of GAD: Assessment of meta-worry and relationship with DSM-IV generalized anxiety disorder. Cognit Ther Res. 2005;29:107-121.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 165]  [Cited by in F6Publishing: 168]  [Article Influence: 8.8]  [Reference Citation Analysis (0)]
22.  Cartwright-Hatton S, Wells A. Beliefs about worry and intrusions: the Meta-Cognitions Questionnaire and its correlates. J Anxiety Disord. 1997;11:279-296.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 560]  [Cited by in F6Publishing: 474]  [Article Influence: 17.6]  [Reference Citation Analysis (0)]
23.  Esbjørn BH, Lønfeldt NN, Nielsen SK, Reinholdt-Dunne ML, Sømhovd MJ, Cartwright-Hatton S. Meta-worry, worry, and anxiety in children and adolescents: relationships and interactions. J Clin Child Adolesc Psychol. 2015;44:145-156.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 34]  [Cited by in F6Publishing: 27]  [Article Influence: 2.7]  [Reference Citation Analysis (0)]
24.  Ellis DM, Hudson J. Test of the Metacognitive Model of Generalized Anxiety Disorder in Anxiety-Disordered Adolescents. J Exp Psychopathol. 2011;2:28-43.  [PubMed]  [DOI]  [Cited in This Article: ]
25.  Hearn CS, Donovan CL, Spence SH, March S. A worrying trend in Social Anxiety: To what degree are worry and its cognitive factors associated with youth Social Anxiety Disorder? J Affect Disord. 2017;208:33-40.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 20]  [Cited by in F6Publishing: 20]  [Article Influence: 2.9]  [Reference Citation Analysis (0)]
26.  Hearn CS, Donovan CL, Spence SH, March S. Do worry and its associated cognitive variables alter following CBT treatment in a youth population with Social Anxiety Disorder? J Anxiety Disord. 2018;53:46-57.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 11]  [Cited by in F6Publishing: 11]  [Article Influence: 1.8]  [Reference Citation Analysis (0)]
27.  Bacow TL, May JE, Brody LR, Pincus DB. Are there specific metacognitive processes associated with anxiety disorders in youth? Psychol Res Behav Manag. 2010;3:81-90.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 19]  [Cited by in F6Publishing: 20]  [Article Influence: 1.4]  [Reference Citation Analysis (0)]
28.  Bacow TL, Pincus DB, Ehrenreich JT, Brody LR. The metacognitions questionnaire for children: development and validation in a clinical sample of children and adolescents with anxiety disorders. J Anxiety Disord. 2009;23:727-736.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 90]  [Cited by in F6Publishing: 75]  [Article Influence: 5.0]  [Reference Citation Analysis (0)]
29.  Ellis DM, Hudson JL. The metacognitive model of generalized anxiety disorder in children and adolescents. Clin Child Fam Psychol Rev. 2010;13:151-163.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 59]  [Cited by in F6Publishing: 49]  [Article Influence: 3.8]  [Reference Citation Analysis (0)]
30.  White JA, Hudson JL. The Metacognitive Model of Anxiety in Children: Towards a Reliable and Valid Measure. Cognit Ther Res. 2016;40:92-106.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 14]  [Cited by in F6Publishing: 11]  [Article Influence: 1.2]  [Reference Citation Analysis (0)]
31.  Kuhn D  Metacognitive Development. In: Balter L, Tamis-LeMonda C. Child Psychology: A handbook of contemporary issues. Philadelphia: Psychology Press, 1999: 259–286.  [PubMed]  [DOI]  [Cited in This Article: ]
32.  Estes D, Wellman HM, Woolley JD.   Children’s Understanding of Mental Phenomena. In: Advances in Child Development and Behavior. San Diego: Academic Press, 1989: 41–87.  [PubMed]  [DOI]  [Cited in This Article: ]
33.  Flavell JH, Miller P.   Social cognition. In: Damon W, Kuhn D. Handbook of child psychology. New York: Wiley, 1997: 851-898.  [PubMed]  [DOI]  [Cited in This Article: ]
34.  Flavell JH. Cognitive development: children's knowledge about the mind. Annu Rev Psychol. 1999;50:21-45.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 438]  [Cited by in F6Publishing: 337]  [Article Influence: 13.5]  [Reference Citation Analysis (0)]
35.  Flavell JH, Green FL, Flavell ER. The mind has a mind of its own: Developing knowledge about mental uncontrollability. Cogn Dev. 1998;13:127-138.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 62]  [Cited by in F6Publishing: 62]  [Article Influence: 2.4]  [Reference Citation Analysis (0)]
36.  Marulis LM, Palincsar AS, Berhenke AL, Whitebread D. Assessing metacognitive knowledge in 3–5 year olds: the development of a metacognitive knowledge interview (McKI). Metacognit Learn. 2016;11:339-368.  [PubMed]  [DOI]  [Cited in This Article: ]
37.  Myers SG, Solem S, Wells A. The Metacognitions Questionnaire and Its Derivatives in Children and Adolescents: A Systematic Review of Psychometric Properties. Front Psychol. 2019;10:1871.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9]  [Cited by in F6Publishing: 14]  [Article Influence: 2.8]  [Reference Citation Analysis (0)]
38.  Moher D, Liberati A, Tetzlaff J, Altman DG; PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 47017]  [Cited by in F6Publishing: 45079]  [Article Influence: 3005.3]  [Reference Citation Analysis (0)]
39.  Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA; PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 15040]  [Cited by in F6Publishing: 14729]  [Article Influence: 1636.6]  [Reference Citation Analysis (1)]
40.  American Psychiatric Association  Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Arlingon (VA): American Psychiatric Publishing, 2013.  [PubMed]  [DOI]  [Cited in This Article: ]
41.  Downes MJ, Brennan ML, Williams HC, Dean RS. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open. 2016;6:e011458.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 794]  [Cited by in F6Publishing: 1102]  [Article Influence: 137.8]  [Reference Citation Analysis (0)]
42.  Koo TK, Li MY. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016;15:155-163.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 9979]  [Cited by in F6Publishing: 13690]  [Article Influence: 1711.3]  [Reference Citation Analysis (0)]
43.  Cohen J. A power primer. Psychol Bull. 1992;112:155-159.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 493]  [Cited by in F6Publishing: 5904]  [Article Influence: 393.6]  [Reference Citation Analysis (0)]
44.  The Cochrane Collaboration  Review Manager (RevMan). [cited 10 January 2021]. Available from: https://training.cochrane.org/online-learning/core-software-cochrane-reviews/revman.  [PubMed]  [DOI]  [Cited in This Article: ]
45.  IntHout J, Ioannidis JP, Rovers MM, Goeman JJ. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open. 2016;6:e010247.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 688]  [Cited by in F6Publishing: 1019]  [Article Influence: 127.4]  [Reference Citation Analysis (0)]
46.  Borenstein M, Higgins JP, Hedges LV, Rothstein HR. Basics of meta-analysis: I2 is not an absolute measure of heterogeneity. Res Synth Methods. 2017;8:5-18.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 720]  [Cited by in F6Publishing: 971]  [Article Influence: 138.7]  [Reference Citation Analysis (0)]
47.  Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327:557-560.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 39087]  [Cited by in F6Publishing: 43911]  [Article Influence: 2091.0]  [Reference Citation Analysis (1)]
48.  Beheshti A, Chavanon M-L, Albrecht B, Christiansen H.   Meta-Mar: a free online meta-analysis service. [cited 10 January 2021]. In: Meta-Mar [Internet]. Available from: https://www.meta-mar.com/.  [PubMed]  [DOI]  [Cited in This Article: ]
49.  Benedetto L, La Fauci E, Ingrassia M. Exploring meta-worry and perceived parenting behaviors in adolescents’ anxiety. Life Span Disabil. 2018;2:117-141.  [PubMed]  [DOI]  [Cited in This Article: ]
50.  Francis R, Hawes DJ, Abbott M, Costa DSJ. Development and Preliminary Validation of the Threat Appraisal Questionnaire for Children (TAQ-C). J Psychopathol Behav Assess. 2017;39:322-341.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 2]  [Cited by in F6Publishing: 1]  [Article Influence: 0.1]  [Reference Citation Analysis (0)]
51.  Francis R, Hawes DJ, Abbott MJ, Costa DSJ. Cognitive mechanisms for worry in early adolescence: Re-examining the role of high verbal intelligence. Pers Individ Dif. 2018;120:179-184.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 4]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
52.  Smith KE, Hudson JL. Metacognitive beliefs and processes in clinical anxiety in children. J Clin Child Adolesc Psychol. 2013;42:590-602.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 36]  [Cited by in F6Publishing: 30]  [Article Influence: 2.7]  [Reference Citation Analysis (1)]
53.  Cartwright-Hatton S, Mather A, Illingworth V, Brocki J, Harrington R, Wells A. Development and preliminary validation of the Meta-cognitions Questionnaire-Adolescent Version. J Anxiety Disord. 2004;18:411-422.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 83]  [Cited by in F6Publishing: 75]  [Article Influence: 3.8]  [Reference Citation Analysis (0)]
54.  Zimmermann M, Glemser M, Ertle A. Dysfunktionale Metakognitionen im Jugendalter: Psychometrische Evaluation einer deutschsprachigen Version des Meta-cognitions Questionaire - Adolescent Version (MCQ-A). Z Kinder Jugendpsychiatr Psychother. 2018;47:264-273.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 1]  [Cited by in F6Publishing: 1]  [Article Influence: 0.2]  [Reference Citation Analysis (0)]
55.  Babaei S, Ranjbar Varandi S, Hatami Z, Gharechahi M. Metacognition Beliefs and General Health in Predicting Alexithymia in Students. Glob J Health Sci. 2015;8:117-125.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 5]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
56.  Esbjørn BH, Normann N, Christiansen BM, Reinholdt-Dunne ML. The efficacy of group metacognitive therapy for children (MCT-c) with generalized anxiety disorder: An open trial. J Anxiety Disord. 2018;53:16-21.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 26]  [Cited by in F6Publishing: 19]  [Article Influence: 3.2]  [Reference Citation Analysis (0)]
57.  Fergus TA, Limbers CA. Reducing Test Anxiety in School Settings: A Controlled Pilot Study Examining a Group Format Delivery of the Attention Training Technique Among Adolescent Students. Behav Ther. 2019;50:803-816.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 6]  [Cited by in F6Publishing: 6]  [Article Influence: 1.2]  [Reference Citation Analysis (0)]
58.  Holmes MC, Donovan CL, Farrell LJ, March S. The efficacy of a group-based, disorder-specific treatment program for childhood GAD--a randomized controlled trial. Behav Res Ther. 2014;61:122-135.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 38]  [Cited by in F6Publishing: 28]  [Article Influence: 2.8]  [Reference Citation Analysis (0)]
59.  Holmes MC, Donovan CL, Farrell LJ. A Disorder-Specific, Cognitively Focused Group Treatment for Childhood Generalized Anxiety Disorder: Development and Case Illustration of the No Worries! J Cogn Psychother. 2015;29:275-301.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 5]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
60.  Normann N, Lønfeldt NN, Reinholdt-Dunne ML, Esbjørn BH. Negative Thoughts and Metacognitions in Anxious Children Following CBT. Cognit Ther Res. 2016;40:188-197.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 6]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
61.  Sanger KL, Dorjee D. Mindfulness training with adolescents enhances metacognition and the inhibition of irrelevant stimuli: Evidence from event-related brain potentials. Trends Neurosci Educ. 2016;5:1-11.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 36]  [Cited by in F6Publishing: 16]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
62.  Simons M, Vloet TD. Emetophobia - A Metacognitive Therapeutic Approach for an Overlooked Disorder. Z Kinder Jugendpsychiatr Psychother. 2018;46:57-66.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 4]  [Article Influence: 0.5]  [Reference Citation Analysis (0)]
63.  Thorslund J, McEvoy PM, Anderson RA. Group metacognitive therapy for adolescents with anxiety and depressive disorders: A pilot study. J Clin Psychol. 2020;76:625-645.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 7]  [Cited by in F6Publishing: 8]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
64.  Benedetto L, Di Blasi D, Pacicca P. Worry and Meta-Cognitive Beliefs in Childhood Anxiety Disorders. Mediterr J Clin Psychol. 2013;1:1-14.  [PubMed]  [DOI]  [Cited in This Article: ]
65.  Donovan CL, Holmes MC, Farrell LJ, Hearn CS. Thinking about worry: Investigation of the cognitive components of worry in children. J Affect Disord. 2017;208:230-237.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 18]  [Cited by in F6Publishing: 17]  [Article Influence: 2.4]  [Reference Citation Analysis (0)]
66.  Esbjørn BH, Sømhovd MJ, Holm JM, Lønfeldt NN, Bender PK, Nielsen SK, Reinholdt-Dunne ML. A structural assessment of the 30-item Metacognitions Questionnaire for Children and its relations to anxiety symptoms. Psychol Assess. 2013;25:1211-1219.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 25]  [Cited by in F6Publishing: 25]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
67.  Gini G, Marino C, Spada MM. The Role of Metacognitions and Thinking Styles in the Negative Outcomes of Adolescents' Peer Victimization. Violence Vict. 2019;34:752-769.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 8]  [Cited by in F6Publishing: 7]  [Article Influence: 1.4]  [Reference Citation Analysis (0)]
68.  Naumann L  Understanding and assessing worrying - analyzing relevant psychopathological mechanisms relevant for generalized anxiety disorder across the lifespan. Doctoral Thesis, The University of Cologne. 2014. Available from: https://kups.ub.uni-koeln.de/6135/.  [PubMed]  [DOI]  [Cited in This Article: ]
69.  Wilson C, Hall M. Thought control strategies in adolescents: links with OCD symptoms and meta-cognitive beliefs. Behav Cogn Psychother. 2012;40:438-451.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 10]  [Article Influence: 0.8]  [Reference Citation Analysis (0)]
70.  Wilson C, Hughes C. Worry, beliefs about worry and problem solving in young children. Behav Cogn Psychother. 2011;39:507-521.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 31]  [Cited by in F6Publishing: 31]  [Article Influence: 2.6]  [Reference Citation Analysis (0)]
71.  Laugesen N, Dugas MJ, Bukowski WM. Understanding adolescent worry: the application of a cognitive model. J Abnorm Child Psychol. 2003;31:55-64.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 144]  [Cited by in F6Publishing: 145]  [Article Influence: 6.9]  [Reference Citation Analysis (0)]
72.  Carr I, Szabó M. Worry in Children: Changing Associations With Fear, Thinking, and Problem-Solving. J Early Adolesc. 2015;35:120-135.  [PubMed]  [DOI]  [Cited in This Article: ]
73.  Fisak B, Mentuccia M, Przeworski A. Meta-worry in adolescents: examination of the psychometric properties of the meta-worry questionnaire in an adolescent sample. Behav Cogn Psychother. 2014;42:491-496.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 10]  [Article Influence: 0.9]  [Reference Citation Analysis (0)]
74.  Hearn CS, Donovan CL, Spence SH, March S, Holmes MC. What's the Worry with Social Anxiety? Child Psychiatry Hum Dev. 2017;48:786-795.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 26]  [Cited by in F6Publishing: 23]  [Article Influence: 3.3]  [Reference Citation Analysis (0)]
75.  Kertz S, Woodruff-Borden J. The role of metacognition, intolerance of uncertainty, and negative problem orientation in children's worry. Behav Cogn Psychother. 2013;41:243-248.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 31]  [Cited by in F6Publishing: 31]  [Article Influence: 2.6]  [Reference Citation Analysis (0)]
76.  Lønfeldt NN, Esbjørn BH, Normann N, Breinholst S, Francis SE. Do Mother’s Metacognitions, Beliefs, and Behaviors Predict Child Anxiety-Related Metacognitions? Child Youth Care Forum. 2017;46:577-599.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 5]  [Cited by in F6Publishing: 5]  [Article Influence: 0.7]  [Reference Citation Analysis (0)]
77.  Lønfeldt NN, Marin CE, Silverman WK, Reinholdt-Dunne ML, Esbjørn BH. The Role of Metacognitions in the Association between Children’s Perceptions of Maternal Control and Anxiety. J Child Fam Stud. 2017;26:1398-1408.  [PubMed]  [DOI]  [Cited in This Article: ]
78.  Irak M. Standardization of Turkish form of metacognition questionnaire for children and adolescents: the relationships with anxiety and obsessive-compulsive symptoms. Turk Psikiyatri Derg. 2012;23:46-52.  [PubMed]  [DOI]  [Cited in This Article: ]
79.  Reinholdt-Dunne ML, Blicher A, Nordahl H, Normann N, Esbjørn BH, Wells A. Modeling the Relationships Between Metacognitive Beliefs, Attention Control and Symptoms in Children With and Without Anxiety Disorders: A Test of the S-REF Model. Front Psychol. 2019;10:1205.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 14]  [Cited by in F6Publishing: 14]  [Article Influence: 2.8]  [Reference Citation Analysis (0)]
80.  Donovan CL, Holmes MC, Farrell LJ. Investigation of the cognitive variables associated with worry in children with Generalised Anxiety Disorder and their parents. J Affect Disord. 2016;192:1-7.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 19]  [Cited by in F6Publishing: 18]  [Article Influence: 2.3]  [Reference Citation Analysis (0)]
81.  Matthews L, Reynolds S, Derisley J. Examining Cognitive Models of Obsessive Compulsive Disorder in Adolescents. Behav Cogn Psychother. 2006;35:149-163.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 32]  [Cited by in F6Publishing: 31]  [Article Influence: 1.7]  [Reference Citation Analysis (0)]
82.  Wilson C, Budd B, Chernin R, King H, Leddy A, Maclennan F, Mallandain I. The role of meta-cognition and parenting in adolescent worry. J Anxiety Disord. 2011;25:71-79.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 26]  [Cited by in F6Publishing: 26]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
83.  Wells A, Cartwright-Hatton S. A short form of the metacognitions questionnaire: properties of the MCQ-30. Behav Res Ther. 2004;42:385-396.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 696]  [Cited by in F6Publishing: 699]  [Article Influence: 35.0]  [Reference Citation Analysis (0)]
84.  Gosselin P, Ladouceur R, Langlois F, Freeston MH, Dugas MJ, Bertrand J. Development and validation of a new instrument to evaluate erroneous beliefs about worries. Eur Rev Appl Psychol. 2003;53:199-211.  [PubMed]  [DOI]  [Cited in This Article: ]
85.  Cho Y, Jahng S, Chai S. The factor structure and concurrent validity of the Korean version of the Metacognitions Questionnaire 30 (K-MCQ-30). J Clin Psychol. 2012;68:349-391.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 17]  [Cited by in F6Publishing: 17]  [Article Influence: 1.4]  [Reference Citation Analysis (0)]
86.  Quattropani MC, Lenzo V, Mucciardi M, Toffle ME. Psychometric properties of the Italian version of the Short Form of the Metacognitions Questionnaire (MCQ-30). Boll di Psicol Appl. 2014;62:29-41.  [PubMed]  [DOI]  [Cited in This Article: ]
87.  Hempel S, Miles JN, Booth MJ, Wang Z, Morton SC, Shekelle PG. Risk of bias: a simulation study of power to detect study-level moderator effects in meta-analysis. Syst Rev. 2013;2:107.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 85]  [Cited by in F6Publishing: 78]  [Article Influence: 7.1]  [Reference Citation Analysis (0)]
88.  Bacow TL  Metacognitive processes in anxious children: Associations with diagnostic status. Doctoral Thesis, The University of Boston, 2008.  [PubMed]  [DOI]  [Cited in This Article: ]
89.  Baker WL, White CM, Cappelleri JC, Kluger J, Coleman CI; Health Outcomes, Policy, and Economics (HOPE) Collaborative Group. Understanding heterogeneity in meta-analysis: the role of meta-regression. Int J Clin Pract. 2009;63:1426-1434.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 246]  [Cited by in F6Publishing: 294]  [Article Influence: 19.6]  [Reference Citation Analysis (0)]
90.  American Psychiatric Association  Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Arlingon (VA): American Psychiatric Publishing, 1994.  [PubMed]  [DOI]  [Cited in This Article: ]
91.  Nunnaly JC, Bernstein IH.   Psychometric Theory. 3rd ed. New York: McGraw-Hill, 1994.  [PubMed]  [DOI]  [Cited in This Article: ]
92.  Boysan M, Kadak MT, Tarakcioglu MC, Sertdurak ZS, Demirel OF. Psychometric Properties of Turkish versions of the Leyton Obsessional Inventory-Child Version (LOI-CV) and Obsessive Beliefs Questionnaire-Child Version (OBQ-CV). Klin Psikofarmakol Bülteni-Bulletin Clin Psychopharmacol. 2016;26:382-396.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 4]  [Cited by in F6Publishing: 4]  [Article Influence: 0.6]  [Reference Citation Analysis (0)]
93.  Esbjørn BH, Normann N, Lønfeldt NN, Tolstrup M, Reinholdt-Dunne ML. Exploring the relationships between maternal and child metacognitions and child anxiety. Scand J Psychol. 2016;57:201-206.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 10]  [Cited by in F6Publishing: 10]  [Article Influence: 1.4]  [Reference Citation Analysis (0)]
94.  Gallagher B, Cartwright-Hatton S. The relationship between parenting factors and trait anxiety: mediating role of cognitive errors and metacognition. J Anxiety Disord. 2008;22:722-733.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 48]  [Cited by in F6Publishing: 48]  [Article Influence: 3.0]  [Reference Citation Analysis (0)]
95.  Mather A, Cartwright-Hatton S. Cognitive predictors of obsessive-compulsive symptoms in adolescence: a preliminary investigation. J Clin Child Adolesc Psychol. 2004;33:743-749.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 40]  [Cited by in F6Publishing: 40]  [Article Influence: 2.0]  [Reference Citation Analysis (0)]
96.  Yavuz M, Altan B, Bayrak B, Gündüz M, Bolat N. The relationships between nomophobia, alexithymia and metacognitive problems in an adolescent population. Turk J Pediatr. 2019;61:345-351.  [PubMed]  [DOI]  [Cited in This Article: ]  [Cited by in Crossref: 12]  [Cited by in F6Publishing: 15]  [Article Influence: 3.8]  [Reference Citation Analysis (0)]