Skip to main content
Download PDF

Study protocol of a factorial trial ECHO: optimizing a group-based school intervention for children with emotional problems

BMC Psychology volume 9, Article number: 97 (2021) Cite this article

Abstract

Background

Youth mental health problems are a major public health concern. Anxiety and depression are among the most common psychological difficulties. The aim of this study is to evaluate an optimized version of a promising indicated group intervention for emotional problems. The program (EMOTION Coping Kids Managing Anxiety and Depression) targets school children 8–12 years with anxious and depressive symptoms and examines three factors. Factor 1 compares the standard EMOTION intervention delivered in 16 group-based sessions (Group), versus a partially-digital EMOTION intervention (DIGGI) delivered as eight group sessions and eight digital sessions. Both versions use virtual reality technology (VR) to improve behavioral experiments. Factor 2 compares parent participation in a 5-session parent group (high involvement) versus sharing information with parents via a brochure (low involvement). Factor 3 compares the use of a measurement and feedback system (MFS) designed to help group leaders tailor the intervention using feedback from children with no MFS.

Methods

Using a cluster-randomized factorial design, 40 schools across Norway will be randomized to eight different experimental conditions based on three, two-level factors. To assess internalizing symptoms in children, children and their parents will be given self-report questionnaires pre-, post-, and one year after intervention. Parents also report on demographics, user satisfaction, personal symptoms and perception of family related factors. Teachers report on child symptoms and school functioning. Group leaders and the head of the municipal services report on implementation issues. The primary outcomes are changes in depressive and anxious symptoms. Some secondary outcomes are changes in self-esteem, quality of life, and user satisfaction. Questions regarding the consequences of the COVID-19 pandemic are included. Treatment fidelity is based on checklists from group leaders, and on user data from the participating children.

Discussion

This study is a collaboration between three regional centers for child and adolescent mental health in Norway. It will provide knowledge about: (1) the effect of school-based preventive interventions on anxiety and depression in children; (2) the effect of feedback informed health systems, (3) the effect and cost of digital health interventions for children, and (4) the effect of parental involvement.

Peer Review reports

Background

Mental health problems in children are a major public health concern. Anxiety disorders are among the most common psychological difficulties, with studies indicating that 23.9% of children 6–8 years and 31.9% of adolescents have had an anxiety disorder at some point during their life [1]. Depression is also common, with studies indicating that up to 14.3% of adolescents have had a depressive episode [2]. Yet, anxiety and depression in children often go undetected in the specialist services in Norway [3]. Moreover, subthreshold anxiety and depression, which also considerably reduces daily functioning, may affect even larger numbers of children [4]. From 2015, the responsibility for treating mild to moderate depression and anxiety in Norway shifted from specialized mental health clinics to first line services [5]. There is, therefore, a great need for standardized assessments and interventions in first line services.

Promising interventions for emotional problems

Developing integrated evidence-based interventions (EBI) that target multiple, but related, emotional problems (i.e., a transdiagnostic approach), has been an important task for the research group involved in the ECHO study. The study uses an optimized version of the EMOTION intervention [6]. The EMOTION intervention is based on cognitive behavioral therapy (CBT) with parental involvement. Our research group recently conducted a randomized controlled trial (RCT), the TIM study, in 36 schools (N = 873) across seven municipalities in Norway [7]. Screening of 1686 children in this study identified 48% with high symptom levels of anxiety or depression. Outcome results were positive and indicated that the intervention can reduce symptoms of anxiety and depression and that the services would benefit from optimized screening and intervention methods [8,9,10]. International research supports these results [11], reporting medium to large effect sizes (0.38–0.79) for selective and indicated interventions. The same study suggested that further investigation is needed to optimize effects when interventions are transferred into routine practice.

ECHO explores three factors that might optimize effects: (1) combining the psychosocial intervention with a Measurement Feedback System (MFS), (2) combining traditional interventions and internet-based interventions, (3) including parents in the intervention.

MFS

In ECHO, group leaders can tailor the intervention for each child through a MFS. New results concerning the registration of personal aims in MFS for adolescents [12] indicate that MFS can support the service provider in enhancing the co-operation with youth and help them stay focused on the aims of the intervention. Results from a Cochrane report [13] on the effect of client feedback identified different MFS instruments that can be used in child health care. These instruments suffer, however, from use of measures that are not well-validated, have a rigid structure, are not adaptable, or are too costly in use for large-scale distribution [14].

Internet-based interventions

One of the areas that was highlighted by the group leaders in the TIM study was the overall length of the intervention. Meta-analyses indicate that internet-based interventions that reduce intervention costs have the potential to provide small to moderate effect-sizes when targeting anxious and depressive symptoms within traditional interventions [15]. To explore this further, the ECHO study evaluates the standard version of EMOTION with a revised, digital version (DIGGI) that conducts half of the sessions in an online format.

Parental involvement

Involving parents in CBT interventions targeting depression and anxiety in children can have a positive effect on treatment outcomes [16]. Yet, parental involvement has also yielded mixed results [17]. While it may be desirable to include parents in separate parent groups, resources to be able to run these groups are scarce in first line services. It can also be difficult for some parents to attend parent meetings.

The aims of examining these factors are to enable the group leader to tailor the intervention through feedback for the specific child, to facilitate implementation in the services, provide easier access for the children through digital sessions, and make behavioral experiments more accessible and realistic for the children through use of VR technology. Including parents may have the potential to support the intervention directed to the child. Integrating self-directed internet-based sessions along with traditional group meetings and the distribution of self-help materials to parents may reduce costs.

The elements mentioned above have not previously been evaluated together while optimizing an intervention. They constitute three factors and are related components that, properly combined, should form the strongest intervention outcomes. It is therefore useful that our multifactorial design allows for the testing of interactions as well as main effects (factors), in a design with equal distribution of all factors within each main effect [18]. Promising advances are also offered through use of new technology such as internet-based sessions and virtual reality (VR) technology. Behavioural experiments constitute an essential approach in CBT. VR technology that provides realistic situations can facilitate the child’s need for gradual exposure to situations that might otherwise result in avoidance or sadness. Through these VR situations, the group leaders establish stimulus control and similar situations can be rehearsed several times [19]. While not its own factor, the use of VR was included in both versions of the EMOTION intervention (Factor 2) because of its strong potential to improve outcomes.

Method/design

The present study is a cluster randomized factorial design, with three factors, each with two levels, giving eight different experimental conditions randomized to schools across three regions in Norway: south-east, central, and north. Each of the 40 recruited schools will therefore be randomly assigned to one of the experimental conditions resulting in five schools per condition (see Table 1).

Table 1 Experimental conditions of ECHO project
Full size table

The stages of the enrollment, intervention, and assessment can be seen in Table 2.

Table 2 SPIRIT table for evaluation of the ECHO study
Full size table

Recruitment and eligibility criteria

School-aged children between eight and twelve years old from third to sixth grade are eligible for participation. The planned recruitment period of children and families lasts for a maximum of two and a half years, starting in spring 2020 until spring 2022. The recruitment of schools starts autumn 2019.

School eligibility will be determined by region of the country and municipality. School-size is a recruitment criterion, as the participating schools need to have at least one full class in each grade to increase the probability of recruiting enough children to run an EMOTION group. The study will be presented to key personnel (principals at schools, heads of different primary care health agencies) at each site. The person responsible for each site or health agency will sign a statement of intention to participate in the study, while interested schools will also sign an agreement to participate in the study and are asked to nominate a contact person. The intervention will be offered each semester (autumn/spring term) of each school year. The plan is to include an average of five children from each grade in each school every semester, but group size may vary with between three and seven children per group. The children are screened prior to participation (T1) and assessed after the intervention (T2) (see Table 2). One year after the end of the intervention, the children will complete the same self-report measures to identify possible long-term effects (T3), an important goal for all preventive interventions. Responsibilities of school contacts include informing teachers and parents at the targeted grades about the study and facilitating the completion of the child surveys at the measurement times (T1-T3). Children are presented with age-appropriate oral and written information about the study. Parents are informed about the study during parental meetings and receive a link to detailed written information and electronic consent. Parents are invited to consent on the child`s behalf if they consider that their child has more sad or anxious feelings than peers and the child wishes to participate in a group. Both parents (or one parent with single parent care) must provide a consent before a child can participate. Presentations and videoclips are available to help recruit schools and children. The recruitment of participants is reported in accordance with the Consolidated Standards of Reporting Trials (CONSORT) guidelines for clustered randomized trials [20]. A project webpage (https://www.echo.r-bup.no) is developed to enhance the communication between all participants.

Inclusion criteria

After informed consent is provided by the parents, children self-report on the Mood and Feeling Questionnaire – Short form for depression (SMFQ) [21, 22] and Multidimensional Anxiety Scale for Children (MASC-C) [23]. The MASC-C is a 39 items self-report assessing anxiety in children and adolescents between 8 and 19 years. The SMFQ [21] is a 13-items measure assessing cognitive, affective, and behavioral-related symptoms of depression in children aged 8–18 years, with one added question about suicidality. Children who score at least one standard deviation above the expected mean score for depression (SMFQ; M = 3.8, SD 3.6, inclusion ≥ 7 points), anxiety (MASC-C; girls M = 46, SD 15, inclusion ≥ 61 points; boys M = 39, SD 15, inclusion ≥ 54), or both, are then invited to join the study. Mean score on the MASC-C is based on Olason, Sighvatsson [24] and Villabø, Gere [25]. Mean score on the SMFQ is based on Angold, Erkanli [26] and Rhew, Simpson [22].

Exclusion criteria

There are few exclusion criteria. Children who may not benefit from a group intervention (e.g., language problems, severe cognitive or developmental challenges) are considered individually and exclusion is approved by the local PI. The reasons for exclusion are documented according to CONSORT guidelines.

Intervention care and supervision

Intervention

The eight possible combinations of the factors MFS (yes/no), EMOTION (Group/DIGGI) and parental involvement (high/low), are used to create a unique intervention focusing on selected intervention elements.

Measurement-feedback system (MFS)

In close cooperation with the University of Oslo, we have developed the MittEcho App (Norwegian, MyEcho translated) to address limitations of existing MFS, including the use of not well-validated measures and a monetized approach. The MittEcho App is freely accessible and compatible for most versions of IOS and android operating systems. MittEcho gives children the opportunity to assess their own progress by evaluating three idiographic goals established by the children, and by measuring their symptom levels derived from the Behavior and Feeling Schedule ([27]; 6 items). All MittEcho results are sent from the App to a secure, digital platform; The Service for Sensitive Data (TSD). The MittEcho publication portal is part of TSD and is a platform that group leaders access to gain access to graphical displays of the participants’ collected feedback. Group leaders apply for secure access to the MittEcho publication portal using their national, digital ID. The data storage and sharing services at TSD comply with the General Data Protection Regulation (GDPR).

Group (16 sessions) versus a partially digital (8 + 8 sessions) EMOTION version

The indicated transdiagnostic intervention EMOTION [28] has been revised for this study to an intensive course that runs over 16 sessions for 8 weeks. EMOTION is based on CBT. The first half of the intervention focuses on building skills, psychoeducation, emotion regulation, and behavioral activation. The second half focuses on practicing skills, maintaining activation, cognitive restructuring and behavioral experiments. In the traditional group version, all 16 sessions are conducted in a group-setting at school lead by two trained group leaders. In the partially digital version (DIGGI), eight selected sessions are conducted in a group setting, while eight are delivered as internet-based automated sessions in which children work on their own at home (approximately every other session internet-based). The digital sessions created for DIGGI are child-friendly and provide examples and possibilities for rehearsal of coping strategies through fun activities requiring little writing. For the purpose of this study, DIGGI sessions are published on a platform that enables the collection of user data.

Both versions of the revised EMOTION intervention use VR during group sessions to conduct behavioral experiments in addition to in-vivo behavioral experiments. VR has the potential to create realistic situations using 3-D videos with head-mounted display to support behavioral experiments. For this purpose, several short VR films have been created, showing challenging scenes in the daily life of a school child (e.g., classroom presentation with different levels of difficulty to accommodate the child’s need to handle difficult feelings and approach avoided situations). Each VR film generates questions to the child about feelings and thoughts in the situations.

High versus low parental involvement

In high parental involvement condition, parents will be invited to participate in a 5-session EMOTION parent group [29]. In three of the five parent sessions, the child participates together with the parents. The groups will be running parallel to the child sessions with similar and complementary topics. The parenting sessions focus on creating a supportive home environment for the children as well as transferring and practicing new skills together with the children in joint group meetings. In the low parental involvement condition parents are presented to a self-help brochure [30] providing age-appropriate information and advice about anxiety and depression.

Supervision

To support the group leaders in the delivery of the intervention conditions, they will attend regular supervision conducted by a trained cognitive behavioral supervisor. The supervisors, in turn, will receive support from the study coordinating central office (RBUP East and South). Group leaders are also asked to complete fidelity check lists for each session of the intervention.

Procedure

The study is registered at clinical trials (NCT04263558) and is funded by a grant from the Kavli Trust Programme on Health Research (project number 31/18). Additional funding for the project is provided by The Center for Child and Adolescent Mental Health – Eastern and Southern Norway (RBUP East and South) and The Regional Centers for Child and Youth Mental Health and Child Welfare – Northern Norway and Central Norway (RKBU North and RKBU Central, respectively).

Randomization

Participants are randomized at the school-level. The schools are randomized into one of the eight different experimental conditions. Each school agrees on participation for approximately five semesters, entailing five waves of data collection. The school randomization procedure is carried out in the statistical software R, using a function specifically written for the ECHO study by the project statistician in collaboration with key personnel. The actual randomization (running the R function) is witnessed by an objective third party. The function takes two important aspects into account: (1) a balanced distribution of schools to the eight factors, even if the number of schools will be uneven, e.g. in case of new schools, and (2) a balanced distribution of the varying workload caused by the different conditions. The latter is to assure that it is not possible to overload a service provider with assignment of multiple resource demanding intervention conditions.

The randomization procedure was performed in two steps. In the first step, the municipalities were allocated to the two most demanding conditions. These municipalities were randomly drawn proportional to the number of schools within the municipality to ensure that each school had approximately the same probability of being allocated to one of these conditions. After the municipalities were selected, one random school was selected within each municipality. In stage 2, the remaining schools were allocated to the remaining conditions. The function that was used first sorted schools by size, then divided them into size groups equal to the number of remaining conditions. If one of the remaining conditions was allocated to only five schools, one size group was subsequently selected to have this condition reduced. Within the size groups the schools were randomly allocated to the remaining conditions so that the correct number of schools are allocated to each condition.

For practical reasons, the EMOTION groups are limited to seven participants. When too many children are eligible based on the results of the screening procedure, seven of the eligible children are randomly invited to child-groups. The randomization is performed through an automated process in our data collection system through which the children also respond to the screening survey. The procedure ensures that it is random which of the eligible students are first offered to be included. It is important that also this selection is random, and not based on non-random factors such as who first completed the assessment, assessment scores, or a school contacts personal assessment of who (out of a list of eligible students) might benefit most from the intervention.

The parents of the children who are excluded through this randomization procedure, are informed why their child is not invited to a group.

Blinding

Because of the nature of the current interventions, it is not possible for the participants to be unaware of the intervention condition they are assigned to after baseline. Furthermore, schools are randomized to one of the conditions for the entire project period. Therefore, most of the participants are aware of the treatment condition prior to the baseline assessment.

Outcomes

Data are collected at three time points: T1 (pre intervention), T2 (post intervention) and T3 (1-year post intervention follow-up). Parents, teachers, group leaders, and service leaders receive unique links to electronic surveys via email or SMS. Children use unique, confidential identifiers to access the child-survey using computers at school. Because of the children’s ages, an adult is present while they complete the questionnaire in order to clarify potentially confusing questions. Both parents are asked to complete the parent survey separately.

All measures have good psychometric properties and have been adapted and used in Norway as well as in international studies. We will use symptom measures that are free of charge (e.g. Revised Children`s Anxiety and Depression Scale, RCADS, 31) together with established copyright protected instruments (e.g. MASC), aiming to develop measures and a MFS system with good psychometric properties that is free to use for all service providers.

Primary outcomes

The primary outcomes of interest for this study are changes in level of depression and anxiety from pre- to post-intervention and from pre-intervention to follow-up. The null hypotheses for the primary outcomes of this study are that there will be no differences in changes of depression or anxiety scores between the three factors (main effects). The primary outcome measures will be based on two informants: children and parents.

Depression is assessed using the SMFQ [21], a 13-item measure assessing cognitive, affective, and behavioral-related symptoms of depression in children 8–18 years. Anxiety is assessed using the MASC-C/P [23], a 39-items self-report measure for adolescents between 8 and 19 years. Parents will use the parent version of the same instruments.

Secondary outcomes

See Table 3.

Table 3 Table for secondary outcomes in the ECHO study
Full size table

Demographic information is collected from the service provider, group leaders, children and parents.

Recruitment and participation

Recruitment and participation data will be reported for available data from baseline.

Participant retention

Contact with participants’ families is maintained by school personnel and automatically generated reminders to complete questionnaires are sent via email or SMS.

Data management

Data will be obtained via electronic surveys from parents, teachers and children, using web-based questionnaires at baseline (T1), immediately after the intervention (T2), and at 12-month follow-up (T3). Data from group leaders and service leaders will also be obtained through electronic surveys, but at different time points than the other informants. Data are collected and managed by an independent data collection team at the study coordinating central office (RBUP East and South). The systems meet requirements for data security and EU’s data protection regulation (GDPR). Data analysis and data cleaning will be performed by the study investigators. Data are stored on a secure server during the study and analysis of results. Project staff have access to the final trial dataset. Upon completion of the study, the data are anonymized and archived according to Norwegian law. Data collected with the Mitt Echo App will be obtained every week of the intervention from children in schools assigned to the MFS condition. User data (e.g. time and duration of use) from the children and group leaders in this condition will be accessible. Canvas (a learning and communication platform) will produce user data from children assigned to the digital condition (DIGGI) and be collected.

Data analysis

The study is carried out in schools and therefore data analyses will be conducted in a multilevel modeling framework to account for non-independence of the participants at the school level.

Sample size

The power estimation was based on an assumption of independence in the data (see Table 4, line A). The power was then adjusted on the need for a multi-level approach, as cases will be clustered in schools (see Table 4, line B) [32, 33]. The desired significance level is p = 0.05 and power is 0.80. The following additional conditions were accounted for: (1) anticipated effect size (d) of the main factors: 0.25 (conservative estimate), (2) the intraclass correlation coefficient (ICC): 0.05 (estimate is based on the level of school affiliation in Norway) [34], (2) average size of the clusters = 20 (i.e.: number of individuals within each school in a 24-month intervention period). Ukoumunne and colleagues’ equations ([33]; page 31 and 32) and Altman’s recommendations are used [35].

The total of individuals should be at least N = 796 across 40 schools. With eight experimental conditions, 5 schools will be assigned to each condition. With 40 schools, 20 children per school will be needed (see Table 4, line B).

Table 4 Number of participants and clusters required in a multilevel study
Full size table

Planned statistical analysis

Several models will be run to test for the main treatment outcomes, implementation outcomes, and related research questions.

The analyses will involve changes in outcome variables. A combination of linear mixed models and latent growth curve analyses will be used to identify differences between treatment groups, as well as change rates in growth over time. Based on the experience from the previous study, the rate of missing data due to electronic data collection will be low. Otherwise, missing data will be accounted for using full information maximum likelihood in growth curve analyses and restricted maximum likelihood techniques in mixed effects models where applicable, well-established techniques that allow for the inclusion of all available data.

To investigate the psychometric properties of some instruments initial exploratory factor analyses will be performed to investigate which factors we are able to obtain from our sample. Further, confirmatory factor analysis will be used. Correlations between subscales will be computed using Pearson’s r. Internal consistency for the subscales will be measured with Cronbach’s alpha.

Data monitoring committee

There is no formal establishment of a data monitoring committee for this project; this is generally not considered a necessary function for a research project of this type.

Cost

The costs of the interventions are evaluated by calculating direct costs related to material, training, trainer payment, supervision, salary to group leaders for attending training, supervision, conducting sessions, and costs with the technical MFS platform. An estimate of per-child costs is included in the final report to funders, along with additional estimates of costs incurred by the trial research team.

Discussion

The present study will promote much needed research and innovation for optimizing service provision in first line health services to aid the alarmingly high number of school children who suffer from clinical and subthreshold levels of anxiety and depression. The effect of different versions of an evidence-based intervention for these children will be assessed using a cluster randomized design involving 40 schools across Norway. The aim is to create a framework that allows more evidence-based psychosocial interventions to be provided at a lower cost to society.

National collaboration

The study is an active collaboration project between three regional centers in Norway responsible for work with mental health problems among children and adolescents: RKBU-north, RKBU-central, and RBUP east and south.

International collaboration

Professor Philip C. Kendall at Temple University in Philadelphia, PA, USA and Dr. Linda Collins have been involved in the project planning, design and are involved in advising, data analysis, and publication of results.

Trial status

The trial began recruiting schools in autumn 2019 (Actual Study Start Date, February 13, 2020) and is continuing through spring of 2022. Data collection pre/post will finish in spring/autumn 2022 with the last follow up assessment autumn 2023.

Trial registration: Clinical Trials NCT04263558, first posted on February 11, 2020, last updated on January 25, 2021.

Secondary registration: Kavli Trust Programme on Health Research (31/18).

Primary sponsor: The Center for Child and Adolescent Mental Health – Eastern and Southern Norway (RBUP East and South), Gullhaugveien 1–3, 0484 Oslo, mail@r-bup.no and.

Protocol version: November 2020.

Ethics and dissemination

Changes to the protocol

Changes to the project are made in the Standard Operating Procedures. These changes are recorded and maintained by the central investigator from RBUP East and South. Changes which are not merely procedural but may impact the experience of the participants in the study are reported to the Regional Committees for Medical and Health Research Ethics for approval.

Confidentiality

Study participants are provided study IDs. A study key with the participant’s name and ID are stored in a secure internal server at RBUP East and South, separate from the participants survey answers and user data. That is, researchers only access and analyze deidentified personal data. Reporting of outcomes will be done using aggregate data.

Contact for scientific inquiries should be addressed to the central scientific investigator, Simon-Peter Neumer, simon-peter.neumer@r-bup.no.

Dissemination of results will be through scientific publications, the project webpage, reports to the funder, and press releases to news media. Three Ph.D. students who are part of the project team will publish and publicly defend dissertations relating to the study. Planned scientific publications include primary outcomes, secondary outcomes, psychometrics, and implementation results. The project team has adopted the Vancouver Protocol for determination of authorship of scientific publications.

Availability of data and materials

Datasets will be available from the corresponding author on reasonable request.

Abbreviations

ASEBA:

Achenbach System of Empirically Based Assessment

BFS:

Behavior and Feelings Survey

BPM-P/T:

Brief Problem Monitoring-parent/teacher version

BSCIY:

Beck Self-Concept Inventory for Youth

CBCL:

Child Behavior Checklist

CBT:

Cognitive Behavioral Therapy

CONSORT:

Consolidated Standards of Reporting Trials

COVID-19:

Coronavirus disease 2019

DEFF:

Design effect

DIGGI:

Partially digital version of EMOTION intervention

EBI:

Evidence-Based Intervention

EBP:

Attitudes towards evidence-based practice

EBPAS:

The Evidence-Based Practice Attitude Scale

EMOTION:

Coping Kids Managing Anxiety and Depression Program

ERC:

The Emotion Regulation Checklist

FAD:

Family Assessment Device

GDPR:

General Data Protection Regulation

GSE:

General Self-Efficacy Scale

HSCL-10:

Hopkins Symptoms Checklist

ICC:

Intra-class correlation coefficient

ICS:

Implementation Climate Scale

ILS:

Implementation Leadership Scale

KINDL:

Children quality of life questionnaire [Kinder Lebensqualität Fragebogen]

MASC-C/P:

Multidimensional Anxiety Scale for children/parent version

MFS:

Measurement Feedback System

PIE:

Post-intervention questionnaire

PARCADS:

Parenting to Reduce Child Anxiety and Depression Scale

PBI:

Parental Bonding Instrument

RBUP:

Regional center for child and adolescent mental health, east and south

RCADS:

Revised Child Anxiety and Depression Scale

RCT:

Randomized Controlled Trial

RKBU:

Regional center for child and adolescent mental health and child welfare

SD:

Standard Deviation

SMFQ:

Mood and Feeling Questionnaire – Short form

TRF:

Teacher’s Report Form

TWQ:

Total Workload Questionnaire

VR:

Virtual Reality

References

  1. Merikangas KR, He J-P, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: Results from the National Comorbidity Survey Replication-Adolescent Supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49(10):980–9.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Costello E, Mustillo S, Erkanli A, Keeler G, Angold A. Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry. 2003;60(8):837–44.

    Article  PubMed  Google Scholar 

  3. Folkehelseinstituttet. Helsetilstanden i Norge. Folkehelserapporten – kortversjon. Oslo: Folkehelseinstituttet; 2018.

  4. Balazs J, Miklosi M, Kereszteny A, Hoven CW, Carli V, Wasserman C, et al. Adolescent subthreshold-depression and anxiety: Psychopathology, functional impairment and increased suicide risk. J Child Psychol Psychiatry. 2013;54(6):670–7.

    Article  PubMed  Google Scholar 

  5. Nygaard E, Kårikstad V. Prioriteringsveileder psykisk helsevern for barn og unge Oslo: Helsedirektoratet; 2015.

  6. Martinsen K, Stark KD, Rodriguez K, Kendall PC, Arora P. Mestrende barn: foreldremanual. Oslo: Gyldendal akademisk; 2014.

    Google Scholar 

  7. Patras J, Martinsen KD, Holen S, Sund AM, Adolfsen F, Rasmussen LP, et al. Study protocol of an RCT of EMOTION: An indicated intervention for children with symptoms of anxiety and depression. BMC Psychol. 2016;4(1):48.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Loevaas MES, Lydersen S, Sund AM, Neumer SP, Martinsen KD, Holen S, et al. A 12-month follow-up of a transdiagnostic indicated prevention of internalizing symptoms in school-aged children: the results from the EMOTION study. Child Adolesc Psychiatry Ment Health. 2020;14(1):15.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Martinsen K, Rasmussen LMP, Wentzel-Larsen T, Holen S, Sund AM, Lovaas MES, et al. Prevention of anxiety and depression in school children: Effectiveness of the transdiagnostic EMOTION program. J Consult Clin Psychol. 2018.

  10. Rasmussen L-MP, Patras J, Neumer S-P, Adolfsen F, Martinsen KD, Holen S, et al. Facilitators and barriers to the implementation of EMOTION: an indicated intervention for young schoolchildren. Scand J Educ Res. 2020;64(5):728–43.

    Article  Google Scholar 

  11. Mychailyszyn MP, Brodman DM, Read KL, Kendall PC. Cognitive-behavioral school-based interventions for anxious and depressed youth: a meta-analysis of outcomes. Clin Psychol. 2012;19(2):129–53.

    Google Scholar 

  12. Tollefsen TK, Darrow SM, Lohne V, Berg-Nielsen TS. Experiences with using an idiographic assessment procedure in primary mental health care services for adolescents. Int J Qual Stud Health Well-being. 2020;15(1):1763741.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Bergman H, Kornør H, Nikolakopoulou A, Hanssen‐Bauer K, Soares‐Weiser K, Tollefsen TK, et al. Client feedback in psychological therapy for children and adolescents with mental health problems. Cochrane Database Syst Rev. 2018(8).

  14. Lyon AR, Lewis CC, Boyd MR, Hendrix E, Liu F. Capabilities and characteristics of digital measurement feedback systems: results from a comprehensive review. Adm Policy Ment Health. 2016;43(3):441–66.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Hollis C, Falconer CJ, Martin JL, Whittington C, Stockton S, Glazebrook C, et al. Annual research review: digital health interventions for children and young people with mental health problems—a systematic and meta-review. J Child Psychol Psychiatry. 2017;58(4):474–503.

    Article  PubMed  Google Scholar 

  16. Brendel KE, Maynard BR. Child–parent interventions for childhood anxiety disorders: a systematic review and meta-analysis. Res Soc Work Pract. 2014;24(3):287–95.

    Article  Google Scholar 

  17. Silverman WK, Pina AA, Viswesvaran C. Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. J Clin Child Adolesc Psychol. 2008;37(1):105–30.

    Article  PubMed  Google Scholar 

  18. Collins LM, Dziak JJ, Kugler KC, Trail JB. Factorial experiments: efficient tools for evaluation of intervention components. Am J Prev Med. 2014;47(4):498–504.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Freeman D, Reeve S, Robinson A, Ehlers A, Clark D, Spanlang B, et al. Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol Med. 2017;47(14):2393–400.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Campbell MK, Elbourne DR, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328(7441):702–8.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Angold A, Costello EJ, Messer SC, Pickles A. Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res. 1995;5(4):237–49.

    Google Scholar 

  22. Rhew IC, Simpson K, Tracy M, Lymp J, McCauley E, Tsuang D, et al. Criterion validity of the Short Mood and Feelings Questionnaire and one- and two-item depression screens in young adolescents. Child Adolesc Psychiatry Ment Health. 2010;4:8.

    Article  PubMed  PubMed Central  Google Scholar 

  23. March JS, Parker JDA, Sullivan K, Stallings P, Conners CK. The Multidimensional Anxiety Scale for Children (MASC): factor structure, reliability, and validity. J Am Acad Child Adolesc Psychiatry. 1997;36(4):554–65.

    Article  PubMed  Google Scholar 

  24. Olason DT, Sighvatsson MB, Smami J. Psychometric properties of the Multidimensional Anxiety Scale for Children (MASC) among Icelandic schoolchildren. Scand J Psychol. 2004;45(5):429–36.

    Article  PubMed  Google Scholar 

  25. Villabø M, Gere M, Torgersen S, March JS, Kendall PC. Diagnostic efficiency of the child and parent versions of the Multidimensional Anxiety Scale for Children. J Clin Child Adolesc Psychol Off J Soc Clin Child Adolesc Psychol Am Psychol Assoc Div. 2012;41(1):75–85.

    Google Scholar 

  26. Angold A, Erkanli A, Silberg J, Eaves L, Costello E. Depression scale scores in 8–17-year-olds: effects of age and gender. J Child Psychol Psychiatry. 2002;43(8):1052–63.

    Article  PubMed  Google Scholar 

  27. Weisz JR, Vaughn-Coaxum RA, Evans SC, Thomassin K, Hersh J, Lee EH, et al. Efficient monitoring of treatment response during youth psychotherapy: the behavior and feelings survey. J Clin Child Adolesc Psychol Off J Soc Clin Child Adolesc Psychol Am Psychol Assoc Div. 2019;53:1–15.

    Google Scholar 

  28. Martinsen K, Kendall PC, Stark K, Rodriguez K, Arora P. Mestrende barn : gruppeledermanual barn. 2nd ed. Oslo: Gyldendal akademisk; 2017.

    Google Scholar 

  29. Martinsen K, Stark K, Rodriguez K, Kendall PC, Arora P. Mestrende barn : gruppeledermanual foreldre. 2nd ed. Oslo: Gyldendal akademisk; 2017.

    Google Scholar 

  30. ECHO. Hvordan støtte barnet ditt? En veileder til foreldre med triste og engstelige barn. [Brochure]. Trondheim: RKBU, NTNU; 2019.

  31. Chorpita BF, Yim L, Moffitt C, Umemoto LA, Francis SE. Assessment of symptoms of DSM-IV anxiety and depression in children: a revised child anxiety and depression scale. Behav Res Ther. 2000;38(8):835–55.

    Article  PubMed  Google Scholar 

  32. Faul F, Erdfelder E, Buchner A, Lang AG. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41(4):1149–60.

    Article  PubMed  Google Scholar 

  33. Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG. Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999;3(5).

  34. Holen S, Waaktaar T, Lervag A, Ystgaard M. The effectiveness of a universal school-based programme on coping and mental health: a randomised, controlled study of Zippy’s Friends. Educ Psychol. 2012;32(5):657–77.

    Article  Google Scholar 

  35. Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991.

    Google Scholar 

  36. Beck AT, Brown GK, Steer RA. BDI-II, Beck depression inventory: manual. San Antonio, Tex.: Psychological Corp.; 1996. VI, 38 s. p.

  37. Runyon MK, Steer RA, Deblinger E. Psychometric characteristics of the beck self-concept inventory for youth with adolescents who have experienced sexual abuse. J Psychopathol Behav Assess. 2009;31(2):129–36.

    Article  Google Scholar 

  38. Schwarzer R, Jerusalem M. The general self-efficacy scale (GSE). Anxiety Stress Coping. 2010;12:329–45.

    Google Scholar 

  39. Romppel M, Herrmann-Lingen C, Wachter R, Edelmann F, Düngen HD, Pieske B, et al. A short form of the General Self-Efficacy Scale (GSE-6): development, psychometric properties and validity in an intercultural non-clinical sample and a sample of patients at risk for heart failure. Psycho-Soc Med. 2013;10

  40. Ravens-Sieberer U, Gortler E, Bullinger M. Subjective health and health behavior of children and adolescents–a survey of Hamburg students within the scope of school medical examination. Gesundheitswesen. 2000;62(3):148–55.

    Article  PubMed  Google Scholar 

  41. Haraldstad K, Richter J. Måleegenskaper ved den norske versjonen av KIDSCREEN. PsykTestBarn. 2014.

  42. Chorpita BF, Moffitt CE, Gray J. Psychometric properties of the Revised Child Anxiety and Depression Scale in a clinical sample. Behav Res Ther. 2005;43(3):309–22.

    Article  PubMed  Google Scholar 

  43. Rapee RM, Wignall A, Sheffield J, Kowalenko N, Davis A, McLoone J, et al. Adolescents’ reactions to universal and indicated prevention programs for depression: perceived stigma and consumer satisfaction. Prev Sci. 2006;7(2):167–77.

    Article  PubMed  Google Scholar 

  44. Tollefsen TK, Neumer S-P, Berg-Nielsen TS. “What matters to you?”: a randomized controlled effectiveness trial, Using Systematic Idiographic Assessment as an intervention to Increase Adolescents’ perceived control of their mental health. J Adolesc. 2020;78:53–61.

    Article  PubMed  Google Scholar 

  45. Achenbach TM, Rescorla L. Manual for the ASEBA school-age forms & profiles: child behavior checklist for ages 6–18, teacher's report form, youth self-report: an integrated system of multi-informant assessment. Burlington, Vt.: ASEBA; 2001. XII, 238 s. p.

  46. Backer-Grøndahl A, Martinussen M. Måleegenskaper ved den norske versjonen av Brief Problem Monitor (BPM). PsykTestBARN [Internet]. 2018; 8(1). Available from: https://psyktestbarn.r-bup.no/no/artikler/bpm-brief-problem-monitor.

  47. Martinussen M, Adolfsen F, Lauritzen C, Richardsen AM. Improving interprofessional collaboration in a community setting: relationships with burnout, engagement and service quality. J Interprof Care. 2012;26(3):219–25.

    Article  PubMed  Google Scholar 

  48. Mårdberg B, Lundberg U, Frankenhaeuser M. The total workload of parents employed in white-collar jobs: construction of a questionnaire and scoring system. Stockholm: Department of Psychology, University of Stockholm; 1990.

    Google Scholar 

  49. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014;9(1):1–11.

    Article  Google Scholar 

  50. Egeland KM, Skar A-MS, Endsjø M, Laukvik EH, Bækkelund H, Babaii A, et al. Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: a stepped-wedge cluster randomized design study protocol. Implement Sci. 2019;14(1):28.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Aarons GA, Ehrhart MG, Farahnak LR. The implementation leadership scale (ILS): development of a brief measure of unit level implementation leadership. Implement Sci. 2014;9(1):1–10.

    Article  Google Scholar 

  52. Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Res Soc Work Pract. 2009;19(5):531–40.

    Article  Google Scholar 

  53. Bird HR, Shaffer D, Fisher P, Gould MS, et al. The Columbia Impairment Scale (CIS): Pilot findings on a measure of global impairment for children and adolescents. Int J Methods Psychiatr Res. 1993;3(3):167–76.

    Google Scholar 

  54. Bird HR, Andrews H, Schwab-Stone M, Goodman S, Dulcan M, Richters J, et al. Global measures of impairment for epidemiologic and clinical use with children and adolescents. Int J Methods Psychiatr Res. 1996;6(4):295–307.

    Article  Google Scholar 

  55. Sim WH, Jorm AF, Lawrence KA, Yap MBH. Development and evaluation of the Parenting to Reduce Child Anxiety and Depression Scale (PaRCADS): assessment of parental concordance with guidelines for the prevention of child anxiety and depression. PeerJ. 2019;7:6865.

    Article  Google Scholar 

  56. Epstein NB, Baldwin LM, Bishop DS. The McMaster family assessment device. J Marital Fam Ther. 1983;9(2):171–80.

    Article  Google Scholar 

  57. Byles J, Byrne C, Boyle MH, Offord DR. Ontario Child Health Study: reliability and validity of the general functioning subscale of the McMaster Family Assessment Device. Fam Process. 1988;27(1):97–104.

    Article  PubMed  Google Scholar 

  58. Parker G, Tupling H, Brown L. A parental bonding instrument. Br J Med Psychol. 2011;52:1–10.

    Article  Google Scholar 

  59. Cox BJ, Enns MW, Clara IP. The Parental Bonding Instrument: confirmatory evidence for a three-factor model in a psychiatric clinical sample and in the National Comorbidity Survey. Soc Psychiatry Psychiatr Epidemiol. 2000;35(8):353–7.

    Article  PubMed  Google Scholar 

  60. Rimehaug T, Wallander J, Berg-Nielsen T. Group and individual stability of three parenting dimensions. Child Adolesc Psychiatry Ment Health. 2011;5:19.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Kleppang AL, Hagquist C. The psychometric properties of the Hopkins Symptom Checklist-10: a Rasch analysis based on adolescent data from Norway. Fam Pract. 2016;33(6):740–5.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We acknowledge the Kavli Trust as the main source of funding for the ECHO study.

Funding

The Kavli Trust Programme on Health Research (31/18), provides primary funding. Additional funding is provided by the Regional Center for Child and Adolescent Mental Health, Eastern and Southern Norway (RBUP East and South), Regional Centre for Child and Youth Mental Health and Child Welfare – Central Norway (RKBU Central), Regional Centre for Child and Youth Mental Health and Child Welfare – Northern Norway (RKBU North). The Kavli Trust Programme on Health Research is not involved in the design, analysis, nor interpretation of the study results. RBUP East and South, RKBU Central, and RKBU North are host organizations of the authors; the authors are solely responsible for the design of the study, collection, analysis, interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

  1. The Center for Child and Adolescent Mental Health – Eastern and Southern Norway, Postboks 4623, 0405, Nydalen, Oslo, Norway

    Simon-Peter Neumer, Solveig Holen, Carina Lisøy, Anne Liv Askeland, Annette Jeneson, Tore Wentzel-Larsen & Kristin Martinsen

  2. The Regional Centre for Child and Youth Mental Health and Child Welfare – Northern Norway, RKBU Nord UiT Norges Arktiske Universitet, 9037, Tromsø, Norway

    Simon-Peter Neumer, Joshua Patras, Ida Mari Haug, Frode Adolfsen & Lene-Mari Potulski Rasmussen

  3. The Regional Centre for Child and Youth Mental Health and Child Welfare – Central Norway, MTFS, Pb 8905, 7491, Trondheim, Norway

    Jo Magne Ingul, Kristin Ytreland, Elisabeth Valmyr Bania & Anne Mari Sund

  4. St.Olavs Hospital, Trondheim University Hospital, Prinsesse Kristinas gate 3, 7030, Trondheim, Norway

    Anne Mari Sund

  5. Department of Psychology, University of Oslo, Forskningsveien 3A, 0373, Oslo, Norway

    Kristin Martinsen

  6. Norwegian Centre for Violence and Traumatic Stress Studies, 0484, Oslo, Norway

    Tore Wentzel-Larsen

Authors
  1. Simon-Peter Neumer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joshua Patras
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Solveig Holen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carina Lisøy
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Anne Liv Askeland
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ida Mari Haug
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Annette Jeneson
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Tore Wentzel-Larsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Frode Adolfsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Lene-Mari Potulski Rasmussen
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jo Magne Ingul
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Kristin Ytreland
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Elisabeth Valmyr Bania
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Anne Mari Sund
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Kristin Martinsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have read and provided substantial contributions to the final version of the study protocol. SPN is the central and principal investigator of the project and is responsible for drafting the initial proposal with all subsequent revisions and for drafting the final protocol for publication. JP is responsible for contributing to initial project proposal. KM is the principal investigator for the study in Southern and Eastern Norway. She is responsible for drafting the latest version of the proposal and developing the EMOTION intervention. SH is responsible for drafting the latest version of the proposal and is the co-investigator for the study in Southern and Eastern Norway. JMI is responsible for contributing to revisions of the protocol and is the principal investigator in Central Norway. AMS is responsible for contributing to revisions of the protocol and is the co-investigator in Central Norway. FA is responsible for contributing to revisions of the protocol and is the principal-investigator in Northern Norway. LMR is a researcher responsible for contributing to revisions of the protocol. CL, IMH and KY are Ph.D. candidates who together with researcher EVB have contributed to the latest version of the protocol. TWL is the project statistician and has contributed to the development of the proposal and study protocol with a special focus on statistical procedures. AJ is the head of the research support team in the central office responsible for developing the data collection system and has contributed to revisions of the protocol. ALA is the project coordinator in the central office and has contributed to revisions of the protocol. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Simon-Peter Neumer.

Ethics declarations

Ethics approval and consent

The ethics approval for the study was given by the Regional Committees for Medical and Health Research Ethics (REK; https://helseforskning.etikkom.no), reference number 28761 Echo/REK sør-øst B. The consent obtained from the study participants is written. Parents of children who are interested in group participation can go to the ECHO website where detailed information sheets and electronic consent forms are found during the participant recruitment phase of each data collection wave. For a child to participate in the study, both parents must complete an electronic consent form on behalf of the child (sole-custodians may consent alone on behalf of the child). We anticipate a relatively low risk of harm for participating, as EMOTION is based largely on known effective methods for treating anxiety and depressive symptoms (i.e., cognitive behavioral therapy) and to our knowledge no risks of harm are reported for the other factors in the study. RBUP East and South and the Norwegian Center for Research Data have also made a Data Protection Impact Assessment that is approved by all participating centers.

Consent for publication

Not applicable.

Competing Interests

Kristin Martinsen receives royalties from the sale of the Norwegian version of the EMOTION program manuals and workbooks. None of the other authors have competing interests related to the publication of this protocol.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Post-intervention questionnaire (PIE).

Additional file 2

. COVID-19 questions child.

Additional file 3

. COVID-19 questions parents.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Neumer, SP., Patras, J., Holen, S. et al. Study protocol of a factorial trial ECHO: optimizing a group-based school intervention for children with emotional problems. BMC Psychol 9, 97 (2021). https://doi.org/10.1186/s40359-021-00581-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40359-021-00581-y

Keywords

BMC Psychology

ISSN: 2050-7283

Contact us