Hostname: page-component-8448b6f56d-tj2md Total loading time: 0 Render date: 2024-04-18T07:12:21.372Z Has data issue: false hasContentIssue false
  • English
  • Français

Treatment Integrity and Social Validity of the FRIENDS for Life Programme in a Northeastern Canadian School System

Published online by Cambridge University Press:  16 April 2020

Susan Doyle ,
Sarah E. Francis Open the ORCID record for Sarah E. Francis [Opens in a new window]  and
Rhonda Joy
Susan Doyle
Affiliation:
Department of Psychology, University of Toledo, Toledo, Ohio, USA
Sarah E. Francis*
Affiliation:
Department of Psychology, University of Toledo, Toledo, Ohio, USA
Rhonda Joy
Affiliation:
Faculty of Education, Memorial University of Newfoundland, St. John's, Newfoundland, Canada
*
*Corresponding author: Sarah E. Francis, Department of Psychology, University of Toledo, 2801 West Bancroft St., Toledo, OH43606-3390, USA. Email: sarah.francis@utoledo.edu
Get access

Abstract

The FRIENDS for Life (FFL) programme, a school-based anxiety prevention programme, targets anxiety reduction and resiliency development in elementary school-aged children (Barrett, Sonderegger & Xenos, 2003). In the context of equivocal effectiveness findings regarding FFL in Canadian schools, the present study assessed pre–post changes in anxiety, self-esteem, and prosocial behaviour in a school system in Northeastern Canada. To yield further insight to the potential sources of equivocal FFL effectiveness findings, we also evaluated FFL treatment integrity (TI) and social validity (SV). Few studies have assessed FFL TI at the level of identifying which programme sessions, or within-session content, have or have not been adhered to (Higgins & O'Sullivan S, 2015). Similarly, few studies have provided detailed programme SV data or perceived programme benefits by children and parents. TI and SV can provide programme data beyond anxiety reduction, which is key in prevention programming research, as pre–post changes are challenging to detect in ‘healthy’ samples (Durlak & Wells, 1997). Treatment outcome, TI, and SV data were collected from classrooms across 10 elementary schools administering FFL. The sample included 210 child and 108 parent participants; post-testing occurred 1 week following FFL programme completion. Findings indicated significant decreases from pre- to post-test in child-reported anxiety and self-esteem but no changes in prosocial behaviours. Findings suggest that low TI ratings may have impacted anxiety, self-esteem, and prosocial behaviour results, and that child-reported SV may be more related to programme outcomes than parent-reported SV. Implications for FFL programme developers and future FFL evaluation studies are discussed.

Keywords

treatment integritysocial validitychild anxiety prevention programmingschool-based mental health programming
Type
Standard Paper
Information
Behaviour Change , Volume 37 , Issue 2 , June 2020 , pp. 74 - 92
Copyright
Copyright © The Author(s) 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ahlen, J, Breitholtz, E, Barrett, PM and Gallegos, J (2012). School-based prevention of anxiety and depression: A pilot study in Sweden. Advances in School Mental Health Promotion, 5, 246–257. doi:10.1080/1754730X.2012.730352CrossRefGoogle Scholar
Barrett, PM (2000). Treatment of childhood anxiety: Developmental aspects. Clinical Psychology Review, 20, 479–494. doi:S0272-7358(99)00038-0CrossRefGoogle ScholarPubMed
Barrett, PM (2004). FRIENDS for Life: Group leaders manual for children. Bowen Hills, Australia: Australian Academic Press.Google Scholar
Barrett, PM (2005) Support Materials for the FRIENDS program. Brisbane, Australia: Pathways Health and Research Centre.Google Scholar
Barrett, PM, Lowry-Webster, HM and Turner, CM (1999). FRIENDS program social validity and treatment integrity scales. Brisbane, Australia: Australian Academic Press.Google Scholar
Barrett, PM, Sonderegger, R and Sonderegger, NL (2001). Evaluation of an anxiety-prevention and positive-coping program (FRIENDS) for children and adolescents of non-English-speaking background. Behaviour Change, 18, 78–91. doi:10.1375/bech.18.2.78CrossRefGoogle Scholar
Barrett, PM, Shortt, AL, Fox, TL and Wescombe, K (2001). Examining the social validity of the FRIENDS treatment program for anxious children. Behaviour Change, 18, 63–77. doi:10.1375/bech.18.2.63CrossRefGoogle Scholar
Barrett, PM, Sonderegger, R and Xenos, S (2003). Using FRIENDS to combat anxiety and adjustment problems among young migrants to Australia: A national trial. Clinical Child Psychology and Psychiatry, 8, 241–260. doi:10.1177/1359104503008002008CrossRefGoogle Scholar
Barrett, PM, Lock, S and Farrell, LJ (2005). Developmental differences in universal preventive intervention for child anxiety. Clinical Child Psychology and Psychiatry, 10, 539–555. doi:10.1177/1359104505056317CrossRefGoogle Scholar
Briesch, AM, Hagermoser Sanetti, LM and Briesch, JM (2010). Reducing the prevalence of anxiety in children and adolescents: An evaluation of the evidence base for the FRIENDS for Life program. School Mental Health, 2, 155–165. doi:0.1007/s12310-010-9042-5CrossRefGoogle Scholar
Brodzinsky, DM, Elias, MJ, Steiger, C, Simon, J, Gill, M and Clarke Hill, J (1992). Coping scale for children and youth: Scale development and validation. Journal of Applied Developmental Psychology, 13, 195–214. doi:10.1016/0193-3973(92)90029-HCrossRefGoogle Scholar
Chorpita, BF, Yim, L, Moffitt, C, Umemoto, LA and Francis, SE (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A Revised Child Anxiety and Depression Scale. Behaviour Research and Therapy, 38, 835–855. doi:10.1016/S0005-7967(99)00130-8CrossRefGoogle ScholarPubMed
Chorpita, BF, Moffitt, CE and Gray, J (2005). Psychometric properties of the Revised Child Anxiety and Depression Scale in a clinical sample. Behavioural Research and Therapy, 43, 309–322. doi:10.1016/j.brat.2004.02.004CrossRefGoogle Scholar
Davies, CD, Niles, AN, Pittig, A, Arch, JJ and Craske, MG (2015). Physiological and behavioural indices of emotion dysregulation as predictors of outcome from cognitive behavioural therapy and acceptance and commitment therapy for anxiety. Journal of Behaviour Therapy and Experimental Psychiatry, 46, 35–43. doi:10.1016/j.jbtep.2014.08.002CrossRefGoogle Scholar
Durlak, JA and DuPre, EP (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0CrossRefGoogle ScholarPubMed
Durlak, JA and Wells, AM (1997). Primary prevention mental health programs for children and adolescents: A meta-analytic review. American Journal of Community Psychology, 25, 115–152. doi:10.1023/A:1024654026646CrossRefGoogle ScholarPubMed
Ebesutani, C, Chorpita, BF, Higa-McMillan, C, Nakamura, BJ, Regan, J and Lynch, RE (2011). A psychometric analysis of the Revised Child Anxiety and Depression Scales – parent version in a school sample. Journal of Abnormal Child Psychology, 39, 173–185. doi:10.1007/s10802-010-9460-8CrossRefGoogle Scholar
Essau, CA, Conradt, J, Sasagawa, S and Ollendick, TH (2012). Prevention of anxiety symptoms in children: Results from a universal school-based trial. Behaviour Therapy, 43, 450–464. doi:10.1016/j.beth.2011.08.003CrossRefGoogle ScholarPubMed
Farrell, LJ, Barrett, P and Claassens, S (2005). Community trial of an evidence-based anxiety intervention for children and adolescents (the FRIENDS program): A pilot study. Behaviour Change, 22, 236–248. doi:10.1375/bech.22.4.236CrossRefGoogle Scholar
Francis, SE and Chorpita, BF (2010). Development and evaluation of the Parental Beliefs about Anxiety Questionnaire. Journal of Psychopathology and Behavioural Assessment, 32, 138–149. doi:10.1007/s10862-009-9133-5CrossRefGoogle Scholar
FRIENDS Resilience (2017). Training. Retrieved from: http://www.friendsresilience.org/shop/Google Scholar
Fryling, MJ, Wallace, MD and Yassine, JN (2012). Impact of treatment integrity on intervention effectiveness. Journal of Applied Behavior Analysis, 45, 449–453. doi:10.1901/jaba.2012.45-449CrossRefGoogle ScholarPubMed
Gallegos-Guajardo, J, Ruvalcaba-Romero, NA, Garza-Tamez, M and Villegas-Guinea, D (2013). Social validity evaluation of the FRIENDS for Life program with Mexican children. Journal of Education and Training Studies, 1, 158–169. doi:10.11114/jets.v1i1.90CrossRefGoogle Scholar
Gallegos-Guajardo, J, Ruvalcaba-Romero, N, Langley, A and Villegas-Guinea, D (2015). Selective prevention for anxiety and resilience promotion: Outcomes of an anxiety prevention and resilience program with girls at risk. Pensando Psicología, 11, 11–23. doi:10.1692/issn.1900-3099CrossRefGoogle Scholar
Gallegos, J, Rodríguez, A, Gómez, G, Rabelo, M and Gutiérrez, MF (2012). The FRIENDS for Life program for Mexican girls living in an orphanage: A pilot study. Behaviour Change, 29, 1–14. doi:10.1017/bec.2012.8CrossRefGoogle Scholar
Gann, CJ and Kunnavatana, SS (2016). A preliminary study in applying the function-based intervention decision model in consultation to increase treatment integrity. Education and Treatment of Children, 39, 445–466. doi:10.1353/etc.2016.0020CrossRefGoogle Scholar
Goodman, R (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. doi:10.1111/j.1469-7610.1997.tb01545.xCrossRefGoogle ScholarPubMed
Goodman, R (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337–1345. doi:10.1097/00004583-200111000-00015CrossRefGoogle ScholarPubMed
Gresham, FM and Lopez, MF (1996). Social validation: A unifying concept for school-based consultation research and practice. School Psychology Quarterly, 11, 204. doi:10.1037/h0088930.CrossRefGoogle Scholar
Gresham, FM, Dart, EH and Collins, TA (2017). Generalizability of multiple measures of treatment integrity: Comparisons among direct observation, permanent products, and self-report. School Psychology Review, 46, 108–121. doi:10.17105/SPR46-1.108-121CrossRefGoogle Scholar
Higgins, E and O'Sullivan, S (2015). “What works”: Systematic review of the “FRIENDS for Life” programme as a universal school-based intervention programme for the prevention of child and youth anxiety. Educational Psychology in Practice, 31, 424–438. doi:10.1080/02667363.2015.1086977CrossRefGoogle Scholar
Hills, PR, Francis, LJ and Thomas, E (2007). The psychometric properties and factor structure of a Welsh translation of the school short form of the Coopersmith Self-Esteem Inventory. Research in Education, 78, 103–109. doi:10.7227/RIE.78.9CrossRefGoogle Scholar
Hills, PR, Francis, LJ and Jennings, P (2011). The school short-form Coopersmith Self-Esteem Inventory: Revised and improved. Canadian Journal of School Psychology, 26, 62–71. doi:10.1177/0829573510397127CrossRefGoogle Scholar
Kessler, RC, Chiu, WT, Demler, O, Merikangas, KR and Walters, EE (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 617–627. doi:10.1001/archpsyc.62.6.617CrossRefGoogle ScholarPubMed
Liaupsin, CJ (2015). Improving treatment integrity through a functional approach to intervention support. Behavioral Disorders, 41, 67–76. doi:10.17988/0198-7429-41.1.67CrossRefGoogle Scholar
Lock, S and Barrett, PM (2003). A longitudinal study of developmental differences in universal preventive intervention for child anxiety. Behaviour Change, 20, 183–199. doi:10.1375/bech.20.4.183.29383CrossRefGoogle Scholar
Lowry-Webster, HM, Barrett, PM and Dadds, MR (2001). A universal prevention trial of anxiety and depressive symptomatology in childhood: Preliminary data from an Australian study. Behaviour Change, 18, 36–50. doi:10.1375/bech.18.1.36CrossRefGoogle Scholar
Maggin, DM and Johnson, AH (2014). A meta-analytic evaluation of the FRIENDS program for preventing anxiety in student populations. Education & Treatment of Children, 37, 277–306. doi:10.1353/etc.2014.0018CrossRefGoogle Scholar
Martens, BK, Witt, JC, Elliott, SN and Darveaux, DX (1985). Teacher judgments concerning the acceptability of school-based interventions. Professional Psychology: Research and Practice, 16, 191. doi:10.1037/0735-7028.16.2.191CrossRefGoogle Scholar
Mental Health Commission of Canada. (2013). Creating Change: Annual Report 2012–2013. Retrieved from: http://www.mentalhealthcommission.ca/English/system/files/private/document/MHCC_Annual_Report_2012-2013_FINAL_ENG.pdfGoogle Scholar
Miller, LD, Laye-Gindhu, A, Bennett, JL, Liu, Y, Gold, S, March, JS and Waechtler, VE (2011). An effectiveness study of a culturally enriched school-based CBT anxiety prevention program. Journal of Clinical Child & Adolescent Psychology, 40, 618–629. doi:10.1080/15374416.2011.581619CrossRefGoogle ScholarPubMed
Nastasi, BK and Truscott, SD (2000). Acceptability research in school psychology: Current trends and future directions. School Psychology Quarterly, 15, 117. doi:10.1037/h0088781CrossRefGoogle Scholar
Reiss, S, Peterson, RA, Gursky, DM and McNally, RJ (1986). Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behaviour Research and Therapy, 24, 1–8. doi:10.1016/0005-7967(86)90143-9CrossRefGoogle ScholarPubMed
Rodgers, A and Dunsmuir, S (2015). A controlled evaluation of the ‘FRIENDS for Life’ emotional resiliency programme on overall anxiety levels, anxiety subtype levels and school adjustment. Child and Adolescent Mental Health, 20, 13–19. doi:10.1111/camh.12030CrossRefGoogle ScholarPubMed
Rose, H, Miller, L and Martinez, Y (2009). ‘FRIENDS for Life’: The results of a resilience-building, anxiety-prevention program in a Canadian elementary school. Professional School Counseling, 12, 400–407. doi:10.5330/PSC.n.2010-12.400CrossRefGoogle Scholar
Ruttledge, R, Devitt, E, Greene, G, Mullany, M, Charles, E, Frehill, J and Moriarty, M (2016). A randomised controlled trial of the FRIENDS for Life emotional resilience programme delivered by teachers in Irish primary schools. Educational & Child Psychology, 33, 69–89.Google Scholar
Schoenfeld, NA and Mathur, SR (2009). Effects of cognitive-behavioral intervention on the school performance of students with emotional or behavioral disorders and anxiety. Behavioral Disorders, 34, 184–195. doi:10.1177/019874290903400401CrossRefGoogle Scholar
Schonert-Reichl, KA, Buote, D, Jaramillo, A and Foulkes, K (2008). Happiness, optimism, and positive psychological traits during pre and early adolescence: Relations to parents, peers, and after school time. In Biennial Meeting of the Society for Research and Adolescence, Chicago, IL .Google Scholar
Schonert-Reichl, KA, Smith, V, Zaidman-Zait, A and Hertzman, C (2012). Promoting children's prosocial behaviours in school: Impact of the “Roots of Empathy” program on the social and emotional competence of school-aged children. School Mental Health, 4, 1–21. doi:10.1007/s12310-011-9064-7CrossRefGoogle Scholar
Silverman, WK, Fleisig, W, Rabian, B and Peterson, RA (1991). Childhood anxiety sensitivity index. Journal of Clinical Child and Adolescent Psychology, 20, 162–168. doi:10.1207/s15374424jccp2002_7CrossRefGoogle Scholar
Silverman, WK, Pina, AA and Viswesvaran, C (2008). Evidence-based psychosocial treatments for phobic and anxiety disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 37, 105–130. doi:10.1080/15374410701817907CrossRefGoogle ScholarPubMed
Stallard, P, Simpson, N, Anderson, S, Carter, T, Osborn, C and Bush, S (2005). An evaluation of the FRIENDS programme: A cognitive behaviour therapy intervention to promote emotional resilience. Archives of Disease in Childhood, 90, 1016–1019. doi:10.1136/adc.2004.068163CrossRefGoogle ScholarPubMed
St. Onge, JR, Stephenson, R and Senthil Kumar, B (2017). Validation of the FRIENDS anxiety prevention program for children in Canada. Canadian Journal of Community Mental Health, 35, 25–40. doi:10.7870/cjcmh-2016-036CrossRefGoogle Scholar
Stopa, JE, Barrett, PM and Golingi, F (2010). The prevention of childhood anxiety in socioeconomically disadvantaged communities: A universal school-based trial. Advances in School Mental Health Promotion, 3, 5–24. doi:10.1080/1754730X.2010.971568CrossRefGoogle Scholar
Strain, PS, Barton, EE and Dunlap, G (2012). Lessons learned about the utility of social validity. Education and Treatment of Children, 35, 183–200. doi:10.1353/etc.2012.0007CrossRefGoogle Scholar
Vostanis, P (2006). Strengths and Difficulties Questionnaire: Research and clinical applications. Current Opinion in Psychiatry, 19, 367–372. doi:10.1097/01.yco.0000228755.72366.05CrossRefGoogle ScholarPubMed
Weems, CF, Taylor, LK, Marks, AB and Varela, RE (2010). Anxiety sensitivity in childhood and adolescence: Parent reports and factors that influence associations with child reports. Cognitive Therapy and Research, 34, 303–315. doi:10.1007/s10608-008-9222-xCrossRefGoogle Scholar
Woerner, W, Fleitlich-Bilyk, B, Martinussen, R, Fletcher, J, Cucchiaro, G, Dalgalarrondo, P and Tannock, R (2004). The Strengths and Difficulties Questionnaire overseas: Evaluations and applications of the SDQ beyond Europe. European Child & Adolescent Psychiatry, 13, 47–54. doi:10.1007/s00787-004-2008-0CrossRefGoogle ScholarPubMed
Wolf, MM (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 1, 203–214. doi:10.1901/jaba.1978.11-203CrossRefGoogle Scholar
Zwaanswijk, M and Kösters, MP (2015). Children's and parents’ evaluations of ‘FRIENDS for Life’, an indicated school-based prevention program for children with symptoms of anxiety and depression. Behaviour Change, 32, 243–254. doi:10.1017/bec.2015.13CrossRefGoogle Scholar