Abstract
Mental health treatment in schools has the potential to improve youth treatment access. However, school-specific barriers can make implementing evidence-based interventions difficult. Task-shifting (i.e., training lay staff to implement interventions) and computer-assisted interventions may mitigate these barriers. This paper reports on a qualitative examination of facilitators and barriers of a school-based implementation of a computer-assisted intervention for anxious youth (Camp Cope-A-Lot; CCAL). Participants (N = 45) included school staff in first through fourth grades. Providers attended a training in CCAL and received weekly, hour-long group consultation calls for 3 months. In the second year, the sustainability of CCAL use was assessed. Qualitative interviews were conducted after the first year (initial implementation) and second year (sustainability). Interviews were analyzed using the Consolidated Framework for Implementation Research domains to classify themes. Although participants reported that CCAL included useful skills, they expressed concerns about recommended session length (45 min) and frequency (weekly). Time burden of consultation calls was also a barrier. School staff facilitated implementation by enabling flexible scheduling for youth to be able to participate in the CCAL program. However, the sustainability of the program was limited due to competing school/time demands. Results suggest that even with computer-assisted programs, there is a need to tailor interventions and implementation efforts to account for the time restrictions experienced by school-based service providers. Optimal fit between the intervention and specific school is important to maintain the potential benefits of computer-assisted treatments delivered by lay service providers in schools.
Similar content being viewed by others
References
Allensworth, D., Lawson, E., Nicholson, L., & Wyche, J. (1997). Schools & health: our nation’s investment. National Academies Press (US). https://doi.org/10.17226/5153
Atkins, M. S., Cappella, E., Shernoff, E. S., Mehta, T. G., & Gustafson, E. L. (2017). Schooling and children’s mental health: Realigning resources to reduce disparities and advance public health. Annual Review of Clinical Psychology, 13, 123–147. https://doi.org/10.1146/annurev-clinpsy-032816-045234
Barrett, P., & Turner, C. (2001). Prevention of anxiety symptoms in primary school children: Preliminary results from a universal school-based trial. British Journal of Clinical Psychology, 40, 399–410. https://doi.org/10.1348/014466501163887
Becker-Haimes, E. M., Tabachnick, A. R., Last, B. S., Stewart, R. E., Hasan-Granier, A., & Beidas, R. S. (2019). Evidence base update for brief, free, and accessible youth mental health measures. Journal of Clinical Child and Adolescent Psychology, 49(1), 1–17. https://doi.org/10.1080/15374416.2019.1689824
Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63, 660–665. https://doi.org/10.1176/appi.ps.201100401
Benjamin, C. L., Taylor, K. P., Goodin, S. M., & Creed, T. A. (2014). Dissemination and implementation of cognitive therapy for depression in schools. In R. S. Beidas & P. C. Kendall (Eds.), Dissemination and implementation of evidence-based practices in child and adolescent mental health (pp. 277–293). Oxford: Oxford University Press.
Brooks, J., McCluskey, S., Turley, E., & King, N. (2014). The utility of template analysis in qualitative psychology research. Qualitative Research in Psychology, 12(2), 202–222. https://doi.org/10.1080/14780887.2014.955224
Carroll, K. M., & Rounsaville, B. J. (2010). Computer-assisted therapy in psychiatry: Be brave—It’s a new world. Current Psychiatry Reports, 12, 426–432. https://doi.org/10.1007/s11920-010-0146-2
Chu, B. C., Talbott Crocco, S., Arnold, C. C., Brown, R., Southam-Gerow, M. A., & Weisz, J. R. (2015). Sustained implementation of cognitive-behavioral therapy for youth anxiety and depression: Long-term effects of structured training and consultation on therapist practice in the field. Professional Psychology: Research and Practice, 46, 70–79. https://doi.org/10.1037/a0038000
Comer, J. S., Furr, J. M., Miguel, E. M., Cooper-Vince, C. E., Carpenter, A. L., Elkins, R. M., …, Chase, R. (2017). Remotely delivering real-time parent training to the home: An initial randomized trial of Internet-delivered parent–child interaction therapy (I-PCIT). Journal of Consulting and Clinical Psychology, 85, 909–917. https://doi.org/10.1037/ccp0000230
Cooper, J. L. (2008). The federal case for school-based mental health services and supports. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 4–8. https://doi.org/10.1097/chi.0b013e31815aac71
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., & Angold, A. (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844. https://doi.org/10.1001/archpsyc.60.8.837
Crawford, E. A., Salloum, A., Lewin, A. B., Andel, R., Murphy, T. K., & Storch, E. A. (2013). A pilot study of computer-assisted cognitive behavioral therapy for childhood anxiety in community mental health centers. Journal of Cognitive Psychotherapy, 27, 221–234. https://doi.org/10.1891/0889-8391.27.3.221
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. https://doi.org/10.1186/1748-5908-4-50
DeSantis, L., & Ugarriza, D. N. (2000). The concept of theme as used in qualitative nursing research. Western Journal of Nursing Research, 22, 351–372. https://doi.org/10.1177/01939450022044467
Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., Romanelli, L. H., …, Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28. https://doi.org/10.1080/1754730X.2008.9715730
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327. https://doi.org/10.1007/s10464-008-9165-0
Eiraldi, R., Wolk, C. B., Locke, J., & Beidas, R. (2015). Clearing hurdles: The challenges of implementation of mental health evidence-based practices in under-resourced schools. Advances in School Mental Health Promotion, 8, 124–140. https://doi.org/10.1080/1754730X.2015.1037848
Farmer, E. M., Burns, B. J., Phillips, S. D., Angold, A., & Costello, E. J. (2003). Pathways into and through mental health services for children and adolescents. Psychiatric Services, 54, 60–66. https://doi.org/10.1176/appi.ps.54.1.60
Fiscella, K., & Kitzman, H. (2009). Disparities in academic achievement and health: The intersection of child education and health policy. Pediatrics, 123, 1073–1080. https://doi.org/10.1542/peds.2008-0533
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. University of South Florida, Louis de la Parte FloridaMental Health Institute, The National Implementation Research Network (FMHI Publication #231).
Forman, S. G., Olin, S. S., Hoagwood, K. E., Crowe, M., & Saka, N. (2009). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1, 26. https://doi.org/10.1007/s12310-008-9002-5
Franklin, C. G., Kim, J. S., Ryan, T. N., Kelly, M. S., & Montgomery, K. L. (2012). Teacher involvement in school mental health interventions: A systematic review. Children and Youth Services Review, 34, 973–982. https://doi.org/10.1016/j.childyouth.2012.01.027
Ginsburg, G. S., Drake, K. L., Muggeo, M. A., Stewart, C. E., Pikulski, P. J., Zheng, D., & Harel, O. (2019). A pilot RCT of a school nurse delivered intervention to reduce student anxiety. Journal of Clinical Child & Adolescent Psychology. https://doi.org/10.1080/15374416.2019.1630833
Hazen, A. L., Hough, R. L., Landsverk, J. A., & Wood, P. A. (2004). Use of mental health services by youths in public sectors of care. Mental Health Services Research, 6, 213–226. https://doi.org/10.1023/B:MHSR.0000044747.54525.36
Hill, C. E., Knox, S., Thompson, B. J., Williams, E. N., Hess, S. A., & Ladany, N. (2005). Consensual qualitative research: An update. Journal of Counseling Psychology, 52, 196–205. https://doi.org/10.1037/0022-0167.52.2.196
Hill, C. E., Thompson, B. J., & Williams, E. N. (1997). A guide to conducting consensual qualitative research. The Counseling Psychologist, 25, 517–572. https://doi.org/10.1177/0011000097254001
Hollon, S. D., & Beck, A. T. (2013). Cognitive and cognitive-behavioral therapies. In Bergin and Garfield’s handbook of psychotherapy and behavior change (Vol. 6, pp. 393–442). Wiley.
Hudson, K. G., Lawton, R., & Hugh-Jones, S. (2020). Factors affecting the implementation of a whole school mindfulness program: A qualitative study using the consolidated framework for implementation research. BMC Health Services Research, 20, 133. https://doi.org/10.1186/s12913-020-4942-z
Husky, M. M., Sheridan, M., McGuire, L., & Olfson, M. (2011). Mental health screening and follow-up care in public high schools. Journal of the American Academy of Child & Adolescent Psychiatry, 50, 881–891. https://doi.org/10.1016/j.jaac.2011.05.013
Kataoka, S., Stein, B. D., Nadeem, E., & Wong, M. (2007). Who gets care? Mental health service use following a school-based suicide prevention program. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 1341–1348. https://doi.org/10.1097/chi.0b013e31813761fd
Kataoka, S. H., Zhang, L., & Wells, K. B. (2002). Unmet need for mental health care among US children: Variation by ethnicity and insurance status. American Journal of Psychiatry, 159, 1548–1555. https://doi.org/10.1176/appi.ajp.159.9.1548
Kendall, P. C., & Hedtke, K. A. (2006). Cognitive-behavioral therapy for anxious children: Therapist manual. Ardmore: Workbook Publishing.
Kendall, P. C., Hudson, J., Gosch, E., Flannery-Schroeder, E., & Suveg, C. (2008). Cognitive-behavioral therapy for anxiety disordered youth: A randomized clinical trial evaluating child and family modalities. Journal of Consulting and Clinical Psychology, 76, 282–297.
Kendall, P. C., & Khanna, M. S. (2008c). Go-to-gadget. Ardmore: Workbook Publishing Inc.
Kendall, P. C., & Khanna, M. S. (2008b). Coach’s manual for Camp Cope-ALot: The Coping Cat CD Rom. Ardmore: Workbook Publishing Inc.
Kendall, P. C., & Khanna, M. S. (2008a). Camp Cope-A-Lot: The Coping Cat CD Rom [Software]. Available from Workbook Publishing Inc. www. workbookpublishing.com.
Khanna, M. S., & Kendall, P. C. (2008). Computer-assisted CBT for child anxiety: The Coping Cat CD-ROM. Cognitive and Behavioral Practice, 15, 159–165. https://doi.org/10.1016/j.cbpra.2008.02.002
Khanna, M. S., & Kendall, P. C. (2010). Computer-assisted cognitive behavioral therapy for child anxiety: Results of a randomized clinical trial. Journal of Consulting and Clinical Psychology, 78, 737–745. https://doi.org/10.1037/a0019739
Khanna, M. S., Kerns, C. M., & Carper, M. M. (2014). Internet-based dissemination and implementation of cognitive behavioral therapy for child anxiety. In R. S. Beidas & P. C. Kendall (Eds.), Dissemination and implementation of evidence-based practices in child and adolescent mental health (pp. 313–335). Oxford: Oxford University Press.
Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2, 105–113. https://doi.org/10.1007/s12310-010-9038-1
Locke, J., Lee, K., Cook, C. R., Frederick, L., Vázquez-Colón, C., Ehrhart, M. G., …, Lyon, A. R. (2018). Understanding the organizational implementation context of schools: A qualitative study of school district administrators, principals, and teachers. School Mental Health, 11, 379–399. https://doi.org/10.1007/s12310-018-9292-1
LoCurto, J., Pella, J., Chan, G., & Ginsburg, G. (2020). School-based clinicians sustained use of a cognitive behavioral treatment for anxiety disorders. Advance online publication. https://doi.org/10.1007/s12310-020-09381-y
Lyon, A. R., & Bruns, E. J. (2019). From evidence to impact: Joining our best school mental health practices with our best implementation strategies. School Mental Health, 11, 106–114. https://doi.org/10.1007/s12310-018-09306-w
Lyon, A. R., & Koerner, K. (2016). User-centered design for psychosocial intervention development and implementation. Clinical Psychology: Science and Practice, 23, 180–200. https://doi.org/10.1111/cpsp.12154
Markle, R. S., Splett, J. W., Maras, M. A., & Weston, K. J. (2014). Effective school teams: Benefits, barriers, and best practices. In M. D. Weis, N. A. Lever, C. P. Bradshaw, & J. S. Owens (Eds.), Handbook of School mental health: Research, training, practice, and policy (2nd ed., pp. 59–73). Berlin: Springer.
McCrone, P., Knapp, M., Proudfoot, J., Ryden, C., Cavanagh, K., Shapiro, D. A., …, Tylee, A. (2004). Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: Randomised controlled trial. The British Journal of Psychiatry, 185, 55–62. https://doi.org/10.1192/bjp.185.1.55
Mellin, E. A., & Weist, M. D. (2011). Exploring school mental health collaboration in an urban community: A social capital perspective. School Mental Health, 3, 81–92. https://doi.org/10.1007/s12310-011-9049-6
Merikangas, K. R., He, J., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010). Lifetime prevalence of mental disorders in US adolescents: Results from the National Comorbidity Survey Replication-Adolescent Supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49, 980–989. https://doi.org/10.1016/j.jaac.2010.05.017
Merikangas, K. R., He, J., Burstein, M., Swendsen, J., Avenevoli, S., Case, B., …, Olfson, M. (2011). Service utilization for lifetime mental disorders in US adolescents: Results of the National Comorbidity Survey-Adolescent Supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 50, 32–45. https://doi.org/10.1016/j.jaac.2010.10.006
Meyer, D. Z., & Avery, L. M. (2009). Excel as a qualitative data analysis tool. Field Methods, 21, 91–112. https://doi.org/10.1177/1525822X08323985
Morse, J. M. (2007). Qualitative researchers don’t count. Qualitative Health Research, 17(3), 287–287. https://doi.org/10.1177/1049732306297322
Nadeem, E., Jaycox, L. H., Kataoka, S. H., Langley, A. K., & Stein, B. D. (2011). Going to scale: Experiences implementing a school-based trauma intervention. School Psychology Review, 40, 549–568. http://www.ncbi.nlm.nih.gov/pubmed/27346911
Newman, M. G. (2000). Recommendations for a cost-offset model of psychotherapy allocation using generalized anxiety disorder as an example. Journal of Consulting and Clinical Psychology, 68, 549–555. https://doi.org/10.1037/0022-006X.68.4.549
Olin, S. S., Williams, N., Pollock, M., Armusewicz, K., Kutash, K., Glisson, C., & Hoagwood, K. E. (2014). Quality indicators for family support services and their relationship to organizational social context. Administration and Policy in Mental Health, 41, 43–54. https://doi.org/10.1007/s10488-013-0499-z
Owens, J. S., Lyon, A. R., Brandt, N. E., Warner, C. M., Nadeem, E., Spiel, C., & Wagner, M. (2014). Implementation science in school mental health: Key constructs in a developing research agenda. School Mental Health, 6, 99–111. https://doi.org/10.1007/s12310-013-9115-3
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group. ( 2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283. https://doi.org/10.1177/1073191111411667
Powell, B. J., Patel, S. V., Haley, A. D., Haines, E. R., Knocke, K. E., Chandler, S., …, Aarons, G. A. (2019). Determinants of implementing evidence-based trauma-focused interventions for children and youth: A systematic review. Administration and Policy in Mental Health, 47, 705–719. https://doi.org/10.1007/s10488-019-01003-3
Reynolds, C. R., & Kamphaus, R. W. (2002). The clinician’s guide to the Behavior Assessment System for Children (BASC). New York: Guilford Press .
Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child and Family Psychology Review, 3, 223–241. https://doi.org/10.1023/A:1026425104386
Rubinson, F. (2002). Lessons learned from implementing problem-solving teams in urban high schools. Journal of Educational and Psychological Consultation, 13(3), 185–217. https://doi.org/10.1207/s1532768xjepc1303_03
Sarver, N. W., Beidel, D. C., & Spitalnick, J. S. (2014). The feasibility and acceptability of virtual environments in the treatment of childhood social anxiety disorder. Journal of Clinical Child and Adolescent Psychology, 43, 63–73. https://doi.org/10.1080/15374416.2013.843461
Schleider, J. L., Dobias, M. L., Sung, J. Y., & Mullarkey, M. C. (2019). Future directions in single-session youth mental health interventions. Journal of Clinical Child & Adolescent Psychology, 49(2), 264–278. https://doi.org/10.1080/15374416.2019.1683852
Stallard, P., Simpson, N., Anderson, S., Hibbert, S., & Osborn, C. (2007). The FRIENDS emotional health programme: Initial findings from a school-based project. Child and Adolescent Mental Health, 12, 32–37. https://doi.org/10.1111/j.1475-3588.2006.00421.x
Straus, A. L., & Corbin, J. (1998). Basics of Qualitative Research: Grounded Theory Procedures and Techniques (2nd ed.). Thousand Oaks: Sage Publications.
Sulkowski, M. L., Joyce, D. K., & Storch, E. A. (2012). Treating childhood anxiety in schools: Service delivery in a response to intervention paradigm. Journal of Child and Family Studies, 21(6), 938–947. https://doi.org/10.1007/s10826-011-9553-1
Swan, A. J., & Kendall, P. C. (2016). Fear and missing out: Youth anxiety and functional outcomes. Clinical Psychology: Science and Practice, 23, 417–435. https://doi.org/10.1111/cpsp.12169
Thaker, S., Steckler, A., Sánchez, V., Khatapoush, S., Rose, J., & Hallfors, D. D. (2008). Program characteristics and organizational factors affecting the implementation of a school-based indicated prevention program. Health Education Research, 23(2), 238–248. https://doi.org/10.1093/her/cym025
U.S. Department of Education Office of Special Education and Rehabilitative Services. (2002). A new era: Revitalizing special education for children and their families. Government Printing Office.
Walkup, J. T., Albano, A. M., Piacentini, J., Birmaher, B., Compton, S. N., Sherrill, J. T., …, Kendall, P. C. (2008). Cognitive behavioral therapy, sertraline, or a combination in childhood anxiety. New England Journal of Medicine, 359, 2753–2766. https://doi.org/10.1056/NEJMoa0804633
Whiteside, S. P., Sim, L. A., Morrow, A. S., Farah, W. H., Hilliker, D. R., Murad, M. H., & Wang, Z. (2020). A meta-analysis to guide the enhancement of CBT for childhood anxiety: Exposure over anxiety management. Clinical Child and Family Psychology Review, 23, 102–121. https://doi.org/10.1007/s10567-019-00303-2
World Health Organization. (2008). Task shifting: Global recommendations and guidelines. https://www.who.int/workforcealliance/knowledge/resources/taskshifting_guidelines/en/
Wright, J. H., Wright, A. S., Albano, A. M., Basco, M. R., Goldsmith, L. J., Raffield, T., & Otto, M. W. (2005). Computer-assisted cognitive therapy for depression: Maintaining efficacy while reducing therapist time. The American Journal of Psychiatry, 162, 1158–1164. https://doi.org/10.1176/appi.ajp.162.6.1158
Zenner, C., Herrnleben-Kurz, S., & Walach, H. (2014). Mindfulness-based interventions in schools—a systematic review and meta-analysis. Frontiers in Psychology, 5, 603. https://doi.org/10.3389/fpsyg.2014.00603
Funding
This project was funded by a National Institute of Mental Health (NIMH) research grant awarded to Philip C. Kendall (R01MH086438). Manuscript preparation was supported by NIMH grants (F31MH124346 to Mrs. Crane; F31MH123038 to Mrs. Norris; F31MH112211 to Dr. Frank). Dr. Kendall receives royalties from the sales of published materials related to the treatment of youth, and his spouse operates and receives income from the publisher.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Crane, M.E., Phillips, K.E., Maxwell, C.A. et al. A Qualitative Examination of a School-Based Implementation of Computer-Assisted Cognitive-Behavioral Therapy for Child Anxiety. School Mental Health 13, 347–361 (2021). https://doi.org/10.1007/s12310-021-09424-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12310-021-09424-y