Abstract
Examination of the efficacy of clinical supervision has accrued limited evidence, partially due to lack of a clarity or consensus on what constitutes supervision outcomes. This not only leads to inconsistency across studies evaluating supervision outcomes but also falls short of providing guidance for clinical supervisors to systematically evaluate the efficacy of their work. We present a practitioner-oriented, evidence-informed, and pan-theoretical framework that connects a broad range of outcomes to the supervision process, including proximal, intermediate, and distal outcomes. We discuss how several practitioner-friendly instruments related to these outcomes can be incorporated into supervision practice and contribute to a more holistic assessment of supervision outcomes. We also discussed supervisory strategies, such as strategically attending to and balancing multiple levels of outcomes and incorporating a theoretical lens to our framework.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bambling, M., King, R., Raue, P., Schweitzer, R., & Lambert, W. (2006). Clinical supervision: Its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Psychotherapy Research, 16(3), 317–331. https://doi.org/10.1080/10503300500268524
Beinart, H. (2002). An exploration of the factors which predict the quality of the relationship in clinical supervision (Unpublished D.Clin. Psych. thesis). Open University/British Psychological Society.
Beinart, H. (2004). Models of supervision and the supervisory relationship and their evidence base. In I. Fleming & L. Steen (Eds.), Supervision and clinical psychology: Theory, practice and perspectives (pp. 36–50). Brunner-Routledge.
Beinart, H. (2014). Building and sustaining the supervisory relationship. In C. E. Watkins & D. L. Milne (Eds.), The Wiley international handbook of clinical supervision (pp. 257–281). Wiley-Blackwell.
Bell, H., Hagedorn, W. B., & Robinson, E. H. M. (2016). An exploration of supervisory and therapeutic relationships and client outcomes. Counselor Education and Supervision, 55(3), 182–197. https://doi.org/10.1002/ceas.12044
Bernard, J. M. (1979). Supervisor training: A discrimination model. Counselor Education and Supervision, 19, 60–68. https://doi.org/10.1002/j.1556-6978.1979.tb00906.x
Bernard, J. M. (1997). The discrimination model. In C. E. Watkins Jr. (Ed.), Handbook of psychotherapy supervision (pp. 310–327). Wiley.
Bernard, J. M., & Goodyear, R. K. (2019). Fundamentals of clinical supervision (6th ed.). Merrill.
Bordin, E. S. (1983). A working alliance based model of supervision. The Counseling Psychologist, 11, 35–42. https://doi.org/10.1177/0011000083111007
Cary, D., & Marques, P. (2007). From expert to collaborator. The Clinical Supervisor, 26(1–2), 141–157. https://doi.org/10.1300/J001v26n01_10
Cliffe, T., Beinart, H., & Cooper, M. (2016). Development and validation of a short version of the supervisory relationship questionnaire. Clinical Psychology & Psychotherapy, 23(1), 77–86. https://doi.org/10.1002/cpp.1935
Cook, R. M., & Welfare, L. E. (2018). Examining predictors of counselor-in-training intentional nondisclosure. Counselor Education & Supervision, 57(3), 211–226. https://doi.org/10.1002/ceas.12111
Cook, R. M., Welfare, L. E., & Romero, D. E. (2018). Counselor-in-training intentional nondisclosure in onsite supervision: A content analysis. Professional Counselor, 8(2), 115–130. https://doi.org/10.15241/rmc.8.2.115
Cook, R. M., Welfare, L. E., & Sharma, J. (2019). Exploring supervisees’ in-session experiences of utilizing intentional nondisclosure. The Clinical Supervisor, 38(2), 202–221. https://doi.org/10.1080/07325223.2019.1608344
Crockett, S., & Hays, D. G. (2015). The influence of supervisor multicultural competence on the supervisory working alliance, supervisee counseling self-efficacy, and supervisee satisfaction with supervision: A mediation model. Counselor Education and Supervision, 54(4), 258–273. https://doi.org/10.1002/ceas.12025
DePue, M. K., Lambie, G. W., Liu, R., & Gonzalez, J. (2016). Investigating supervisory relationships and therapeutic alliances using structural equation modeling. Counselor Education and Supervision, 55(4), 263–277. https://doi.org/10.1002/ceas.12053
Efstation, J. F., Patton, M. J., & Kardash, C. M. (1990). Measuring the working alliance in counselor supervision. Journal of Counseling Psychology, 37(3), 322–329. https://doi.org/10.1037/0022-0167.37.3.322
Ellis, M., & Ladany, N. (1997). Inferences concerning supervisees and clients in clinical supervision: An integrative review. In C. E. Watkins Jr. (Ed.), The handbook of psychotherapy supervision (pp. 447–507). Wiley.
Falender, C. A. (2014). Supervision outcomes: Beginning the journey beyond the emperor’s new clothes. Training and Education in Professional Psychology, 8(3), 143–148. https://doi.org/10.1037/tep0000066
Fernández-Ballesteros, R., & Botella, J. (2008). Self-report measures. In A. M. Nezu & C. M. Nezu (Eds.), Evidence-based outcome research: A practical guide to conducting randomized controlled trials for psychosocial interventions (pp. 95–122). Oxford University Press.
Freitas, G. J. (2002). The impact of psychotherapy supervision on client outcome: A critical examination of 2 decades of research. Psychotherapy: Theory, Research, Practice, Training, 39(4), 354–367. https://doi.org/10.1037/0033-3204.39.4.354
Gnilka, P. B., Chang, C. Y., & Dew, B. J. (2012). The relationship between supervisee stress, coping resources, the working alliance, and the supervisory working alliance. Journal of Counseling & Development, 90(1), 63–70. https://doi.org/10.1111/j.1556-6676.2012.00009.x
Goreczny, A. J., Hamilton, D., Lubinski, L., & Pasquinelli, M. (2015). Exploration of counselor self-efficacy across academic training. The Clinical Supervisor, 34(1), 78–97. https://doi.org/10.1080/07325223.2015.1012916
Hatcher, R. L., & Gillaspy, J. A. (2006). Development and validation of a revised short version of the working alliance inventory. Psychotherapy Research, 16(1), 12–25. https://doi.org/10.1080/10503300500352500
Junga, Y. M., Witthöft, M., & Weck, F. (2019). Assessing therapist development: Reliability and validity of the supervisee levels questionnaire (SLQ-R). Journal of Clinical Psychology, 75(9), 1658–1672. https://doi.org/10.1002/jclp.22794
Knox, S. (2015). Disclosure -- and lack there of -- in individual supervision. The Clinical Supervisor, 34(2), 151–163. https://doi.org/10.1080/07325223.2015.1086462
Ladany, N., Hill, C. E., Corbett, M. M., & Nutt, E. A. (1996). Nature, extent, and importance of what psychotherapy trainees do not disclose to their supervisors. Journal of Counseling Psychology, 43(1), 10–24. https://doi.org/10.1037/0022-0167.43.1.10
Ladany, N., Ellis, M. V., & Friedlander, M. L. (1999). The supervisory working alliance, trainee self-efficacy, and satisfaction. Journal of Counseling & Development, 77(4), 447–455. https://doi.org/10.1002/j.1556-6676.1999.tb02472.x
Lambert, M. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association.
Larson, L. M., Suzuki, L. A., Gillespie, K. N., Potenza, M. T., Bechtel, M. A., & Toulouse, A. L. (1992). Development and validation of the counseling self-estimate inventory. Journal of Counseling Psychology, 39(1), 105–120. https://doi.org/10.1037/0022-0167.39.1.105
Li, C., Kemer, G., & Henson, J. M. (2020). Development and validation of the supervisee disclosure in supervision scale. Counselor Education and Supervision, 59(2), 145–159. https://doi.org/10.1002/ceas.12172
Livni, D., Crowe, T. P., & Gonsalvez, C. J. (2012). Effects of supervision modality and intensity on alliance and outcomes for the supervisee. Rehabilitation Psychology, 57(2), 178–186. https://doi.org/10.1037/a0027452
Luke, M., & Peters, H. C. (2020). Supervision as the signature pedagogy for counseling leadership. Teaching and supervision in counseling, 2(2), article 4. https://doi.org/10.7290/tsc020204
McKibben, W. B., Cook, R. M., & Fickling, M. J. (2019). Feminist supervision and supervisee nondisclosure: The mediating role of the supervisory relationship. The Clinical Supervisor, 38(1), 38–57. https://doi.org/10.1080/07325223.2018.1509756
McNeill, B. W., Stoltenberg, C. D., & Romans, J. S. (1992). The integrated developmental model of supervision: Scale development and validation procedures. Professional Psychology: Research and Practice, 23(6), 504–508. https://doi.org/10.1037/0735-7028.23.6.504
Mehr, K. E., Ladany, N., & Caskie, G. I. L. (2010). Trainee nondisclosure in supervision: What are they not telling you? Counselling and Psychotherapy Research, 10(2), 103–113. https://doi.org/10.1080/14733141003712301
Mehr, K. E., Ladany, N., & Caskie, G. I. L. (2015). Factors influencing trainee willingness to disclose in supervision. Training and Education in Professional Psychology, 9(1), 44–51. https://doi.org/10.1037/tep0000028
Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2(2), 91–100. http://scottdmiller.com/wp-content/uploads/documents/OutcomeRatingScale-JBTv2n2.pdf
Milne, D. (2009). Evidence-based clinical supervision: Principles and practice. Malden Blackwell Publishing.
Milne, D. (2014). Beyond the “acid test”: A conceptual review and reformulation of outcome evaluation in clinical supervision. American Journal of Psychotherapy, 68(2), 213–230. https://doi.org/10.1176/appi.psychotherapy.2014.68.2.213
Mori, Y., Inman, A. G., & Caskie, G. I. L. (2009). Supervising international students: Relationship between acculturation, supervisor multicultural competence, cultural discussions, and supervision satisfaction. Training and Education in Professional Psychology, 3(1), 10–18. https://doi.org/10.1037/a0013072
Palomo, M., Beinart, H., & Cooper, M. J. (2010). Development and validation of the supervisory relationship questionnaire (SRQ) in UK trainee clinical psychologists. British Journal of Clinical Psychology, 49(2), 131–149. https://doi.org/10.1348/014466509X441033
Park, E. H., Ha, G., Lee, S., Lee, Y. Y., & Lee, S. M. (2019). Relationship between the supervisory working alliance and outcomes: A meta-analysis. Journal of Counseling & Development, 97(4), 437–446. https://doi.org/10.1002/jcad.12292
Patton, M. J., & Kivlighan, D. M., Jr. (1997). Relevance of the supervisory alliance to the counseling alliance and to treatment adherence in counselor training. Journal of Counseling Psychology, 44(1), 108–115. https://doi.org/10.1037/0022-0167.44.1.108
Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. R. (2009). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-efficacy. Training and Education in Professional Psychology, 3(3), 157–168. https://doi.org/10.1037/a0015673
Reiser, R. P., & Milne, D. L. (2014). A systematic review and reformulation of outcome evaluation in clinical supervision: Applying the fidelity framework. Training and Education in Professional Psychology, 8(3), 149–157. https://doi.org/10.1037/tep0000031
Rousmaniere, T. G., Swift, J. K., Babins-Wagner, R., Whipple, J. L., & Berzins, S. (2016). Supervisor variance in psychotherapy outcome in routine practice. Psychotherapy Research, 26(2), 196–205. https://doi.org/10.1080/10503307.2014.963730
Sabella, S. A., Schultz, J. C., & Landon, T. J. (2020). Validation of a brief form of the supervisory working Alliance inventory. Rehabilitation Counseling Bulletin, 63(2), 115–124. https://doi.org/10.1177/0034355219846652
Schweitzer, R. D., & Witham, M. (2018). The supervisory alliance: Comparison of measures and implications for a supervision toolkit. Counselling and Psychotherapy Research, 18(1), 71–78. https://doi.org/10.1002/capr.12143
Stoltenberg, C. D., & McNeill, B. W. (2010). IDM supervision: An integrative developmental model for supervising counselors & therapists (3rd ed.). Routledge.
Tangen, J. L., & Borders, D. (2016). The supervisory relationship: A conceptual and psychometric review of measures. Counselor Education and Supervision, 55(3), 159–181. https://doi.org/10.1002/ceas.12043
Wampold, B. E., & Holloway, E. L. (1997). Methodology, design, and evaluation in psychotherapy supervision research. In C. E. Watkins Jr. (Ed.), Handbook of psychotherapy supervision (pp. 11–27). Wiley.
Watkins, C. E. (2011). Does psychotherapy supervision contribute to patient outcomes? Considering thirty years of research. The Clinical Supervisor, 30(2), 235–256. https://doi.org/10.1080/07325223.2011.619417
Watkins, C. E. (2014). The supervisory alliance: A half century of theory, practice, and research in critical perspective. American Journal of Psychotherapy, 68(1), 19–55. https://doi.org/10.1176/appi.psychotherapy.2014.68.1.19
Wheeler, S., & Barkham, M. (2014). A core evaluation battery for supervision. In C. E. Watkins Jr. & D. L. Milne (Eds.), The Wiley international handbook of clinical supervision (pp. 365–385). Wiley.
Wheeler, S., & Richards, K. (2007). The impact of clinical supervision on counsellors and therapists, their practice and their clients. A systematic review of the literature. Counselling and Psychotherapy Research, 7(1), 54–65. https://doi.org/10.1080/14733140601185274
Wheeler, S., Aveline, M., & Barkham, M. (2011). Practice-based supervision research: A network of researchers using a common toolkit. Counselling and Psychotherapy Research, 11(2), 88–96. https://doi.org/10.1080/14733145.2011.562982
Zhu, P., Luke, M., & Bellini, J. (2021). A grounded theory analysis of cultural humility in counseling and counselor education. Counselor Education and Supervision, 60(1), 73–89. https://doi.org/10.1002/ceas.12197
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors have no conflicts of interest to disclose.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Rights and permissions
About this article
Cite this article
Zhu, P., Luke, M.M. A Supervisory Framework for Systematically Attending to Outcomes in Clinical Supervision. Int J Adv Counselling 44, 94–111 (2022). https://doi.org/10.1007/s10447-021-09455-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10447-021-09455-9