Skip to main content

Advertisement

SpringerLink
Log in

A review to identify key perspectives in PBL meta-analyses and reviews: trends, gaps and future research directions

  • Review
  • Published:
Advances in Health Sciences Education Aims and scope Submit manuscript

Abstract

In the past 50 years, the original McMaster PBL model has been implemented, experimented, revised, and modified, and is still evolving. Yet, the development of PBL is not a series of success stories, but rather a journey of experiments, failures and lessons learned. In this paper, we analyzed the meta-analyses and systematic reviews on PBL from 1992 to present as they provide a focused lens on the PBL research in the past 5 decades. We identified three major waves in the PBL research development, analyzed their impact on PBL research and practice, and offered suggestions of research gaps and future directions for the field. The first wave of PBL research (polarization: 1990–mid 2000) focused on answering the question “Does PBL work?” and the outcomes. The results were conflicting. The researchers took polarizing positions and debated over the merits of PBL throughout this wave. However, the contradictory results and the debates in fact pushed the researchers to look harder for new directions to solve the puzzle. These efforts resulted in the second wave (from outcomes to process: mid 2000–mid 2010) that focused on the question “How does PBL work?” The second wave of PBL research targeted at investigating the effects of implementation constituents, such as assessment formats or single versus curriculum wide implementations. The third wave (specialization: mid 2010 and onward) of PBL research focused on “How does PBL work in different specific contexts?” These research widened our perspectives by expanding our understanding of how PBL manifests itself in different contexts. Given the diversification of PBL and more hybrid PBL models, we suggest “Why does PBL with particular implementation characteristics for specific outcomes work or not work in the condition where it is implemented?” to be the question to answer in the next wave of PBL research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • The references with an asterisk are the meta-analyses or systematic reviews included in this review.

  • *Al-Azri, H., & Ratnapalan, S. (2014). Problem-based learning in continuing medical education: Review of randomized controlled trials. Canadian Family Physician,60, 157–165.

    Google Scholar 

  • *Albanese, M. A., & Dast, L. (2014). Problem-based learning: Outcomes evidence from the health professions. Journal on Excellence in College Teaching,25(3&4), 239–252.

    Google Scholar 

  • *Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine,68, 52–81.

    Google Scholar 

  • *Azer, S. A., & Azer, D. (2015). Group interaction in problem-based learning tutorials: A systematic review. European Journal of Dental Education,19, 194–208. https://doi.org/10.1111/eje.12121.

    Article  Google Scholar 

  • Barrows, H. S. (1986). A taxonomy of problem-based learning methods. Medical Education, 20(6), 481–486.

    Google Scholar 

  • Barrows, H. S. (1996). Problem-based learning in medicine and beyond: A brief overview. In L. Wilkerson & W. H. Gijselaers (Eds.), Bring problem-based learning to higher education: Theory and practice. New directions for teaching and learning (Vol. 68, pp. 3–12). San Francisco: Jossey-Bass.

    Google Scholar 

  • Barrows, H. S., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education. New York: Springer.

    Google Scholar 

  • *Belland, B., French, B., & Ertmer, P. A. (2009). Validity and problem-based learning research: A review of instruments used to assess intended learning outcomes. The Interdisciplinary Journal of Problem-Based Learning,3(1), 59–89.

    Google Scholar 

  • *Berkson, L. (1993). Problem-based learning: Have the expectations been met? Academic Medicine,68, S79–S88.

    Google Scholar 

  • *Car, L. T., Kyaw, B. M., Dunleavy, G., Smart, N. A., Semwal, M., Rotgans, J. I., et al. (2019). Digital problem-based learning in health professions: Systematic review and meta-analysis by the digital health education collaboration. Journal of Medical Internet Research,21(2), e12945. https://doi.org/10.2196/12945.

    Article  Google Scholar 

  • Ciancolo, A. T., & Regehr, G. (2019). Learning theory and educational intervention: Producing meaningful evidence of impact through layered analysis. Academic Medicine,94, 789–794.

    Google Scholar 

  • *Colliver, J. A. (2000). Effectiveness of problem-based learning curricula: Research and theory. Academic Medicine,75(3), 259–266.

    Google Scholar 

  • Cook, D. A., Bordage, G., & Schmidt, H. G. (2008). Description, justification and clarification: A framework for classifying the purposes of research in medical education. Medical Education,42, 128–133.

    Google Scholar 

  • Cook, D. J., Mulrow, C. D., & Haynes, R. B. (1997). Systematic reviews: Synthesis of best evidence for clinical decisions. Annals of Internal Medicine,126(5), 376–380. https://doi.org/10.7326/0003-4819-126-5-199703010-00006.

    Article  Google Scholar 

  • Czabanowska, K., Moust, J. H., Meijer, A., Schröder-Bäck, P., & Roebertsen, H. (2012). Problem-based learning revisited, introduction of active and self-directed learning to reduce fatigue among students. Journal of University Teaching & Learning Practice,9(1), 6.

    Google Scholar 

  • *Demirel, M., & Dagyar, M. (2016). Effects of problem-based learning on attitude: A meta-analysis study. Eurasia Journal of Mathematics, Science & Technology Education,12(8), 2115–2137. https://doi.org/10.12973/eurasia.2016.1293a.

    Article  Google Scholar 

  • *Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learning: A meta-analysis. Learning and Instruction,13, 533–568.

    Google Scholar 

  • *Dolmans, D. H. J. M., Loyens, S. M. M., Marcq, H., & Gijbels, D. (2016). Deep and surface learning in problem-based learning: A review of the literature. Advances in Health Science Education,21, 1087–1112. https://doi.org/10.1007/s10459-015-9645-6.

    Article  Google Scholar 

  • Engeström, Y. (1987). Learning by expanding: An activity theoretical approach to developmental research. Helsinki: Orienta-Konsultit.

    Google Scholar 

  • *Eslami, E., Bassir, S. H., & Sadr-Eshkevari, P. (2014). Current state of the effectiveness of problem-based learning in prosthodontics: A systematic review. Journal of Dental Education,78(5), 723–734.

    Google Scholar 

  • Fonteijn, H. T. H., & Dolmans, D. H. J. M. (2019). Group work and group dynamics in PBL. In M. Moallem, W. Hung, & N. Baddagh (Eds.), The Wiley handbook of problem-based learning (pp. 199–219). Hoboken, NJ: Wiley.

    Google Scholar 

  • Francom, G. M. (2017). Principles for task-centered instruction. In C. M. Reigeluth, B. J. Beatty, & R. D. Myers (Eds.), Instructional design theories and models: The learner-centered paradigm of education (Vol. 4, pp. 65–91). New York: Routledge.

    Google Scholar 

  • *Galvao, T. F., Silva, M. T., Neiva, C. S., Ribeiro, L. M., & Pereira, M. G. (2014). Problem-based learning in pharmaceutical education: A systematic review and meta-analysis. The Scientific World Journal. https://doi.org/10.1155/2014/578382.

    Article  Google Scholar 

  • *Gao, X., Luo, S., Mu, D., Xiong, Y., Guanjian, L., & Wan, C. (2016). Effects of problem-based learning in paediatric education in China: A meta-analysis. Journal of Evidence-Based Medicine,9, 136–143.

    Google Scholar 

  • *Gavgani, V. Z., Hazrati, H., & Ghojazadeh, M. (2015). The efficacy of digital case scenario versus paper case scenario on clinical reasoning in problem-based learning: A systematic review and meta-analysis. Research and Development in Medical Education,4(1), 17–22.

    Google Scholar 

  • *Gijbels, D., Dochy, F., van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research,75(1), 27–61.

    Google Scholar 

  • Gordon, M., Daniel, M., & Patricio, M. (2018). What do we mean by ‘systematic’ in health education systematic reviews and why it matters! Medical Teacher. https://doi.org/10.1080/0142159x.2018.1504164.

    Article  Google Scholar 

  • Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal,26(2), 91–108.

    Google Scholar 

  • *Hartling, L., Spooner, C., Tjosvold, L., & Oswald, A. (2010). Problem-based learning in pre-clinical medical education: 22 years of outcome research. Medical Teacher,32, 28–35.

    Google Scholar 

  • Hmelo-Silver, C. E., Duncan, R. G., & Chinn, C. A. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark (2006). Educational Psychologist,42(2), 99–107.

    Google Scholar 

  • *Huang, B., Zheng, L., Li, C., Li, L., & Yu, H. (2013). Effectiveness of problem-based learning in Chinese dental education: A meta-analysis. Journal of Dental Education,77(3), 377–383.

    Google Scholar 

  • Hung, W., & Loyens, S. M. M. (2012). Global development of problem-based learning: Adoption, adaptation, and advancement. Interdisciplinary Journal of Problem-Based Learning,6(1), 4–9.

    Google Scholar 

  • *Jerzembek, G., & Murphy, S. (2013). A narrative review of problem-based learning with school-aged children: Implementation and outcomes. Educational Review,65(2), 206–218.

    Google Scholar 

  • *Jia, X., Zeng, W., & Zeng, Q. (2018). Combined administration of problem- and lecture-based learning teaching models in medical education in China: A meta-analysis of randomized controlled trials. Medicine,97, 43.

    Google Scholar 

  • Jonassen, D. H. (2000). Toward a design theory of problem solving. ETR&D,48(4), 63–85.

    Google Scholar 

  • *Kalaian, H. A., Mullan, P. B., & Kasim, R. M. (1999). What can studies of problem-based learning tell us? Synthesizing and modeling PBL effects on National Board of Medical Examination performance: Hierarchical linear modeling meta-analytic approach. Advances in Health Sciences Education,4, 209–221.

    Google Scholar 

  • Kelley, H. H. (1973). The process of causal attribution. American Psychologist,28, 107–128.

    Google Scholar 

  • *Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for Stem education: Bayesian meta-analysis. Educational Psychology Review,30, 397–429.

    Google Scholar 

  • Kirschner, P. A., Sweller, J., & Clark, R. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist,41(2), 75–86.

    Google Scholar 

  • *Koh, G. C.-H., Khoo, H. E., Wong, M. L., & Koh, D. (2008). The effects of problem-based learning during medical school on physician competency: A systematic review. Canadian Medical Association Journal,178(1), 34–41.

    Google Scholar 

  • *Kong, L.-N., Qin, B., Zhou, Y.-Q., Mou, S.-Y., & Gao, H.-M. (2014). The effectiveness of problem-based learning on development of nursing students’ critical thinking: A systematic review and meta-analysis. International Journal of Nursing Studies,51, 458–469.

    Google Scholar 

  • *Leary, H., Walker, A., Shelton, B. E., & Fitt, M. H. (2013). Exploring the relationships between tutor background, tutor training, and student learning: A problem-based learning meta-analysis. The Interdisciplinary Journal of Problem-Based Learning,7(1), 44–66.

    Google Scholar 

  • *Liu, L., Du, X., Zhang, Z., & Zhou, J. (2019). Effect of problem-based learning in pharmacology education: A meta-analysis. Studies in Educational Evaluation,60, 43–58.

    Google Scholar 

  • Loyens, S., & Rikers, R. (2011). Instruction based on inquiry. In R. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (pp. 361–381). New York, NY: Routledge.

    Google Scholar 

  • *Ma, Y., & Lu, X. (2019). The effectiveness of problem-based learning in pediatric medical education in China: A meta-analysis of randomized controlled trials. Medicine,98, 2.

    Google Scholar 

  • *Neville, A. J. (2009). Problem-based learning and medical education forth years on. Medical Principles and Practice,18, 1–9.

    Google Scholar 

  • *Newman, M. (2003). A pilot systematic review and meta-analysis on the effectiveness of problem-based learning. Special report 2. London: Middlesex University. Retrieved 14 May 2019, from https://eric.ed.gov/?id=ED476146.

  • *Norman, G. R., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine,67, 557–565.

    Google Scholar 

  • Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review: A new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy,10(Suppl 1), 21–34.

    Google Scholar 

  • *Polyzois, I., Claffey, N., & Mattheos, N. (2010). Problem-based learning in academic health education: A systematic literature review. European Journal of Dental Education,14, 55–64.

    Google Scholar 

  • *Qin, Y., Wang, Y., & Floden, R. E. (2016). The effect of problem-based learning on improvement of the medical educational environment: A systematic review and meta-analysis. Medical Principles and Practice,25, 525–532. https://doi.org/10.1159/000449036.

    Article  Google Scholar 

  • *Sayyah, M., Shirbandi, K., Saki-Malehi, A., & Rahim, F. (2017). Use of a problem-based learning teaching model for undergraduate medical and nursing education: A systematic review and meta-analysis. Advances in Medical Education and Practice,8, 691–700.

    Google Scholar 

  • Servant-Miklos, V. F. C., Norman, G. R., & Schmidt, H. G. (2019). A short intellectual history of problem-based learning. In M. Moallem, W. Hung, & N. Dabbagh (Eds.), The Wiley handbook of Problem-based Learning (pp. 3–24). Hoboken, NJ: Wiley-Blackwell.

    Google Scholar 

  • Schmidt, H. G. (1983). Problem-based learning: Rationale and description. Medical Education,17, 11–16.

    Google Scholar 

  • Schmidt, H. G., Loyen, S. M. M., van Gog, T., & Paas, F. (2007). Problem-based learning is compatible with human cognitive architecture: Commentary on Kirschner, Sweller, and Clark (2006). Educational Psychologist,42(2), 91–97.

    Google Scholar 

  • *Schmidt, H. G., van der Molen, H. T., te Winkel, W. W. R., & Wijnen, W. H. F. W. (2009). Constructivist, problem-based learning does work: A meta-analysis of curriculum comparisons involving a single medical school. Educational Psychologist,44(4), 227–249.

    Google Scholar 

  • *Shin, I.-S., & Kim, J.-H. (2013). The effect of problem-based learning in nursing education: A meta-analysis. Advances in Health Science Education,18, 1103–1120. https://doi.org/10.1007/s10459-012-9436-2.

    Article  Google Scholar 

  • *Strobel, J., & van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem-Based Learning,3(1), 44–58.

    Google Scholar 

  • Tawfik, A. A., Hung, W., & Giabbanelli, P. J. Comparing how different inquiry-based approaches impact learning outcomes. Interdisciplinary Journal of Problem-Based Learning(in press).

  • Thagard, P. (2000). Explaining disease: Correlations, causes, and mechanisms. In F. C. Keil & R. A. Wilson (Eds.), Explanation and cognition (pp. 254–276). Cambridge, MA: MIT Press.

    Google Scholar 

  • *Tsai, C.-W., & Chiang, Y.-C. (2013). Research trends in problem-based learning (PBL) research in e-learning and online education environments: A review of publications in SSCI-indexed journals from 2004 to 2012. British Journal of Educational Technology,44(6), E185–E190. https://doi.org/10.1111/bjet.12038.

    Article  Google Scholar 

  • *Tsigarides, J., Wingfield, L. R., & Kulendran, M. (2017). Does a PBL-based medical curriculum predispose training in specific career paths: A systematic review of the literature. BMC Research Notes,10, 24. https://doi.org/10.1186/s13104-016-2348-0.

    Article  Google Scholar 

  • van Merriënboer, J. J. G. (2013). Perspectives on problem solving and instruction. Computers & Education,64, 153–160.

    Google Scholar 

  • van Merrienboer, J. J. G., & Kirschner, P. A. (2018). Ten steps to complex learning: A systematic approach to four-component instructional design (3rd ed.). New York: Routledge.

    Google Scholar 

  • Vardi, I., & Ciccarelli, M. (2008). Overcoming problems in problem-based learning: A trial of strategies in an undergraduate unit. Innovations in Education and Teaching International,45(4), 345–354.

    Google Scholar 

  • *Vernon, D. T. A., & Blake, R. L. (1993). Does problem-based learning work: A meta-analysis of evaluative research. Academic Medicine,68, 550–563.

    Google Scholar 

  • *Walker, A., & Leary, H. (2009). A problem based learning meta analysis: Differences across problem types, implementation types, disciplines, and assessment levels. Interdisciplinary Journal of Problem-Based Learning, 3(1). Retrieved 14 May 2019, from http://docs.lib.purdue.edu/ijpbl/vol3/iss1/3.

  • Wijnia, L., Loyens, S. M. M., & Rikers, R. M. J. P. (2019). The problem-based learning process: An overview of different models. In M. Moallem, W. Hung, & N. Baddagh (Eds.), The Wiley handbook of problem-based learning (pp. 273–294). Hoboken, NJ: Wiley.

    Google Scholar 

  • *Wilder, S. (2015). Impact of problem-based learning on academic achievement in high school: A systematic review. Educational Review,67(4), 414–435. https://doi.org/10.1080/00131911.2014.974511.

    Article  Google Scholar 

  • *Wolf, F. M. (1993). Problem-based learning and meta-analysis: Can we see the forest through the trees? Academic Medicine,68(7), 542–544.

    Google Scholar 

  • *Wosinski, J., Belcher, A. E., Durrenberger, Y., Allin, A.-C., Stormacq, C., & Gerson, L. (2018). Facilitating problem-based learning among undergraduate nursing students: A qualitative systematic review. Nurse Education Today,60, 67–74.

    Google Scholar 

  • *Zhang, S., Xu, J., Wang, H., Zhang, D., Zhang, Q., & Zou, L. (2018). Effects of problem-based learning in Chinese radiology education: A systeamtic review and meta-analysis. Medicine,97, 9.

    Google Scholar 

  • *Zhang, Y., Zhou, L., Liu, X., Liu, L., Wu, Y., Zhao, Z., et al. (2015). The effectiveness of the problem-based learning teaching model for use in introductory Chinese undergraduate medical courses: A systematic review and meta-Analysis. PLoS ONE,10(3), e0120884. https://doi.org/10.1371/journal.pone.0120884.

    Article  Google Scholar 

  • *Zhou, J., Zhou, S., Huang, C., Xu, R., Zhang, Z., Zeng, S., et al. (2016). Effectiveness of problem-based learning in China pharmacy education: A meta-analysis. BMC Medical Education,16, 23. https://doi.org/10.1186/s12909-016-0546-z.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Instructional Design and Technology Program, Department of Education, Health and Behavior Studies, University of North Dakota, Grand Forks, USA

    Woei Hung

  2. School of Health Professions Education (SHE), Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands

    Diana H. J. M. Dolmans & Jeroen J. G. van Merriënboer

Authors
  1. Woei Hung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Diana H. J. M. Dolmans
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeroen J. G. van Merriënboer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Woei Hung.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hung, W., Dolmans, D.H.J.M. & van Merriënboer, J.J.G. A review to identify key perspectives in PBL meta-analyses and reviews: trends, gaps and future research directions. Adv in Health Sci Educ 24, 943–957 (2019). https://doi.org/10.1007/s10459-019-09945-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-019-09945-x

Keywords

Search

Navigation