Abstract
Student learning in introductory science, technology, engineering, and mathematics (STEM) courses is often self-regulated. For self-regulated learning to be effective, students need to engage in accurate metacognitive monitoring to make appropriate metacognitive control decisions. However, the accuracy with which individuals monitor their task performance appears to largely overlap with their ability to perform that task. This study examined the trajectories in the accuracy of students’ metacognitive monitoring over the course of a semester, along with the effect of monitoring accuracy feedback. The results indicate that some students improve the accuracy of their predictions over the course of a semester. However, low-performing students are less accurate at predicting their exam grades, and tend not to improve their metacognitive calibration over the course of a semester. In addition, providing low-performing students with calibration feedback may lead to greater overconfidence.
Similar content being viewed by others
Notes
A second reason was pragmatic given that course instructors did not want item-by-item local judgements used on the high-stakes exams for this course.
The Physics department generally aims to write exams that have a mean score between 70 and 75%. The second and final exams had lower means than desired by course instructors. While course instructors aim for a mean in this range, students are not made aware of this goal. Historically, the mean varies and may fall outside of this this desired range
The same conclusions are reached if only those who made predictions on all four exams are used in the analysis.
The same conclusions are reached if only those who made predictions on all four exams are used in the analysis.
The same conclusions are reached if only those who made predictions on all four exams are used in the analysis though the marginal interaction for exam 4 results in p = .10.
References
Ackerman, R. (2014). The diminishing criterion model for metacognitive regulation of time investment. Journal of Experimental Psychology: General, 143, 1349–1368. https://doi.org/10.1037/a0035098.
Ariel, R., & Dunlosky, J. (2011). The sensitivity of judgment-of-learning resolution to past test performance, new learning, and forgetting. Memory & Cognition, 39, 171–184. https://doi.org/10.3758/s13421-010-0002-y.
Ariel, R., Dunlosky, J., & Bailey, H. (2009). Agenda-based regulation of study-time allocation: When agendas override item-based monitoring. Journal of Experimental Psychology: General, 138, 432–447. https://doi.org/10.1037/a0015928.
Baars, M., Vink, S., Van Gog, T., De Bruin, A., & Paas, F. (2014). Effects of training self-assessment and usingassessment standards on retrospective and prospective monitoring of problem solving. Learning and Instruction, 33, 92–107. https://doi.org/10.1016/j.learninstruc.2014.04.004.
Barzilai, S., & Zohar, A. (2014). Reconsidering personal epistemology as metacognition: A multifaceted approach to the analysis of epistemic thinking. Educational Psychologist, 49, 13–35. https://doi.org/10.1080/00461520.2013.863265.
Belenky, D. M., & Nokes-Malach, T. J. (2013). Mastery-approach goals and knowledge transfer: An investigation into the effects of task structure and framing instructions. Learning and Individual Differences, 25, 21–34. https://doi.org/10.1016/j.lindif.2013.02.004.
Bipp, T., Steinmayr, R., & Spinath, B. (2012). A functional look at goal orientations: Their role for self-estimates of intelligence. Learning and Individual Differences, 22, 280–289. https://doi.org/10.1016/j.lindif.2012.01.009.
Bromme, R., Pieschl, S., & Stahl, E. (2010). Epistemological beliefs are standards for adaptive learning: A functional theory about epistemological beliefs and metacognition. Metacognition and Learning, 5, 7–26. https://doi.org/10.1007/s11409-009-9053-5.
Callender, A. A., Franco-Watkins, A. M., & Roberts, A. S. (2015). Improving metacognition in the classroom through instruction, training, and feedback. Metacognition and Learning, 11, 215–235. https://doi.org/10.1007/s11409-015-9142-6.
Castel, A. D., Benjamin, A. S., Craik, F. I., & Watkins, M. J. (2002). The effects of aging on selectivity and control in short-term recall. Memory & Cognition, 30, 1078–1085. https://doi.org/10.3758/BF03194325.
Cromley, J. G., Perez, T., & Kaplan, A. (2016). Undergraduate STEM achievement and retention: Cognitive, motivational, and institutional factors and solutions. Policy Insights From the Behavioral and Brain Sciences, 3, 4–11. https://doi.org/10.1177/2372732215622648.
Coutinho, S. A. (2007). The relationship between goals, metacognition, and academic success. Educate, 7, 39–47.
Dunlosky, J., & Bjork, R. (2008). The integrated nature of memory and metamemory. In J. Dunlosky & R. Bjork (Eds.), Handbook of memory and metamemory (pp. 11–28). New York, NY: Psychology Press.
Dunlosky, J., & Lipko, A. R. (2007). Metacomprehension: A brief history and how to improve its accuracy. Current Directions in Psychological Science, 16, 228–232. https://doi.org/10.1111/j.1467-8721.2007.00509.x.
Dunlosky, J., & Metcalfe, J. (2008). Metacognition. Los Angeles: SAGE.
Dunlosky, J., & Thiede, K. W. (2013). Metamemory. In D. Reisberg (Ed.), The Oxford handbook of psychology (pp. 283–298). Oxford, UK: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780195376746.013.0019.
Dunning, D., Heath, C., & Suls, J. M. (2004). Flawed self-assessment: Implications for health, education, and the workplace. Psychological Science in the Public Interest, 5, 69–106. https://doi.org/10.1111/j.1529-1006.2004.00018.x.
Dweck, C. S. (1999). Self-theories: Their role in motivation, personality and development. Philadelphia: Taylor and Francis/Psychology Press.
Dweck, C. S., & Leggett, E. L. (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256–273. https://doi.org/10.1037/0033-295X.95.2.256.
Ehrlinger, J., Johnson, K., Banner, M., Dunning, D., & Kruger, J. (2008). Why the unskilled are unaware: Further explorations of (absent) self-insight among the incompetent. Organizational Behavior and Human Decision Processes, 105, 98–121. https://doi.org/10.1016/j.obhdp.2007.05.002.
Elliot, A. J., & Murayama, K. (2008). On the measurement of achievement goals: Critique, illustration, and application. Journal of Educational Psychology, 100, 613–628. https://doi.org/10.1037/0022-0663.100.3.613.
Erdmann, R., Miller, K., & Stains, M. (2020). Exploring STEM postsecondary instructors’ accounts of instructional planning and revisions. International Journal of STEM Education, 7(1), 1–17. https://doi.org/10.1186/s40594-020-00206-7.
Fakcharoenphol, W., Morphew, J.W., & Mestre, J.P. (2015). Judgments of physics problem difficulty among experts and novices. Physical Review Physics Education Research, 11(2), 020108. https://doi.org/10.1103/PhysRevSTPER.11.02012.
Finn, B., & Metcalfe, J. (2008). Judgments of learning are influenced by memory for past test. Journal of Memory and Language, 58, 19–34. https://doi.org/10.1016/j.jml.2007.03.006.
Flavel, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive developmental inquiry. American Psychologist, 34, 906–911. https://doi.org/10.1037/0003-066X.34.10.906.
Foster, N. L., Was, C. A., Dunlosky, J., & Isaacson, R. M. (2017). Even after thirteen class exams, students are still overconfident: The role of memory for past exam performance in student predictions. Metacognition & Learning, 12, 1–19. https://doi.org/10.1007/s11409-016-9158-6.
Geurten, M., & Meulemans, T. (2017). The effect of feedback on children’s metacognitive judgments: A heuristic account. Journal of Cognitive Psychology, 29, 184–201. https://doi.org/10.1080/20445911.2016.1229669.
Glaser, R., & Chi, M. T. H. (1988). Overview. In M. T. H. Chi, R. Glaser, & M. Farr (Eds.), The Nature of Expertise (pp. xv-xxvii). Hillsdale, NJ: Erlbaum.
Greene, J. A., & Azevedo, R. (2007). A theoretical review of Winne and Hadwin’s model of self-regulated learning: New perspectives and directions. Review of Educational Research, 77, 334–372. https://doi.org/10.3102/003465430303953.
Gul, F., & Shehzad, S. (2012). Relationship between metacognition, goal orientation and academic achievement. Procedia – Social and Behavioral Sciences, 47, 1864–1868. https://doi.org/10.1016/j.sbspro.2012.06.914.
Hacker, D. J., Bol, L., & Bahbahani, K. (2008). Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition and Learning, 3, 101–121. https://doi.org/10.1007/s11409-008-9021-5.
Hacker, D. J., Bol, L., Horgan, D. D., & Rakow, E. A. (2000). Test prediction and performance in a classroom context. Journal of Educational Psychology, 92, 160–170. https://doi.org/10.1037/0022-0663.92.1.160.
Hartwig, M. K., & Dunlosky, J. (2012). Study strategies of college students: Are self-testing and scheduling related to achievement? Psychonomic Bulletin and Review, 19, 126–134. https://doi.org/10.3758/s13423-011-0181-y.
Henderson, Mestre, & Slakey, 2015.
Hofer, B. K. (2004). Epistemological understanding as a metacognitive process: Thinking aloud during online-searching. Educational Psychologist, 39, 43–55. https://doi.org/10.1207/s15326985ep3901_5.
Hong, Y-Y., Chiu, C-Y., & Dweck, C. S. (1995). Implicit theories of intelligence: Reconsidering the role of confidence in achievement motivation. In M. H. Kernis (Ed.), Efficacy, agency, and self-esteem (pp. 197–216). New York, NY: Springer Science and Business Media. DOI: https://doi.org/10.1007/978-1-4899-1280-0_10.
Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modeling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6, 53–60.
Karpicke, J. D., Butler, A. C., & Roedigger, H. L. (2009). Metacognitive strategies in student learning: Do students practice retrieval when they study on their own? Memory, 17, 471–479. https://doi.org/10.1080/09658210802647009.
Kelemen, W. L., Winningham, R. G., & Weaver III, C. A. (2007). Repeated testing sessions and scholastic aptitude in college students’ metacognitive accuracy. European Journal of Cognitive Psychology, 19, 689–717. https://doi.org/10.1080/09541440701326170.
Kelley, C. M., & Jacoby, L. L. (1996). Adult egocentrism: Subjective experience versus analytic bases for judgment. Journal of Memory and Language, 35, 157–175. https://doi.org/10.1006/jmla.1996.0009.
Keren, G. (1990). Cognitive aids and debiasing methods: Can cognitive pills cure cognitive ills? Advances in Psychology, 68, 523–552. https://doi.org/10.1016/S0166-4115(08)61341-2.
Kim, J. H. (2018). The effect of metacognitive monitoring feedback on performance in a computer-based training simulation. Applied Ergonomics, 67, 193–202. https://doi.org/10.1016/j.apergo.2017.10.006.
King, B. (2015). Changing college majors: Does it happen more in STEM and do grades matter? Journal of College Science Teaching, 44, 44–51. https://doi.org/10.2505/4/jcst15_044_03_44.
Kitchner, K. S. (1983). Cognition, metacognition, and epistemic cognition: A three-level model of cognitive processing. Human Development, 26, 106–116.
Koriat, A. (1997). Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126, 349–370. https://doi.org/10.1037/0096-3445.126.4.349.
Koriat, A. (2007). Metacognition and consciuousnees. In P. D. Zelazo, M. Moscovitch, & E. Thompson (Eds.), The Cambridge handbook of consciousness (pp. 289–325). Cambridge, UK: Cambridge University Press.
Koriat, A., Ma'ayan, H., & Nussinson, R. (2006). The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior. Journal of Experimental Psychology: General, 135, 36–69. https://doi.org/10.1037/0096-3445.135.1.36.
Koriat, A., Nussinson, R., & Ackerman, R. (2014). Judgments of learning depend on how learners interpret study effort. Journal of Experimental Psychology: Learning, Memory, and Cognition, 40, 1624–1637. https://doi.org/10.1037/xlm0000009.
Kostons, D., van Gog, T., & Paas, F. (2012). Training self-assessment and task-selection skills: A cognitive approach to improving self-regulated learning. Learning and Instruction, 22, 121–132. https://doi.org/10.1016/j.learninstruc.2011.08.004.
Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77, 1121–1134. https://doi.org/10.1037/0022-3514.77.6.1121.
Laburn, A. S., Zimmerman, B. J., & Hasselhorn, M. (2010). Enhancing students’ self-regulation and mathematics performance: The influence of feedback and self-evaluative standards. Metacognition and Learning, 5, 173–194. https://doi.org/10.1007/s114909-010-9056-2.
Lipko, A. R., Dunlosky, J., Hartwig, M. K., Rawson, K. A., Swan, K., & Cook, D. (2009). Using standards to improve middle school students’ accuracy at evaluating the quality of their recall. Journal of Experimental Psychology: Applied, 15, 307–318. https://doi.org/10.1037/a0017599.
Maki, R. H., Shields, M., Wheeler, A. E., & Zacchilli, T. L. (2005). Individual differences in absolute and relative metacomprehension accuracy. Journal of Educational Psychology, 97, 723–731. https://doi.org/10.1037/0022-0663.97.4.723.
Mason, L., Boldrin, A., & Ariasi, N. (2010). Epistemic metacognition in context: Evaluating and learning online information. Metacognition and Learning, 5, 67–90. https://doi.org/10.1007/s11409-009-9048-2.
Metcalfe, J., & Finn, B. (2008). Evidence that judgments of learning are causally related to study choice. Psychonomic Bulletin & Review, 15, 174–179. https://doi.org/10.3758/PBR.15.1.174.
Metcalfe, J., & Kornell, N. (2005). A region of proximal learning model of study time allocation. Journal of Memory and Language, 52, 463–477. https://doi.org/10.1016/j.jml.2004.12.001.
Miller, T. M., & Geraci, L. (2011). Training metacognition in the classroom: The influence of incentives and feedback on exam predictions. Metacognition and Learning, 6, 303–314. https://doi.org/10.1007/s11409-011-9083-7.
Morphew, J.W., Gladding, G.E., & Mestre, J.P. (2020). Effect of presentation style and problem-solving attempts on metacognition and learning from solution videos. Physical Review Physics Education Research, 16(1), 010104. https://doi.org/10.1103/PhysRevPhysEducRes.16.010104.
Muis, K. R., & Franco, G. M. (2010). Epistemic profiles and metacognition: Support for the consistency hypothesis. Metacognition and Learning, 5, 27–45. https://doi.org/10.1007/s11409-009-9041-9.
Nagin, D. (2005). Group-based modeling of development. Cambridge, MA: Harvard University Press.
Nagin, D. S., & Odgers, C. L. (2010). Group-based trajectory modeling in clinical research. Annual Review of Clinical Psychology, 6, 109–138. https://doi.org/10.1146/annurev.clinpsy.121208.131413.
Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 26, pp. 125–173). New York, NY: Academic Press.
Nelson, T. O., & Narens, L. (1994). Why investigate metacognition? In J. Metcalfe & A. P. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1–26). Cambridge, MA: MIT Press.
Nietfeld, J. L., Cao, L., & Osborne, J. (2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. The Journal of Experimental Education, 74, 7–28.
Nietfeld, J. L., Cao, L., & Osborne, J. W. (2006). The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy. Metacognition and Learning, 1, 159–179. https://doi.org/10.1007/s10409-006-9595-6.
Ozuru, Y., Kurby, K. A., & McNamara, D. S. (2012). The effect of metacomprehension judgment task on comprehension monitoring and metacognitive accuracy. Metacognition and Learning, 7, 113–131. https://doi.org/10.1007/s11409-012-9087-y.
Pieschl, S., Stahl, E., & Bromme, R. (2008). Epistemological beliefs and self-regulated learning with hypertext. Metacognition and Learning, 3, 18–27. https://doi.org/10.1007/s11409-007-9008-7.
Pintrich, P. P. (2002). The role of metacognitive knowledge in learning, teaching, and assessing. Theory Into Practice, 41, 219–225. https://doi.org/10.1207/s15430421tip4104_3.
Raaijmakers, S. F., Baars, M., Paas, F., van Merrienboer, J. J. G., & van Gog, T. (2019). Effects of self-assessment feedback on self-assessment and task-selection accuracy. Metacognition and Learning, 14, 21–42. https://doi.org/10.1007/s11409-019-09189-5.
Rawson, K. A., & Dunlosky, J. (2007). Improving students’ self-evaluation of learning for key concepts in textbook materials. European Journal of Cognitive Psychology, 19, 559–579. https://doi.org/10.1080/09541440701326022.
Rebello, N. S. (2012). How accurately can students estimate their performance on an exam and how does this relate to their actual performance on the exam? In N. S. Rebello, P. V. Engelhardt, & C. Singh (Eds.), AIP Conference Proceedings (Vol. 1413, pp. 315–318). AIP. https://doi.org/10.1063/1.3680058.
Saenz, G. D., Geraci, L., Miller, T. M., & Tirso, R. (2017). Metacognition in the classroom: The association between students’ exam predictions and their desired grades. Consciousness and Cognition, 51, 125–139. https://doi.org/10.1016/j.concog.2017.03.002.
Simons, D. J. (2013). Unskilled and optimistic: Overconfident predictions despite calibrated knowledge of relative skill. Psychonomic Bulletin & Review, 20, 601–607. https://doi.org/10.3758/s13423-013-0379-2.
Schlosser, T., Dunning, D., Johnson, K. L., & Kruger, J. (2013). How unaware are the unskilled? Empirical tests of the “signal extraction” counterexplanation for the Dunning-Kruger effect in self-evaluation of performance. Journal of Economic Psychology, 39, 85–100. https://doi.org/10.1016/j.joep.2013.07.004.
Schneider, W. (2002). Memory development in childhood. In U. Goswami (Ed.), Blackwell handbook of childhood cognitive development (pp. 236–256). Malden, MA: Blackwell.
Schommer, M. (1990). Effects of beliefs about the nature of knowledge on comprehension. Journal of Educational Psychology, 82, 498–504. https://doi.org/10.1037/0022-0663.82.3.498.
Schwartz, B. L., & Efklides, A. (2015). Metamemory and memory efficiency: Implications for student learning. Journal of Applied Research in Memory and Cognition, 1, 145–151. https://doi.org/10.1016/j.jarmac.2012.06.002.
Scott, B. M., & Levy, M. G. (2013). Metacognition: Examining the components of a fuzzy concept. Educational Research, 2, 120–131. https://doi.org/10.5838/erej.2013.22.04.
Serra, M. J., & DeMarree, K. G. (2016). Unskilled and unaware in the classroom: College students’ desired grades predict their biased grade predictions. Memory & Cognition, 44, 1127–1137. https://doi.org/10.3758/s13421-016-0624-9.
Soderstrom, N. C., Yue, C. L., & Bjork, E. L. (2015). Metamemory and education. In J. Dunlosky and S. K. Tauber (Eds.) The Oxford Handbook of Metamemory. Oxford, UK: Oxford University Press. Retrieved from http://www.oxfordhandbooks.com/view/10.1093 /oxfordhb /9780199336746.001.0001/oxfordhb-9780199336746-e-6.
Son, L. K., & Metcalfe, J. (2000). Metacognitive and control strategies in study-time allocation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 204–221. https://doi.org/10.1037/0278-7393.26.1.204.
Stahl, E., & Bromme, R. (2007). The CAEB: An instrument for measuring connotative aspects of epistemological beliefs. Learning and Instruction, 17, 773–785. https://doi.org/10.1016/j.learninstruc.2007.09.016.
Tauber, S. K., & Dunlosky, J. (2015). Monitoring of learning at the category level when learning a natural concept: Will task experience improve its resolution? Acta Psychologica, 155, 8-18. DOI: 10/1016/j.actpsy.2014.11.011.
Tauber, S. K., & Rhodes, J. (2012). Multiple bases for young and older adults’ judgments of learning in multiblock learning. Psychology and Aging, 27, 474–483. https://doi.org/10.1037/a0025246.
Thompson, W. B. (1998). Metamemory accuracy: Effects of feedback and the stability of individual differences. The American Journal of Psychology, 111, 33–42.
Tobias, S., & Everson, H. T. (2009). The importance of knowing what you know: A knowledge monitoring framework for studying metacognition in education. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 107–127). New York, NY: Routledge.
Tuysuzoglu, B. B., & Greene, J. A. (2015). An investigation of the role of contingent metacognitive behavior in self-regulated learning. Metacognition and Learning, 10, 77–98. https://doi.org/10.1007/s11409-014-9126-y.
Urban, K., & Urban, M. (2019). Improving the accuracy of the self-evaluation during on-screen self-regulated learning through calibration feedback. In INTED2019 proceedings (pp. 9002-9007). Spain.
Urban, K., & Urban, M. (2018). Influence of fluid intelligence on accuracy of metacognitive monitoring in preschool children fades with the calibration feedback. Studia Psychologica, 60, 123–136. https://doi.org/10.21909/sp.2018.02.757.
Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1, 3–14. https://doi.org/10.1007/s11409-006-6893-0.
Wilkinson, S. C., Reader, W., & Payne, S. J. (2012). Adaptive browsing: Sensitivity to time pressure and task difficulty. International Journal of Human-Computer Studies, 70, 14–25. https://doi.org/10.1016/j.ijhcs.2011.08.003.
Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Mahwah: Erlbaum.
Winne, P. H., & Hadwin, A. F. (2008). The weave of motivation and self-regulated learning. In D. H. Schunk & B. J. Zimmerman (Eds.), Motivation and self-regulated learning: Theory, research, and applications (pp. 297–314). New York, NY: Erlbaum.
Zimmerman, B. J. (2000). Attainment of self-regulation: A social cognitive perspective. In M. Boekaerts, P. Pintrich, & M. Zeidner (Eds.), Self-regulation: Theory, research, and applications (pp. 13–39). Orlando: Academic.
Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45, 166–183. https://doi.org/10.3102/0002831207312909.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author declares that they have no conflicts of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Morphew, J.W. Changes in metacognitive monitoring accuracy in an introductory physics course. Metacognition Learning 16, 89–111 (2021). https://doi.org/10.1007/s11409-020-09239-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11409-020-09239-3