Abstract
Schooling traditionally affords students more experience in learning and practicing procedures than in identifying what a situation calls for. When asked to choose appropriate numerical data to support their causal claims, college students perform surprisingly poorly. In one case we describe, almost all chose limited, inconclusive data as sufficient evidence, despite having available the more comprehensive data needed to support their claim and despite their established competence to employ such data for this purpose. Our objective in highlighting this weakness is to make a case that choosing one’s evidence warrants the status of an important metacognitive intellectual skill and educational objective, one central to but that extends well beyond the domains of scientific and mathematical reasoning and hence warrants greater attention both in and beyond the science curriculum. People may choose evidence to justify their assertions in an ill-considered way, with potential adverse effects in both private and public communication.
Similar content being viewed by others
Change history
13 August 2021
A Correction to this paper has been published: https://doi.org/10.1007/s11191-021-00269-0
References
Arvidsson, T.S., & Kuhn, D. (2021). Realizing the full potential of individualizing learning. Contemporary Educational Psychology.
Barzilai, S., & Zohar, A. (2012). Epistemic thinking in action: Evaluating and integrating online sources. Cognition and Instruction, 30, 39–85.
Barzilai, S., Tzadok, E., & Eshet-Alkalai, Y. (2015). Sourcing while reading divergent expert accounts: Pathways from views of knowing to written argumentation. Instructional Science, 43, 737–766.
De Keersmaecker, J., Dunning, D., Pennycook, G., et al. (2019). Investigating the robustness of the illusory truth effect across individual differences in cognitive ability, need for cognitive closure, and cognitive style. Personality and Social Psychology Bulletin, 46, 204–215. https://doi.org/10.1177/0146167219853844.
Denison, S., & Xu, F. (2019). Infant statisticians: The origins of reasoning under uncertainty. Perspectives on Psychological Science, 14, 499–509.
DiSessa, A. (2001). Changing minds: Computers, learning, and literacy. Cambridge: MIT.
Duncan, R., Chinn, C., & Barzilai, S. (2018). Grasp of evidence: Problematizing and expanding the next generation science standards’ conceptualization of evidence. Journal of Research in Science Teaching, 55, 907–937. https://doi.org/10.1002/tea.21468.
Elmore, R. (2018a). Beijing Academy: Innovation, design, and learning. ECNU Review of Education, 1, 135–146.
Elmore, R. (2018b). Design as learning, learning as design. In R. Ellis & P. Goodyear (Eds.), Spaces of teaching and learning. Understanding teaching-learning practice (pp. 47–62). Singapore: Springer.
Greene, J., Sandoval, W., & Braten, I. (Eds.). (2016). Handbook of epistemic cognition. New York: Routledge.
Hemberger, L., Kuhn, D., Matos, F., & Shi, Y. (2017). A dialogic path to evidence-based argumentive writing. Journal of the Learning Sciences, 26, 575–607.
Hills, T. (2018). The dark side of information proliferation. Perspectives on Psychological Science. https://doi.org/10.1177/1745691618803647.
Hilton, A., & Hilton, G. (2016). Proportional reasoning: An essential component of scientific understanding. Teaching Science, 62, 32–42.
Iordanou, K. (2010). Developing argument skills across scientific and social domains. Journal of Cognition and Development, 11, 293–327.
Iordanou, K. (2017). From theory of mind to epistemic cognition. A lifespan perspective. Frontline Learning Research, 4, 106–119.
Iordanou, K., & Constantinou, C. (2015). Supporting use of evidence in argumentation through practice in argumentation and reflection in the context of SOCRATES learning environment. Science Education, 99, 282–311.
Jiménez-Aleixandre, M. P., & Puig, B. (2012). Argumentation, evidence evaluation and critical thinking. In B. Fraser, K. Tobin, & C. McRobbie (Eds.), Second international handbook of science education. Dordrecht: Springer.
Jiménez-Aleixandre, M. P., Rodriguez, A., & Duschl, R. (2000). “Doing the lesson” or “doing science”: Argument in high school genetics. Science Education, 84, 757–792.
Kahneman, D., Slovic, P., & Tversky, A. (Eds.). (1982). Judgment under uncertainty: Heuristics and biases. Cambridge: Cambridge University Press.
Kuhn, D. (2005). Education for thinking. Cambridge MA: Harvard University Press.
Kuhn, D. (2009). The importance of learning about knowing: Creating a foundation for development of intellectual values. Perspectives on Child Development, 3, 112–117.
Kuhn, D. (2012). The development of causal reasoning. WIREs Cognitive Science. https://doi.org/10.1002/wcs.1160.
Kuhn, D. (2018). Building Our best future: Thinking critically about ourselves and our world. New York: Wessex Learning.
Kuhn, D. (2019). Critical thinking as discourse. Human Development, 62, 146–164. https://doi.org/10.1159/000500171.
Kuhn, D. (2020). Why is reconciling divergent views a challenge? Current Directions in Psychological Science, 29, 27–32. https://doi.org/10.1177/0963721419885996.
Kuhn, D., & Crowell, A. (2011). Dialogic argumentation as a vehicle for developing young adolescents’ thinking. Psychological Science, 22, 545–552.
Kuhn, D., & Lerman, D. (2021). Yes but: Developing a critical stance toward evidence. International Journal of Science Education.
Kuhn, D., & Modrek, A. (2018). Do reasoning limitations undermine discourse? Thinking and Reasoning, 24, 97–116.
Kuhn, D., & Moore, W. (2015). Argument as core curriculum. Learning: Research and Practice, 1, 66–78.
Lazer, D., Baum, M., et al. (2018). The science of fake news. Science, 359, 1094–1096.
Lee, V. R., & Wilkerson, M. (2018). Data use by middle and secondary students in the digital age: A status report and future prospects. Washington, D.C: Commissioned paper for the National Academies of Sciences, Engineering, and Medicine, Board on Science Education, Committee on Science Investigations and Engineering Design for Grades 6–12.
Macagno, F. (2016). Argument relevance and structure: Assessing and developing students’ uses of evidence. International Journal of Educational Research, 79, 180–194.
Macagno, F., & Walton, D. (2018). Practical reasoning arguments: A modular approach. Argumentation., 32, 519–547. https://doi.org/10.1007/s10503-018-9450-5.
Mayweg-Paus, E., & Macagno, F. (2016). How dialogic settings influence evidence use in adolescent students. Zeitschrift für Pädagogische Psychologie, 30, 121–132. https://doi.org/10.1024/1010-0652/a000171.
McNeill, K., & Berland, L. (2017). What is (or should be) scientific evidence use in k-12 classrooms? Journal of Research in Science Teaching, 54, 672–689.
Mehan, H., & Cazden, C. (2015). The study of classroom discourse: Early history and current developments. In L. Resnick, C. Asterhan, & S. Clarke (Eds.), Socializing intelligence through academic talk and dialogue. Washington DC: American Educational Research Association.
Mercer, N., & Littleton, K. (2007). Dialogue and development of children’s thinking. A sociocultural approach. London and New York: Routledge.
Mercier, H., & Sperber, D. (2011). Why do humans reason? Arguments for an argumentative theory. Behavioral and Brain Sciences, 34, 57–111.
Metz, S., Weisberg, D., & Weisberg, M. (2018). Non-scientific criteria for belief sustain counter-scientific beliefs. Cognitive Science, 42, 1477–1503. https://doi.org/10.1111/cogs.1258.
Miller, E., Manz, E., Russ, R., Stroupe, D., & Berland, L. (2018). Addressing the epistemic elephant in the room: Epistemic agency and the next generation science standards. Journal of Research in Science Teaching, 55, 1053–1075. https://doi.org/10.1002/tea.21459.
Mills, C. M. (2013). Knowing when to doubt: Developing a critical stance when learning from others. Developmental Psychology, 49, 404–418.
Miralda-Banda, A., Garcia-Mila, M., & Felton, M. (2019). Concept of evidence and the quality of evidence-based reasoning in elementary students. Topoi. https://doi.org/10.1007/s11245-019-09685-y.
Modrek, A., & Kuhn, D. (2017). A cognitive cost of the need to achieve? Cognitive Development 44, 12–20.
Modrek, A., Kuhn, D., Conway, A., & Arvidsson, T.S. (2019). Cognitive regulation, not behavior regulation, predicts learning. Learning and Instruction. https://doi.org/10.1016/j.learninstruc.2017.12.001.
Monteira, S., & Jiménez-Aleixandre, M. P. (2016). The practice of using evidence in kindergarten: The role of purposeful observation. Journal of Research in Science Teaching, 53, 1232–1258.
Moshman, D. (2015). Epistemic cognition and development: The psychology of justification and truth. New York: Psychology.
Papathomas, L., & Kuhn, D. (2017). Learning to argue via apprenticeship. Journal of Experimental Child Psychology, 159, 129–139.
Pennycook, G., & Rand, D. (2018). Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition, 10, 1016.
Rapanta, C. (2019). Argumentation as critically oriented pedagogical dialogue. Informal Logic, 39, 1–31.
Resnick, L., Asterhan, C., & Clarke, S. with Schantz, F. (2018). Next generation research in dialogic learning. In G. Hall, L. Quinn, & D. Gollnick (Eds.), Wiley handbook of teaching and learning. New York: Wiley.
Reznitskaya, A., & Wilkinson, A. (2017). The most reasonable answer: Helping students build better arguments together. Cambridge: Harvard Education Press.
Rittle-Johnson, B. (2017). Developing mathematics knowledge. Child Development Perspectives, 11, 184–190.
Rudolph, J. L. (2014). Dewey’s ‘science as method’ a century later reviving science education for civic ends. American Educational Research Journal, 51, 1056–1083.
Ryu, S., & Sandoval, W. (2012). Improvements to elementary children’s epistemic understanding from sustained argumentation. Science Education, 96, 488–526.
Sampson, V., & Clark, D. (2008). Assessment of the ways students generate arguments in science education: Current perspectives and recommendations for future directions. Science Education, 92, 447–472.
Scardamalia, M., & Bereiter, C. (2015). Education in an open informational world. In R. Scott & M. Buchmann (Eds.), Emerging trends in the social and behavioral sciences. Hoboken: Wiley Online Library. https://doi.org/10.1002/9781118900772.
Settlage, J., & Southerland, S. (2019). Epistemic tools for science classrooms: The continual need to accommodate and adapt. Science Education, 103, 1112–1119.
Shi, Y. (2019). Enhancing evidence-based argumentation in a mainland China middle school. Contemporary Educational Psychology, 59, 101809. https://doi.org/10.1016/j.cedpsych.2019.101809.
Shi, Y. (2020). Constructed dialogs reveal skill development in argumentive writing. Reading and Writing. https://doi.org/10.1007/s11145-020-10045-1.
Siegler, R., Thompson, C., & Schneider, M. (2011). An integrated theory of whole number and fractions development. Cognitive Psychology, 62, 273–296.
Sikorski, T. R., & Hammer, D. (2017). Looking for coherence in science curriculum. Science Education, 101, 929–943.
Sperber, D., Clement, F., Heintz, C., Mascaro, O., Mercier, H., Origgi, G., & Wilson, D. (2010). Epistemic vigilance. Mind & Language, 25, 359–498.
Teig, N., Scherer, R., & Kjaernsli, M. (2020). Identifying patterns of students’ performance on simulated inquiry tasks using PISA 2015 log-file data. Journal of Research in Science Teaching, 57, 1400–1429. https://doi.org/10.1002/tea.21657.
Tourniaire, F. & Pulos, S. (1985). Proportional reasoning: A review of the literature Educational Studies in Mathematics, 16, 181–204.
VanDooren, W., Vamvakoussi, X., & Verschaffel, L. (2018). Proportional reasoning. In Educational Practices Series, 30 (Vol. 8). International Academy of Education.
Villarroel, C., Felton, M., & Garcia-Mila, M. (2016). Arguing against confirmation bias: The effect of argumentative discourse goals on the use of disconfirming evidence in written argument. International Journal of Educational Research, 79, 167–179.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was revised: The original version of this article unfortunately contains incorrect article title due to a typesetting mistake.
Rights and permissions
About this article
Cite this article
Kuhn, D., Modrek, A.S. Choose Your Evidence. Sci & Educ 31, 21–31 (2022). https://doi.org/10.1007/s11191-021-00209-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11191-021-00209-y