Skip to main content
Log in

Choose Your Evidence

Scientific Thinking Where It May Most Count

  • Article
  • Published:
Science & Education Aims and scope Submit manuscript

A Correction to this article was published on 13 August 2021

This article has been updated

Abstract

Schooling traditionally affords students more experience in learning and practicing procedures than in identifying what a situation calls for. When asked to choose appropriate numerical data to support their causal claims, college students perform surprisingly poorly. In one case we describe, almost all chose limited, inconclusive data as sufficient evidence, despite having available the more comprehensive data needed to support their claim and despite their established competence to employ such data for this purpose. Our objective in highlighting this weakness is to make a case that choosing one’s evidence warrants the status of an important metacognitive intellectual skill and educational objective, one central to but that extends well beyond the domains of scientific and mathematical reasoning and hence warrants greater attention both in and beyond the science curriculum. People may choose evidence to justify their assertions in an ill-considered way, with potential adverse effects in both private and public communication.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Change history

References

  • Arvidsson, T.S., & Kuhn, D. (2021). Realizing the full potential of individualizing learning. Contemporary Educational Psychology.

  • Barzilai, S., & Zohar, A. (2012). Epistemic thinking in action: Evaluating and integrating online sources. Cognition and Instruction, 30, 39–85.

    Article  Google Scholar 

  • Barzilai, S., Tzadok, E., & Eshet-Alkalai, Y. (2015). Sourcing while reading divergent expert accounts: Pathways from views of knowing to written argumentation. Instructional Science, 43, 737–766.

    Article  Google Scholar 

  • De Keersmaecker, J., Dunning, D., Pennycook, G., et al. (2019). Investigating the robustness of the illusory truth effect across individual differences in cognitive ability, need for cognitive closure, and cognitive style. Personality and Social Psychology Bulletin, 46, 204–215. https://doi.org/10.1177/0146167219853844.

    Article  Google Scholar 

  • Denison, S., & Xu, F. (2019). Infant statisticians: The origins of reasoning under uncertainty. Perspectives on Psychological Science, 14, 499–509.

    Article  Google Scholar 

  • DiSessa, A. (2001). Changing minds: Computers, learning, and literacy. Cambridge: MIT.

    Google Scholar 

  • Duncan, R., Chinn, C., & Barzilai, S. (2018). Grasp of evidence: Problematizing and expanding the next generation science standards’ conceptualization of evidence. Journal of Research in Science Teaching, 55, 907–937. https://doi.org/10.1002/tea.21468.

    Article  Google Scholar 

  • Elmore, R. (2018a). Beijing Academy: Innovation, design, and learning. ECNU Review of Education, 1, 135–146.

    Article  Google Scholar 

  • Elmore, R. (2018b). Design as learning, learning as design. In R. Ellis & P. Goodyear (Eds.), Spaces of teaching and learning. Understanding teaching-learning practice (pp. 47–62). Singapore: Springer.

    Google Scholar 

  • Greene, J., Sandoval, W., & Braten, I. (Eds.). (2016). Handbook of epistemic cognition. New York: Routledge.

    Google Scholar 

  • Hemberger, L., Kuhn, D., Matos, F., & Shi, Y. (2017). A dialogic path to evidence-based argumentive writing. Journal of the Learning Sciences, 26, 575–607.

  • Hills, T. (2018). The dark side of information proliferation. Perspectives on Psychological Science. https://doi.org/10.1177/1745691618803647.

  • Hilton, A., & Hilton, G. (2016). Proportional reasoning: An essential component of scientific understanding. Teaching Science, 62, 32–42.

    Google Scholar 

  • Iordanou, K. (2010). Developing argument skills across scientific and social domains. Journal of Cognition and Development, 11, 293–327.

    Article  Google Scholar 

  • Iordanou, K. (2017). From theory of mind to epistemic cognition. A lifespan perspective. Frontline Learning Research, 4, 106–119.

    Article  Google Scholar 

  • Iordanou, K., & Constantinou, C. (2015). Supporting use of evidence in argumentation through practice in argumentation and reflection in the context of SOCRATES learning environment. Science Education, 99, 282–311.

    Article  Google Scholar 

  • Jiménez-Aleixandre, M. P., & Puig, B. (2012). Argumentation, evidence evaluation and critical thinking. In B. Fraser, K. Tobin, & C. McRobbie (Eds.), Second international handbook of science education. Dordrecht: Springer.

    Google Scholar 

  • Jiménez-Aleixandre, M. P., Rodriguez, A., & Duschl, R. (2000). “Doing the lesson” or “doing science”: Argument in high school genetics. Science Education, 84, 757–792.

    Article  Google Scholar 

  • Kahneman, D., Slovic, P., & Tversky, A. (Eds.). (1982). Judgment under uncertainty: Heuristics and biases. Cambridge: Cambridge University Press.

    Google Scholar 

  • Kuhn, D. (2005). Education for thinking. Cambridge MA: Harvard University Press.

  • Kuhn, D. (2009). The importance of learning about knowing: Creating a foundation for development of intellectual values. Perspectives on Child Development, 3, 112–117.

  • Kuhn, D. (2012). The development of causal reasoning. WIREs Cognitive Science. https://doi.org/10.1002/wcs.1160.

  • Kuhn, D. (2018). Building Our best future: Thinking critically about ourselves and our world. New York: Wessex Learning.

  • Kuhn, D. (2019). Critical thinking as discourse. Human Development, 62, 146–164. https://doi.org/10.1159/000500171.

  • Kuhn, D. (2020). Why is reconciling divergent views a challenge? Current Directions in Psychological Science, 29, 27–32. https://doi.org/10.1177/0963721419885996.

  • Kuhn, D., & Crowell, A. (2011). Dialogic argumentation as a vehicle for developing young adolescents’ thinking. Psychological Science, 22, 545–552.

  • Kuhn, D., & Lerman, D. (2021). Yes but: Developing a critical stance toward evidence. International Journal of Science Education.

  • Kuhn, D., & Modrek, A. (2018). Do reasoning limitations undermine discourse? Thinking and Reasoning, 24, 97–116.

  • Kuhn, D., & Moore, W. (2015). Argument as core curriculum. Learning: Research and Practice, 1, 66–78.

  • Lazer, D., Baum, M., et al. (2018). The science of fake news. Science, 359, 1094–1096.

    Article  Google Scholar 

  • Lee, V. R., & Wilkerson, M. (2018). Data use by middle and secondary students in the digital age: A status report and future prospects. Washington, D.C: Commissioned paper for the National Academies of Sciences, Engineering, and Medicine, Board on Science Education, Committee on Science Investigations and Engineering Design for Grades 6–12.

    Google Scholar 

  • Macagno, F. (2016). Argument relevance and structure: Assessing and developing students’ uses of evidence. International Journal of Educational Research, 79, 180–194.

    Article  Google Scholar 

  • Macagno, F., & Walton, D. (2018). Practical reasoning arguments: A modular approach. Argumentation., 32, 519–547. https://doi.org/10.1007/s10503-018-9450-5.

    Article  Google Scholar 

  • Mayweg-Paus, E., & Macagno, F. (2016). How dialogic settings influence evidence use in adolescent students. Zeitschrift für Pädagogische Psychologie, 30, 121–132. https://doi.org/10.1024/1010-0652/a000171.

    Article  Google Scholar 

  • McNeill, K., & Berland, L. (2017). What is (or should be) scientific evidence use in k-12 classrooms? Journal of Research in Science Teaching, 54, 672–689.

    Article  Google Scholar 

  • Mehan, H., & Cazden, C. (2015). The study of classroom discourse: Early history and current developments. In L. Resnick, C. Asterhan, & S. Clarke (Eds.), Socializing intelligence through academic talk and dialogue. Washington DC: American Educational Research Association.

    Google Scholar 

  • Mercer, N., & Littleton, K. (2007). Dialogue and development of children’s thinking. A sociocultural approach. London and New York: Routledge.

    Book  Google Scholar 

  • Mercier, H., & Sperber, D. (2011). Why do humans reason? Arguments for an argumentative theory. Behavioral and Brain Sciences, 34, 57–111.

    Article  Google Scholar 

  • Metz, S., Weisberg, D., & Weisberg, M. (2018). Non-scientific criteria for belief sustain counter-scientific beliefs. Cognitive Science, 42, 1477–1503. https://doi.org/10.1111/cogs.1258.

    Article  Google Scholar 

  • Miller, E., Manz, E., Russ, R., Stroupe, D., & Berland, L. (2018). Addressing the epistemic elephant in the room: Epistemic agency and the next generation science standards. Journal of Research in Science Teaching, 55, 1053–1075. https://doi.org/10.1002/tea.21459.

    Article  Google Scholar 

  • Mills, C. M. (2013). Knowing when to doubt: Developing a critical stance when learning from others. Developmental Psychology, 49, 404–418.

    Article  Google Scholar 

  • Miralda-Banda, A., Garcia-Mila, M., & Felton, M. (2019). Concept of evidence and the quality of evidence-based reasoning in elementary students. Topoi. https://doi.org/10.1007/s11245-019-09685-y.

  • Modrek, A., & Kuhn, D. (2017). A cognitive cost of the need to achieve? Cognitive Development 44, 12–20.

  • Modrek, A., Kuhn, D., Conway, A., & Arvidsson, T.S. (2019). Cognitive regulation, not behavior regulation, predicts learning. Learning and Instruction. https://doi.org/10.1016/j.learninstruc.2017.12.001.

  • Monteira, S., & Jiménez-Aleixandre, M. P. (2016). The practice of using evidence in kindergarten: The role of purposeful observation. Journal of Research in Science Teaching, 53, 1232–1258.

    Article  Google Scholar 

  • Moshman, D. (2015). Epistemic cognition and development: The psychology of justification and truth. New York: Psychology.

    Google Scholar 

  • Papathomas, L., & Kuhn, D. (2017). Learning to argue via apprenticeship. Journal of Experimental Child Psychology, 159, 129–139.

  • Pennycook, G., & Rand, D. (2018). Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning. Cognition, 10, 1016.

    Google Scholar 

  • Rapanta, C. (2019). Argumentation as critically oriented pedagogical dialogue. Informal Logic, 39, 1–31.

    Article  Google Scholar 

  • Resnick, L., Asterhan, C., & Clarke, S. with Schantz, F. (2018). Next generation research in dialogic learning. In G. Hall, L. Quinn, & D. Gollnick (Eds.), Wiley handbook of teaching and learning. New York: Wiley.

    Google Scholar 

  • Reznitskaya, A., & Wilkinson, A. (2017). The most reasonable answer: Helping students build better arguments together. Cambridge: Harvard Education Press.

    Google Scholar 

  • Rittle-Johnson, B. (2017). Developing mathematics knowledge. Child Development Perspectives, 11, 184–190.

    Article  Google Scholar 

  • Rudolph, J. L. (2014). Dewey’s ‘science as method’ a century later reviving science education for civic ends. American Educational Research Journal, 51, 1056–1083.

    Article  Google Scholar 

  • Ryu, S., & Sandoval, W. (2012). Improvements to elementary children’s epistemic understanding from sustained argumentation. Science Education, 96, 488–526.

    Article  Google Scholar 

  • Sampson, V., & Clark, D. (2008). Assessment of the ways students generate arguments in science education: Current perspectives and recommendations for future directions. Science Education, 92, 447–472.

    Article  Google Scholar 

  • Scardamalia, M., & Bereiter, C. (2015). Education in an open informational world. In R. Scott & M. Buchmann (Eds.), Emerging trends in the social and behavioral sciences. Hoboken: Wiley Online Library. https://doi.org/10.1002/9781118900772.

    Chapter  Google Scholar 

  • Settlage, J., & Southerland, S. (2019). Epistemic tools for science classrooms: The continual need to accommodate and adapt. Science Education, 103, 1112–1119.

    Article  Google Scholar 

  • Shi, Y. (2019). Enhancing evidence-based argumentation in a mainland China middle school. Contemporary Educational Psychology, 59, 101809. https://doi.org/10.1016/j.cedpsych.2019.101809.

    Article  Google Scholar 

  • Shi, Y. (2020). Constructed dialogs reveal skill development in argumentive writing. Reading and Writing. https://doi.org/10.1007/s11145-020-10045-1.

  • Siegler, R., Thompson, C., & Schneider, M. (2011). An integrated theory of whole number and fractions development. Cognitive Psychology, 62, 273–296.

    Article  Google Scholar 

  • Sikorski, T. R., & Hammer, D. (2017). Looking for coherence in science curriculum. Science Education, 101, 929–943.

    Article  Google Scholar 

  • Sperber, D., Clement, F., Heintz, C., Mascaro, O., Mercier, H., Origgi, G., & Wilson, D. (2010). Epistemic vigilance. Mind & Language, 25, 359–498.

    Article  Google Scholar 

  • Teig, N., Scherer, R., & Kjaernsli, M. (2020). Identifying patterns of students’ performance on simulated inquiry tasks using PISA 2015 log-file data. Journal of Research in Science Teaching, 57, 1400–1429. https://doi.org/10.1002/tea.21657.

    Article  Google Scholar 

  • Tourniaire, F. & Pulos, S. (1985). Proportional reasoning: A review of the literature Educational Studies in Mathematics, 16, 181–204.

  • VanDooren, W., Vamvakoussi, X., & Verschaffel, L. (2018). Proportional reasoning. In Educational Practices Series, 30 (Vol. 8). International Academy of Education.

  • Villarroel, C., Felton, M., & Garcia-Mila, M. (2016). Arguing against confirmation bias: The effect of argumentative discourse goals on the use of disconfirming evidence in written argument. International Journal of Educational Research, 79, 167–179.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Deanna Kuhn.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised: The original version of this article unfortunately contains incorrect article title due to a typesetting mistake.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kuhn, D., Modrek, A.S. Choose Your Evidence. Sci & Educ 31, 21–31 (2022). https://doi.org/10.1007/s11191-021-00209-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11191-021-00209-y

Keywords

Navigation