Abstract
The Program for International Student Assessment (PISA) testing is conducted every 3 years by the Organization for Economic Co-operation and Development (OECD; oecd.org) with 15-year-olds across the globe. Students complete a battery of tests in science, reading, and mathematics and complete an attitudinal survey. The goal of the PISA testing is to determine, broadly, if children are prepared for successful adulthoods. This means that items on the test are application- and not theoretically based. The mathematics portion of the PISA test includes problems in four content subtest areas: (1) change and relationships, (2) quantity, (3) uncertainty and data, and (4) space and shape. The subscale most closely related to spatial cognition is space and shape. Developers of the mathematics portion of the test indicate that student scores on subset areas 1 through 3 also depend on a child’s understanding of space and shape; thus, the space and shape construct is a key to overall performance on the test. The goal of this paper is twofold. First, it examines PISA data by subtest for several countries by analyzing trends between high-performing countries and other countries of interest with a particular focus on the subtest scores for space and shape. Second, the paper examines the relationship between scores on individual released items from PISA and scores on standard instruments designed to assess spatial skills for students from the USA. Findings indicate that success on PISA items is significantly correlated with scores on tests of spatial cognition. This finding means that improving spatial skills could be an overlooked strategy to improve student performance on large-scale tests of student achievement and has the potential to ultimately better prepare children for successful adulthoods.
Similar content being viewed by others
References
Alibali, M. W. (2005). Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition and Computation, 5(4), 307–331.
Bennett, G. K., Seashore, H. G., & Wesman, A. G. (1973). Differential aptitude tests, forms S and T. New York: The Psychological Corporation.
Carroll, J. B., (1993). Human cognitive abilities: A survey of factor-analytic studies. Cambridge University Press.
Casey, B. M., Dearing, E., Vasilyeva, M., Ganley, C. M., & Tine, M. (2011). Spatial and numerical predictors of measurement performance: The moderating effects of community income and gender. Journal of Educational Psychology., 103(2), 296–311.
Cheng, Y. L., & Mix, K. S. (2014). Spatial training improves children’s mathematics ability. Journal of Cognition and Development, 15(1), 2–11. https://doi.org/10.1080/15248372.2012.725186.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New Jersey: Lawrence Earlbaum Associates.
Deno, J. A. (1995). The relationship of previous experiences to spatial visualization ability. Engineering Design Graphics Journal, 59(3), 5–17.
Duesbury, R. T., & O’Neil Jr., H. F. (1996). Effect of type of practice in a computer-aided design environment in visualizing there-dimensional objects from two-dimensional orthographic projections. Journal of Applied Psychology, 81, 249–260.
Duffy, G., Sorby, S., & Bowe, B. (2020). Spatial ability is a key cognitive factor in the representation of word problems in mathematics among engineering students, Journal Of Engineering Education, (In review).
Eyal, R. & Tendick, F. (2001). Spatial ability and learning the use of an angled laparoscope in a virtual environment. Medicine Meets Virtual Reality 2001,J. D. Westwood et al, Editors, IOS Press, Amsterdam, pp. 146–152.
Frick, A. (2018). Spatial transformation abilities and their relation to later mathematics performance. Psychological Research, 83, 1465–1484. https://doi.org/10.1007/s00426-018-1008-5.
Gerson, H. B. P., Sorby, S. A., Wysocki, A., & Baartmans, B. J. (2001). The development and assessment of multimedia software for improving 3-D spatial visualization skills. Computer Applications in Engineering Education, 9(2), 105–113.
Gilligan, K. A., Flouri, E., Farran, E., & K. (2017). The contribution of spatial ability to mathematics achievement in middle childhood. Journal of Experimental Child Psychology, 163, 107–125. https://doi.org/10.1016/j.jecp.2017.04.016.
Gilligan, K. A., Thomas, M. S. C., & Farran, E. K. (2019). First demonstration of effective spatial training for near transfer to spatial performance and far transfer to a range of mathematics skills at 8 years. Developmental Science, 1–8. https://doi.org/10.1111/desc.12909.
Guay, R. B. (1977). Purdue spatial visualization test: Rotations. West Lafayette: Purdue Research Foundation.
Gunderson, E. A., Ramirez, G., Beilock, S. L., & Levine, S. C. (2012). The relation between spatial skill and early number knowledge: The role of the linear number line. Developmental Psychology, 48(5), 1229–1241.
Hawes, A., & Ansari, D. (2020). What explains the relationship between spatial and mathematical skills? A review of evidence from brain and behavior. Psychonomic Bulletin & Review. https://doi.org/10.3758/s13423-019-01694-7.
Hawes, Z., Moss, J., Caswell, B., & Poliszczuk, D. (2015). Effects of mental rotation training on children’s spatial and mathematics performance: A randomized controlled study. Trends in Neuroscience and Education, 4, 60–68. https://doi.org/10.1016/j.tine.2015.05.001.
Hegarty, M., Keehner, M., Khooshabeh, P., & Montello, D. (2009). How spatial abilities enhance, and are enhanced by dental education. Learning and Individual Differences, 19, 61–70. https://doi.org/10.1016/j.lindif.2008.04.006.
Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the Programme for International Student Assessment. Scandinavian Journal of Educational Research, 62(3), 333–353. https://doi.org/10.1080/00313831.2016.1258726.
Jones, S., & Burnett, G. (2008). Spatial ability and learning to program. Human Technology, 4(1), 47–61.
Kali, Y., & Orion, N. (1996). Spatial abilities of high-school students in the perception of geologic structures. Journal of Research in Science Teaching, 33, 369–391.
Kozhevnikov, M., Motes, M. A., & Hegarty, M. (2007). Spatial visualization in physics problem solving. Cognitive Science, 31(4), 549–579.
Linn, M. C., & Petersen, A. C. (1985). Emergence and characterization of sex differences in spatial ability: A meta-analysis. Child Development, 56, 1479–1498.
Lowrie, T., Logan, T., & Ramful, A. (2017). Visuospatial training improves elementary students’ mathematics performance. British Journal of Educational Psychology, 87, 170–186. https://doi.org/10.1111/bjep.12142.
Mix, K. S., & Cheng, Y. L. (2012). The relation between space and math: Developmental and educational implications. Advances in Child Development and Behavior, 42, 197–243.
Moehring, W., Newcombe, N., & Frick, A. (2015). The relation between spatial thinking and proportional reasoning in pre-schoolers. Journal of Experimental Child Psychology, 132, 213–220. https://doi.org/10.1016/j.jecp.2015.01.005.
Sorby, S. A. (2001). A course in spatial visualization and its impact on the retention of women engineering students. Journal of Women and Minorities in Science and Engineering, 7(2), 153–172.
Sorby, S. A. (2009). Educational research in developing 3-D spatial skills for engineering students. International Journal of Science Education, 31(3), 459–480.
Sorby, S. A., & Baartmans, B. J. (2000). The development and assessment of a course for enhancing the 3-D spatial visualization skills of first year engineering students. Journal of Engineering Education, 89(3), 301–307.
Sorby, S. A., & Veurink, N. L. (2012). Spatial skills among minority and international engineering students. Proceedings of the annual conference of the American Society for Engineering Education, San Antonio, TX.
Sorby, S., Leopold, C., & Gorska, R. (1999). Cross-cultural comparisons of gender differences in the spatial skills of engineering students. Journal of Women and Minorities in Science and Engineering, 5(3), 279–291.
S. Sorby, T. Drummer, K. Hungwe, & P. Charlesworth (2005). “Developing 3-D spatial visualization skills for non-engineering students, “proceedings of the 2005 ASEE annual conference, Portland, Oregon.
Sorby, S. A., Casey, B., Veurink, N., & Dulaney, A. (2013). The role of spatial training in improving spatial and calculus performance in engineering students. Learning and Individual Differences, 26, 20–29.
Sorby, S. A., Veurink, N., & Streiner, S. (2018). Does spatial skills instruction improve STEM outcomes? The answer is ‘yes. Journal of Learning and Individual Differences, 67, 209–222.
Tartre, L. A. (1990). Spatial skills, gender, and mathematics. In E. H. Fennema & G. C. Leder (Eds.), Mathematics and gender (pp. 27–59). New York: Teachers College Press.
Thomson, S., De Bortoli, L., & Buckley, S. (2013). PISA 2012: How Australia measures up: The PISA 2012 assessment of students’ mathematical, scientific and reading literacy.
Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., & Newcombe, N. S. (2013). The malleability of spatial skills: A meta-analysis of training studies. Psychological Bulletin, 139(2), 352–402. https://doi.org/10.1037/a0028446.
van Garderen, D. (2006). Spatial visualization, visual imagery, and mathematical problem solving of students with varying abilities. Journal of Learning Disabilities., 39(6), 496–506.
Vandenberg, S. G., & Kuse, A. R. (1978). Mental rotations, a group test of three dimensional spatial visualization. Perceptual and Motor Skills, 47, 599–604.
Verdine, B. N., Golinkoff, R. M., Hirsh-Pasek, K., Newcombe, N. S., Filipowicz, A. T., & Chang, A. (2014). Deconstructing building blocks: Preschoolers’ spatial assembly performance relates to early mathematical skills. Child Development., 85(3), 1062–1076.
Wai, J., Lubinski, D., & Benbow, C. P. (2009). Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology, 101(4), 817–835.
Wu, H. K., & Shah, P. (2004). Exploring visuospatial thinking in chemistry learning. Science Education, 88(3), 465–492.
Acknowledgements
The authors gratefully acknowledge the IES for their support of this work through grant number R305A170640. The data presented in this paper was gathered during the course of this project. The PI of the project is Dr. Sheryl Sorby (University of Cincinnati) and coPIs are Dr. Logan Fiorella (University of Georgia) and Dr. David Uttal (Northwestern University). Other collaborators on the project include Norma Veurink, Dr. Jason Powers, Camille Msall, Dr. Vivian Wong, Dr. Kinnari Atit, Dr. Grace Panther, Dr. So Yoon Yoon, and Kylie Anglin.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
ESM 1
(PDF 285 kb)
Appendix A
Appendix A
The mathematics instrument used in this study follows. The items were compiled from released items from the PISA mathematics assessment (https://www.oecd.org/pisa/38709418.pdf).
Rights and permissions
About this article
Cite this article
Sorby, S.A., Panther, G.C. Is the key to better PISA math scores improving spatial skills?. Math Ed Res J 32, 213–233 (2020). https://doi.org/10.1007/s13394-020-00328-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13394-020-00328-9