Abstract
This study investigated the development of perceptions of critical thinking and problem-solving skills among a group of students taking part in instructional design projects to produce digital materials using different instructional design models. The study participants were students from a computer science teaching department who were enrolled in an instructional design course. Participants were divided into two groups according to instructional design model. The rapid prototyping model (RPM) group consisted of 47 students working in 9 teams on an assignment to develop an e-book for educational use, and the Dick and Carey model (DCM) group consisted of 37 students working in 7 teams on an assignment to design digital materials to enrich courses on a specific subject. Student perceptions of the development of their critical thinking and problem-solving skills were analyzed using a causal-comparative approach, with the Big Five Personality traits as covariance. The RPM group indicated significant improvements in their perceived problem-solving skills, particularly with respect to their confidence in undertaking tasks, whereas the DCM group perceived significant improvements in their disposition to critical-thinking, particularly with respect to self-confidence and analyticity. The Openness to Experience trait was reported to be a significant covariance on the self-confidence sub-factor of both skills, as was the trait Extraversion. The findings are discussed in detail, along with recommendations for further research.
Similar content being viewed by others
References
Abrami, P. C., Bernard, R. M., Borokhovski, E., Wade, A., Surkes, M. A., Tamim, R., et al. (2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research., 78(4), 1102–1134.
Akkuş, Y., Kaplan, F., & Kaçar, N. (2010). Kars sağlık yüksekokulu hemşirelik öğrencilerinin eleştirel düşünme düzeyleri ve etkileyen faktörlerin belirlenmesi [The Critical Thinking Levels of Nursing Students of Kars Health Higher School and Influencing Factors]. Fırat Sağlık Hizmetleri Dergisi, 5(15), 103–112.
Andrews, D. H., & Goodson, L. A. (1980). A comparative analysis of models of instructional design. Journal of Instructional Development, 3(4), 2–16.
Antonietti, A., Ignazi, S., & Perego, P. (2000). Metacognitive knowledge about problem-solving methods. British Journal of Educational Psychology., 70(1), 1–16. https://doi.org/10.1348/000709900157921.
Arts, J. A., Gijselaers, W. H., & Segers, M. S. (2002). Cognitive effects of an authentic computer-supported, problem-based learning environment. Instructional Science, 30(6), 465–495.
Baaki, J., & Luo, T. (2019). Instructional designers guided by external representations in a design process. International Journal of Technology and Design Education, 1–29.
Bacanlı, H., İlhan, T., & Aslan, S. (2009). Beş faktör kuramina dayali bir kişilik ölçeğinin geliştirilmesi: sifatlara dayali kişilik testi (SDKT) [Development of a personality scale based on five factor theory: adjective based personality test (ABPT)]. Türk Eğitim Bilimleri Dergisi, 7(2), 261–279.
Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84(2), 191.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
Bannan-Ritland, B. (2001). Teaching instructional design: An action learning approach. Performance Improvement Quarterly, 14(2), 37–52.
Bauer, K. W., & Liang, Q. (2003). The effect of personality and precollege characteristics on first-year activities and academic performance. Journal of College Student Development, 44, 277–290.
Bausell, R. B., & Li, Y. F. (2002). Power analysis for experimental research: a practical guide for the biological, medical and social sciences. Cambridge: Cambridge University Press.
Bennet, S., Harper, B., & Hedberg, J. (2002). Designing real life cases to support authentic design activities. Australasian Journal of Educational Technology, 18(1), 1–12.
Brookfield, S. D. (2011). Teaching for critical thinking: Tools and techniques to help students question their assumptions. San Francisco: John Wiley & Sons.
Browne, M. N., & Keeley, S. M. (2007). Asking the right questions: A guide to critical thinking. Englewood Cliffs: Prentice Hall.
Bulut, S., Ertem, G., & Sevil, Ü. (2009). Hemşirelik öğrencilerinin eleştirel düşünme düzeylerinin incelenmesi [Examination of nursing students’ level of critical thinking]. Dokuz Eylül Üniversitesi Hemşirelik Yüksekokulu Elektronik Dergisi, 2(2), 27–38.
Cennamo, K., & Kalk, D. (2019). Real world instructional design: An iterative approach to designing learning experiences. London: Routledge.
Chartrand, J. M., Rose, M. L., Elliott, T. R., Marmarosh, C., & Caldwell, S. (1993). Peeling back the onion: Personality, problem solving, and career decision-making style correlates of career indecision. Journal of Career Assessment, 1(1), 66–82.
Cheung, C. K., Rudowicz, E., Lang, G., Yue, X. D., & Kwan, A. S. (2001). Critical thinking among university students: does the family background matter? College Student Journal, 35(4), 577.
Clifford, J. S., Boufal, M. M., & Kurtz, J. E. (2004). Personality traits and critical thinking skills in college students: Empirical tests of a two-factor theory. Assessment, 11, 169–176.
Cole, R. S., & Todd, J. B. (2003). Effects of web-based multimedia homework with immediate rich feedback on student learning in general chemistry. Journal of Chemical Education, 80(11), 1338–1343.
Copeland, W. D., Birmingham, C., de la Cruz, E., & Lewin, B. (1993). The reflective practitioner in teaching: Toward a research agenda. Teaching and Teacher Education, 9(4), 347–359.
Costa, P. T., & MacCrae, R. R. (1992). Revised NEO personality inventory (NEO PI-R) and NEO five-factor inventory (NEO-FFI): Professional manual. Odessa: Psychological Assessment Resources, Incorporated.
Dean, D., & Kuhn, D. (2003). Metacognition and critical thinking.
Dick, W., Carey, L., & Carey, J. O. (2005). The systematic design of instruction (6th ed.). Boston: Pearson Allyn & Bacon.
Dick, W., & Carey, L. (1996). The systematic design of instruction. Chicago: Scott, Foresman.
Dihoff, R. E., Brosvic, G. M., Epstein, M. L., & Cook, M. J. (2004). Provision of feedback during preparation for academic testing: Learning is enhanced by immediate but not delayed feedback. The Psychological Record, 54(2), 207.
Elliott, T. R., Herrick, S. M., MacNair, R. R., & Harkins, S. W. (1994). Personality correlates of self-appraised problem solving ability: Problem orientation and trait affectivity. Journal of Personality Assessment, 63(3), 489–505.
El-sayed, R. S., Sleem, W. F., El-sayed, N. M., & Ramada, F. A. (2011). Disposition of staff nurses’ critical thinking and its relation to quality of their performance at Mansoura University Hospital. Journal of American Science, 7, 388–395.
Ennis, R. H. (1987). A taxonomy of critical thinking dispoisitions and abilities. In J. B. Baron & J. J. Stem Berg (Eds.), Teaching thinking skills: Theory and practice (pp. 9–26). New York: Freeman.
Epstein, M. L., Lazarus, A. D., Calvano, T. B., & Matthews, K. A. (2002). Immediate feedback assessment technique promotes learning and corrects inaccurate first responses. The Psychological Record, 52(2), 187.
Ernst, J., & Monroe, M. (2006). The effects of environment-based education on students’ critical thinking skills and disposition toward critical thinking: Reprinted from Environmental Education Research (2004) 10(4), pp. 507–522. Environmental Education Research, 12(3–4), 429–443.
Eysenck, H. J. (1959). Personality and the estimation of time. Perceptual and Motor Skills, 9, 405–406.
Facione, N. C., Facione, P. A., & Sanchez, C. A. (1994). Critical thinking disposition as a measure of competent clinical judgment: the development of the California Critical Thinking Disposition Inventory. The Journal of Nursing Education, 33(8), 345–350.
Facione, P., & Gittens, C. A. (2015). Think critically. New York: Pearson Inc.
Facione, P. A., Facione, N. C., & Giancarlo, C. A. (1997). Professional judgment and the disposition toward critical thinking. Retrieved Nov 21, 2020 from https://insightassessment.com/wp-content/uploads/ia/pdf/Prof_Jdgmnt__Dsp_CT_97_Frnch1999.pdf.
Facione, P. A., Sanchez, C. A., Facione, N. C., & Gainen, J. (1995). The disposition toward critical thinking. The Journal of General Education, 44(1), 1–25.
Fahim, M., & Teimourtash, M. (2012). A critical look at the notion of critical thinking from a new personality trait perspective: “Midtrovert”.
Field, A. (2009). Discovering statistics using SPSS. London: Sage Publications.
Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2011). How to design and evaluate research in education. New York: McGraw-Hill Humanities/Social Sciences/Languages.
Gagne, R. M. (1980). The conditions of learning (3rd ed.). New York: Holt, Rinehart & Winston.
Gagne, R., Briggs, L., & Wager, W. (1992). Principles of instructional design (4rth ed.). New York: Holt, Rinehart & Winston.
Garside, C. (1996). Look who’s talking: A comparison of lecture and group discussion teaching strategies in developing critical thinking skills. Communication Education, 45(3), 212–227.
Ge, X., Chen, C. H., & Davis, K. A. (2005). Scaffolding novice instructional designers’ problem-solving processes using question prompts in a web-based learning environment. Journal of Educational Computing Research, 33(2), 219–248.
Gellin, A. (2003). The effect of undergraduate student involvement on critical thinking: A meta-analysis of the literature 1991–2000. Journal of college student development, 44(6), 746–762.
Gerlach, V. S., & Ely, D. P. (1980). Teaching and media: A systematic approach (2nd ed.). Englewood Cliffs: Prentice-Hall.
Glaser, R. (1991). The maturing of the relationship between the science of learning and cognition and educational practice. Learning and Instruction, 1(2), 129–144.
Gokhale, A. A. (1995). Collaborative learning enhances critical thinking. Journal of Technology Education, 7(1). http://scholar.lib.vt.edu/ejournals/JTE/v7n1/gokhale.jte-v7n1.html?ref=Sawos.Org.
Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48(1), 26.
Griffin, M. L. (2003). Using critical incidents to promote and assess reflective thinking in preservice teachers. Reflective practice, 4(2), 207–220.
Halpern, D. F. (1998). Teaching critical thinking for transfer across domains: Disposition, skills, structure training, and metacognitive monitoring. American Psychologist, 53(4), 449.
Harris, I. (1993). New expectations for professional competence. In L. Curry & J. F. Wergin (Eds.), Educating professionals: Responding to new expectations for competence and accountability. San Francisco: Jossey-Bass.
Haynes, T., & Bailey, G. (2003). Are you and your basic business students asking the right questions? Business Education Forum, 57(3), 33–37.
Heppner, P. P., & Petersen, C. H. (1982). The development and implications of a personal problem-solving inventory. Journal of Counseling Psychology, 29(1), 66.
Houtz, J. C., Ponterotto, J. G., Burger, C., & Marino, C. (2010). Problem-solving style and multicultural personality dispositions: A study of construct validity. Psychological Reports, 106(3), 927–938. https://doi.org/10.2466/pr0.106.3.927-938.
IBSTPI, International Board of Standards for Training, Performance, and Instruction. (1994). Instructional design competencies: The standards. International Board of Standards for Training, Performance, and Instruction.
Jonassen, D. (2002). Integration of problem solving into instructional design. In R. Reiser & J. Dempsey (Eds.), Trends and issues in instructional design and technology (pp. 107–120). Upper Saddle River: Merrill/Prentice Hall.
Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85.
Jones, T. S., & Richey, R. C. (2000). Rapid prototyping methodology in action: A developmental study. Educational Technology Research and Development, 48(2), 63–80.
Kirmizi, F. S., Saygi, C., & Yurdakal, I. H. (2015). Determine the relationship between the disposition of critical thinking and the perception about problem solving skills. Procedia-Social and Behavioral Sciences, 191, 657–661.
Kökdemir, D. (2003). Belirsizlik Durumlarında Karar Verme ve Problem Çözme [Decision making and problem solving under uncertainty]. Unpublished doctoral dissertation, Ankara University Social Sciences Institute, Social Psychology Division. Ankara.
Lee, H.-J. (2000). The nature of the changes in reflective thinking in preservice mathematics teachers engaged in student teaching field experience in Korea. Paper presented at the Annual Meeting of the America Educational Research Association (AERA), New Orleans, LA, April 24–28, 2000.
Lee, J., & Jang, S. (2014). A methodological framework for instructional design model development: Critical dimensions and synthesized procedures. Educational Technology Research and Development, 62(6), 743–765.
Mayer, R. E. (1998). Cognitive, metacognitive, and motivational aspects of problem solving. Instructional Science, 26(1–2), 49–63.
McMillan, J. H. (1987). Enhancing college students’ critical thinking: A review of studies. Research in Higher Education, 26(1), 3–29.
Morrison, G., Ross, S., & Kemp, J. (2001). Designing effective instruction (3rd ed.). New York: John Wiley & Sons Inc.
Mount, M. K., & Barrick, M. R. (1995). The Big Five personality dimensions: Implications for research and practice in human resources management. Research in Personnel and Human Resources Management, 13(3), 153–200.
Moursund, D., & Bielefeldt, T. (1999). Will new teachers be prepared to teach in a digital age? In A national survey on information technology in teacher education. Santa Monica: Milken Family Foundation.
Nelson, C. E. (1994). Critical thinking and collaborative learning. New Directions for Teaching and Learning., 1994(59), 45–58.
Nelson, W. A., Macliaro, S., & Sherman, T. M. (1988). The intellectual content of instructional design. Journal of Instructional Development, 2(1), 29–35.
Paul, R., & Scriven, M. (1987). Critical thinking as defined by the national council for excellence in critical thinking. In 8th Annual international conference on critical thinking and education reform, Berkeley.
Perez, R. S., & Emery, C. D. (1995). Designer thinking: How novices and experts think about instructional design. Performance Improvement Quarterly, 8(3), 80–95.
Phelps, E., & Damon, W. (1989). Problem solving with equals: Peer collaboration as a context for learning mathematics and spatial concepts. Journal of Educational Psychology, 81(4), 639.
Posner, G. J., & Rudnitsky, A. N. (1994). Course design: A guide to curriculum development for teachers. White Plains: Longman.
Quinn, J. (1994). Connecting education and practice in an instructional design graduate program. Educational Technology Research and Development, 42(3), 71–82.
Reigeluth, C. M. (1999). What is instructional design theory? In C. M. Reigeluth (Ed.), Instructional design theories and models: A new paradigm of instructional theory (Vol. 2, pp. 5–29). Mahwah: Lawrence Erlbaum Associates.
Reiser, R. A., & Dick, W. (1996). Instructional planning: A guide for teachers. Boston: Allyn and Bacon.
Richey, R. C., Fields, D. C., & Foxon, M. (2001). Instructional design competencies: The standards (3rd ed.). Syracuse: ERIC Clearinghouse on Information and Technology.
Savery, J. R., & Duffy, T. M. (1995). Problem Based learning: An instructional model and its constructivist framework. Educational Technology, 35(5), 31–38.
Scheeler, M. C., Congdon, M., & Stansbery, S. (2010). Providing immediate feedback to co-teachers through bug-in-ear technology: An effective method of peer coaching in inclusion classrooms. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 33(1), 83–96.
Schenker, J. D., & Rumrill, P. D., Jr. (2004). Causal-comparative research designs. Journal of Vocational Rehabilitation, 21(3), 117–121.
Sepahvand, E., Shehni Yailagh, M., Allipour Birgany, S., & Behroozi, N. (2017). Testing a model of causal relationships of family communication patterns, metacognition and personality traits with critical thinking disposition, mediated by epistemic beliefs of female high school students in Ahvaz. Journal of Psychological Achievements, 24(1), 23–44.
Shambaugh, R. N., & Magliaro, S. G. (2001). A reflexive model for teaching instructional design. Educational Technology Research and Development, 49(2), 69–91.
Simon, A., & Ward, L. O. (1974). The performance on the Watson-Glaser Critical Thinking Appraisal of university students classified according to sex, type of course pursued, and personality score category. Educational and Psychological Measurement, 34(4), 957–960.
Snyder, L. G., & Snyder, M. J. (2008). Teaching critical thinking and problem solvingproblem-solving skills. The Journal of Research in Business Education, 50(2), 90.
Sosu, E. M. (2013). The development and psychometric validation of a Critical Thinking Disposition Scale. Thinking Skills and Creativity, 9, 107–119.
Soto, V. J. (2013). Which instructional design models are educators using to design virtual world instruction. MERLOT Journal of Online Learning and Teaching, 9(3), 364–375.
Spector, J. M., Muraida, D. J., & Dallman, B. E. (1990). Establishing instructional strategies for advanced interactive technologies. In Proceedings of the psychology in the DoD symposium (vol. 12, pp. 347–352).
Spector, J. M., Muraida, D. J., & Marlino, M. R. (1992). Cognitively based models of courseware development. Educational Technology Research and Development, 40(2), 45–54.
Squires, D. (1999). Educational software and learning: Subversive use and volatile design. Educational technology, 39(3), 48–54.
Swanson, H. L. (1990). Influence of metacognitive knowledge and aptitude on problem solving. Journal of Educational Psychology, 82(2), 306.
Taylan, S. (1990). Heppner’in problem çözme envanterinin uyarlama, güvenirlik ve geçerlik çalışmaları. [An adaptation, reliability and validity studies of Heppner’s problem-solving inventory]. Yayınlanmamış Yüksek Lisans Tezi, Ankara Üniversitesi, Ankara. [Unpublished master’s thesis, Ankara University, Ankara.].
Terenzini, P. T., Springer, L., Pascarella, E. T., & Nora, A. (1995). Influences affecting the development of students’ critical thinking skills. Research in Higher Education, 36(1), 23–39.
Tessmer, M., & Wedman, J. (1995). Context-sensitive instructional design models: A response to design research, studies, and criticism. Performance Improvement Quarterly, 8(3), 38–54.
Titzer, J. L., Swenty, C. F., & Hoehn, W. G. (2012). An interprofessional simulation promoting collaboration and problem solving among nursing and allied health professional students. Clinical Simulation in Nursing, 8(8), e325–e333.
Tripp, S. D., & Bichelmeyer, B. (1990). Rapid prototyping: An alternative instructional design strategy. Educational Technology Research and Development, 38(1), 31–44.
Visscher-Voerman, I., & Gustafson, K. L. (2004). Paradigms in the theory and practice of education and training design. Educational Technology Research and Development, 52(2), 69–89.
Visscher-Voerman, I., Gustafson, K., & Plomp, T. (1999). Educational design and development: An overview of paradigms. In J. Van der Akker, R. M. Branch, K. Gustafson, N. Nieveen, & T. Plomp (Eds.), Design approaches and tools in education and training (pp. 15–28). Netherlands: Springer.
Waite, S., & Davis, B. (2006). Collaboration as a catalyst for critical thinking in undergraduate research. Journal of Further and Higher Education, 30(4), 405–419.
Wedman, J., & Tessmer, M. (1993). Instructional designers decisions and priorities: A survey of design practice. Performance Improvement Quarterly, 6(2), 43–57.
WienerVazquez-Abad, L. R. J. (1995). The present and future of ID practice. Performance Improvement Quarterly, 8(3), 55–67.
Winn, W. (1989). Toward a rationale and theoretical basis for educational technology. Educational Technology Research and Development, 37(1), 35–46.
Winn, W. (1997). Advantages of a theory based curriculum in instructional technology. Educational Technology, 37(1), 34–41.
Yang, Y. T. C., Newby, T. J., & Bill, R. L. (2005). Using Socratic questioning to promote critical thinking skills through asynchronous discussion forums in distance learning environments. The American Journal of Distance Education, 19(3), 163–181.
York, C. S., & Ertmer, P. A. (2016). Examining instructional design principles applied by experienced designers in practice. Performance Improvement Quarterly, 29(2), 169–192.
Young, M. F. (1993). Instructional design for situated learning. Educational Technology Research and Development, 41(1), 43–85.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Toker, S., Baturay, M.H. Developing disposition to critical thinking and problem-solving perception in instructional design projects for producing digital materials. Int J Technol Des Educ 32, 1267–1292 (2022). https://doi.org/10.1007/s10798-020-09646-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10798-020-09646-2