Skip to main content
Log in

Developing disposition to critical thinking and problem-solving perception in instructional design projects for producing digital materials

  • Original Research Article
  • Published:
International Journal of Technology and Design Education Aims and scope Submit manuscript

Abstract

This study investigated the development of perceptions of critical thinking and problem-solving skills among a group of students taking part in instructional design projects to produce digital materials using different instructional design models. The study participants were students from a computer science teaching department who were enrolled in an instructional design course. Participants were divided into two groups according to instructional design model. The rapid prototyping model (RPM) group consisted of 47 students working in 9 teams on an assignment to develop an e-book for educational use, and the Dick and Carey model (DCM) group consisted of 37 students working in 7 teams on an assignment to design digital materials to enrich courses on a specific subject. Student perceptions of the development of their critical thinking and problem-solving skills were analyzed using a causal-comparative approach, with the Big Five Personality traits as covariance. The RPM group indicated significant improvements in their perceived problem-solving skills, particularly with respect to their confidence in undertaking tasks, whereas the DCM group perceived significant improvements in their disposition to critical-thinking, particularly with respect to self-confidence and analyticity. The Openness to Experience trait was reported to be a significant covariance on the self-confidence sub-factor of both skills, as was the trait Extraversion. The findings are discussed in detail, along with recommendations for further research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Abrami, P. C., Bernard, R. M., Borokhovski, E., Wade, A., Surkes, M. A., Tamim, R., et al. (2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research., 78(4), 1102–1134.

    Article  Google Scholar 

  • Akkuş, Y., Kaplan, F., & Kaçar, N. (2010). Kars sağlık yüksekokulu hemşirelik öğrencilerinin eleştirel düşünme düzeyleri ve etkileyen faktörlerin belirlenmesi [The Critical Thinking Levels of Nursing Students of Kars Health Higher School and Influencing Factors]. Fırat Sağlık Hizmetleri Dergisi, 5(15), 103–112.

    Google Scholar 

  • Andrews, D. H., & Goodson, L. A. (1980). A comparative analysis of models of instructional design. Journal of Instructional Development, 3(4), 2–16.

    Article  Google Scholar 

  • Antonietti, A., Ignazi, S., & Perego, P. (2000). Metacognitive knowledge about problem-solving methods. British Journal of Educational Psychology., 70(1), 1–16. https://doi.org/10.1348/000709900157921.

    Article  Google Scholar 

  • Arts, J. A., Gijselaers, W. H., & Segers, M. S. (2002). Cognitive effects of an authentic computer-supported, problem-based learning environment. Instructional Science, 30(6), 465–495.

    Article  Google Scholar 

  • Baaki, J., & Luo, T. (2019). Instructional designers guided by external representations in a design process. International Journal of Technology and Design Education, 1–29.

  • Bacanlı, H., İlhan, T., & Aslan, S. (2009). Beş faktör kuramina dayali bir kişilik ölçeğinin geliştirilmesi: sifatlara dayali kişilik testi (SDKT) [Development of a personality scale based on five factor theory: adjective based personality test (ABPT)]. Türk Eğitim Bilimleri Dergisi, 7(2), 261–279.

    Google Scholar 

  • Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84(2), 191.

    Article  Google Scholar 

  • Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.

    Google Scholar 

  • Bannan-Ritland, B. (2001). Teaching instructional design: An action learning approach. Performance Improvement Quarterly, 14(2), 37–52.

    Article  Google Scholar 

  • Bauer, K. W., & Liang, Q. (2003). The effect of personality and precollege characteristics on first-year activities and academic performance. Journal of College Student Development, 44, 277–290.

    Article  Google Scholar 

  • Bausell, R. B., & Li, Y. F. (2002). Power analysis for experimental research: a practical guide for the biological, medical and social sciences. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Bennet, S., Harper, B., & Hedberg, J. (2002). Designing real life cases to support authentic design activities. Australasian Journal of Educational Technology, 18(1), 1–12.

    Article  Google Scholar 

  • Brookfield, S. D. (2011). Teaching for critical thinking: Tools and techniques to help students question their assumptions. San Francisco: John Wiley & Sons.

    Google Scholar 

  • Browne, M. N., & Keeley, S. M. (2007). Asking the right questions: A guide to critical thinking. Englewood Cliffs: Prentice Hall.

    Google Scholar 

  • Bulut, S., Ertem, G., & Sevil, Ü. (2009). Hemşirelik öğrencilerinin eleştirel düşünme düzeylerinin incelenmesi [Examination of nursing students’ level of critical thinking]. Dokuz Eylül Üniversitesi Hemşirelik Yüksekokulu Elektronik Dergisi, 2(2), 27–38.

    Google Scholar 

  • Cennamo, K., & Kalk, D. (2019). Real world instructional design: An iterative approach to designing learning experiences. London: Routledge.

    Book  Google Scholar 

  • Chartrand, J. M., Rose, M. L., Elliott, T. R., Marmarosh, C., & Caldwell, S. (1993). Peeling back the onion: Personality, problem solving, and career decision-making style correlates of career indecision. Journal of Career Assessment, 1(1), 66–82.

    Article  Google Scholar 

  • Cheung, C. K., Rudowicz, E., Lang, G., Yue, X. D., & Kwan, A. S. (2001). Critical thinking among university students: does the family background matter? College Student Journal, 35(4), 577.

    Google Scholar 

  • Clifford, J. S., Boufal, M. M., & Kurtz, J. E. (2004). Personality traits and critical thinking skills in college students: Empirical tests of a two-factor theory. Assessment, 11, 169–176.

    Article  Google Scholar 

  • Cole, R. S., & Todd, J. B. (2003). Effects of web-based multimedia homework with immediate rich feedback on student learning in general chemistry. Journal of Chemical Education, 80(11), 1338–1343.

    Article  Google Scholar 

  • Copeland, W. D., Birmingham, C., de la Cruz, E., & Lewin, B. (1993). The reflective practitioner in teaching: Toward a research agenda. Teaching and Teacher Education, 9(4), 347–359.

    Article  Google Scholar 

  • Costa, P. T., & MacCrae, R. R. (1992). Revised NEO personality inventory (NEO PI-R) and NEO five-factor inventory (NEO-FFI): Professional manual. Odessa: Psychological Assessment Resources, Incorporated.

    Google Scholar 

  • Dean, D., & Kuhn, D. (2003). Metacognition and critical thinking.

  • Dick, W., Carey, L., & Carey, J. O. (2005). The systematic design of instruction (6th ed.). Boston: Pearson Allyn & Bacon.

    Google Scholar 

  • Dick, W., & Carey, L. (1996). The systematic design of instruction. Chicago: Scott, Foresman.

    Google Scholar 

  • Dihoff, R. E., Brosvic, G. M., Epstein, M. L., & Cook, M. J. (2004). Provision of feedback during preparation for academic testing: Learning is enhanced by immediate but not delayed feedback. The Psychological Record, 54(2), 207.

    Article  Google Scholar 

  • Elliott, T. R., Herrick, S. M., MacNair, R. R., & Harkins, S. W. (1994). Personality correlates of self-appraised problem solving ability: Problem orientation and trait affectivity. Journal of Personality Assessment, 63(3), 489–505.

    Article  Google Scholar 

  • El-sayed, R. S., Sleem, W. F., El-sayed, N. M., & Ramada, F. A. (2011). Disposition of staff nurses’ critical thinking and its relation to quality of their performance at Mansoura University Hospital. Journal of American Science, 7, 388–395.

    Google Scholar 

  • Ennis, R. H. (1987). A taxonomy of critical thinking dispoisitions and abilities. In J. B. Baron & J. J. Stem Berg (Eds.), Teaching thinking skills: Theory and practice (pp. 9–26). New York: Freeman.

    Google Scholar 

  • Epstein, M. L., Lazarus, A. D., Calvano, T. B., & Matthews, K. A. (2002). Immediate feedback assessment technique promotes learning and corrects inaccurate first responses. The Psychological Record, 52(2), 187.

    Article  Google Scholar 

  • Ernst, J., & Monroe, M. (2006). The effects of environment-based education on students’ critical thinking skills and disposition toward critical thinking: Reprinted from Environmental Education Research (2004) 10(4), pp. 507–522. Environmental Education Research, 12(3–4), 429–443.

    Article  Google Scholar 

  • Eysenck, H. J. (1959). Personality and the estimation of time. Perceptual and Motor Skills, 9, 405–406.

    Article  Google Scholar 

  • Facione, N. C., Facione, P. A., & Sanchez, C. A. (1994). Critical thinking disposition as a measure of competent clinical judgment: the development of the California Critical Thinking Disposition Inventory. The Journal of Nursing Education, 33(8), 345–350.

    Article  Google Scholar 

  • Facione, P., & Gittens, C. A. (2015). Think critically. New York: Pearson Inc.

    Google Scholar 

  • Facione, P. A., Facione, N. C., & Giancarlo, C. A. (1997). Professional judgment and the disposition toward critical thinking. Retrieved Nov 21, 2020 from https://insightassessment.com/wp-content/uploads/ia/pdf/Prof_Jdgmnt__Dsp_CT_97_Frnch1999.pdf.

  • Facione, P. A., Sanchez, C. A., Facione, N. C., & Gainen, J. (1995). The disposition toward critical thinking. The Journal of General Education, 44(1), 1–25.

    Google Scholar 

  • Fahim, M., & Teimourtash, M. (2012). A critical look at the notion of critical thinking from a new personality trait perspective: “Midtrovert”.

  • Field, A. (2009). Discovering statistics using SPSS. London: Sage Publications.

    Google Scholar 

  • Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2011). How to design and evaluate research in education. New York: McGraw-Hill Humanities/Social Sciences/Languages.

    Google Scholar 

  • Gagne, R. M. (1980). The conditions of learning (3rd ed.). New York: Holt, Rinehart & Winston.

    Google Scholar 

  • Gagne, R., Briggs, L., & Wager, W. (1992). Principles of instructional design (4rth ed.). New York: Holt, Rinehart & Winston.

    Google Scholar 

  • Garside, C. (1996). Look who’s talking: A comparison of lecture and group discussion teaching strategies in developing critical thinking skills. Communication Education, 45(3), 212–227.

    Article  Google Scholar 

  • Ge, X., Chen, C. H., & Davis, K. A. (2005). Scaffolding novice instructional designers’ problem-solving processes using question prompts in a web-based learning environment. Journal of Educational Computing Research, 33(2), 219–248.

    Article  Google Scholar 

  • Gellin, A. (2003). The effect of undergraduate student involvement on critical thinking: A meta-analysis of the literature 1991–2000. Journal of college student development, 44(6), 746–762.

    Article  Google Scholar 

  • Gerlach, V. S., & Ely, D. P. (1980). Teaching and media: A systematic approach (2nd ed.). Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Glaser, R. (1991). The maturing of the relationship between the science of learning and cognition and educational practice. Learning and Instruction, 1(2), 129–144.

    Article  Google Scholar 

  • Gokhale, A. A. (1995). Collaborative learning enhances critical thinking. Journal of Technology Education, 7(1). http://scholar.lib.vt.edu/ejournals/JTE/v7n1/gokhale.jte-v7n1.html?ref=Sawos.Org.

  • Goldberg, L. R. (1993). The structure of phenotypic personality traits. American Psychologist, 48(1), 26.

    Article  Google Scholar 

  • Griffin, M. L. (2003). Using critical incidents to promote and assess reflective thinking in preservice teachers. Reflective practice, 4(2), 207–220.

    Article  Google Scholar 

  • Halpern, D. F. (1998). Teaching critical thinking for transfer across domains: Disposition, skills, structure training, and metacognitive monitoring. American Psychologist, 53(4), 449.

    Article  Google Scholar 

  • Harris, I. (1993). New expectations for professional competence. In L. Curry & J. F. Wergin (Eds.), Educating professionals: Responding to new expectations for competence and accountability. San Francisco: Jossey-Bass.

    Google Scholar 

  • Haynes, T., & Bailey, G. (2003). Are you and your basic business students asking the right questions? Business Education Forum, 57(3), 33–37.

    Google Scholar 

  • Heppner, P. P., & Petersen, C. H. (1982). The development and implications of a personal problem-solving inventory. Journal of Counseling Psychology, 29(1), 66.

    Article  Google Scholar 

  • Houtz, J. C., Ponterotto, J. G., Burger, C., & Marino, C. (2010). Problem-solving style and multicultural personality dispositions: A study of construct validity. Psychological Reports, 106(3), 927–938. https://doi.org/10.2466/pr0.106.3.927-938.

    Article  Google Scholar 

  • IBSTPI, International Board of Standards for Training, Performance, and Instruction. (1994). Instructional design competencies: The standards. International Board of Standards for Training, Performance, and Instruction.

  • Jonassen, D. (2002). Integration of problem solving into instructional design. In R. Reiser & J. Dempsey (Eds.), Trends and issues in instructional design and technology (pp. 107–120). Upper Saddle River: Merrill/Prentice Hall.

    Google Scholar 

  • Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85.

    Article  Google Scholar 

  • Jones, T. S., & Richey, R. C. (2000). Rapid prototyping methodology in action: A developmental study. Educational Technology Research and Development, 48(2), 63–80.

    Article  Google Scholar 

  • Kirmizi, F. S., Saygi, C., & Yurdakal, I. H. (2015). Determine the relationship between the disposition of critical thinking and the perception about problem solving skills. Procedia-Social and Behavioral Sciences, 191, 657–661.

    Article  Google Scholar 

  • Kökdemir, D. (2003). Belirsizlik Durumlarında Karar Verme ve Problem Çözme [Decision making and problem solving under uncertainty]. Unpublished doctoral dissertation, Ankara University Social Sciences Institute, Social Psychology Division. Ankara.

  • Lee, H.-J. (2000). The nature of the changes in reflective thinking in preservice mathematics teachers engaged in student teaching field experience in Korea. Paper presented at the Annual Meeting of the America Educational Research Association (AERA), New Orleans, LA, April 24–28, 2000.

  • Lee, J., & Jang, S. (2014). A methodological framework for instructional design model development: Critical dimensions and synthesized procedures. Educational Technology Research and Development, 62(6), 743–765.

    Article  Google Scholar 

  • Mayer, R. E. (1998). Cognitive, metacognitive, and motivational aspects of problem solving. Instructional Science, 26(1–2), 49–63.

    Article  Google Scholar 

  • McMillan, J. H. (1987). Enhancing college students’ critical thinking: A review of studies. Research in Higher Education, 26(1), 3–29.

    Article  Google Scholar 

  • Morrison, G., Ross, S., & Kemp, J. (2001). Designing effective instruction (3rd ed.). New York: John Wiley & Sons Inc.

    Google Scholar 

  • Mount, M. K., & Barrick, M. R. (1995). The Big Five personality dimensions: Implications for research and practice in human resources management. Research in Personnel and Human Resources Management, 13(3), 153–200.

    Google Scholar 

  • Moursund, D., & Bielefeldt, T. (1999). Will new teachers be prepared to teach in a digital age? In A national survey on information technology in teacher education. Santa Monica: Milken Family Foundation.

  • Nelson, C. E. (1994). Critical thinking and collaborative learning. New Directions for Teaching and Learning., 1994(59), 45–58.

    Article  Google Scholar 

  • Nelson, W. A., Macliaro, S., & Sherman, T. M. (1988). The intellectual content of instructional design. Journal of Instructional Development, 2(1), 29–35.

    Google Scholar 

  • Paul, R., & Scriven, M. (1987). Critical thinking as defined by the national council for excellence in critical thinking. In 8th Annual international conference on critical thinking and education reform, Berkeley.

  • Perez, R. S., & Emery, C. D. (1995). Designer thinking: How novices and experts think about instructional design. Performance Improvement Quarterly, 8(3), 80–95.

    Article  Google Scholar 

  • Phelps, E., & Damon, W. (1989). Problem solving with equals: Peer collaboration as a context for learning mathematics and spatial concepts. Journal of Educational Psychology, 81(4), 639.

    Article  Google Scholar 

  • Posner, G. J., & Rudnitsky, A. N. (1994). Course design: A guide to curriculum development for teachers. White Plains: Longman.

    Google Scholar 

  • Quinn, J. (1994). Connecting education and practice in an instructional design graduate program. Educational Technology Research and Development, 42(3), 71–82.

    Article  Google Scholar 

  • Reigeluth, C. M. (1999). What is instructional design theory? In C. M. Reigeluth (Ed.), Instructional design theories and models: A new paradigm of instructional theory (Vol. 2, pp. 5–29). Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Reiser, R. A., & Dick, W. (1996). Instructional planning: A guide for teachers. Boston: Allyn and Bacon.

    Google Scholar 

  • Richey, R. C., Fields, D. C., & Foxon, M. (2001). Instructional design competencies: The standards (3rd ed.). Syracuse: ERIC Clearinghouse on Information and Technology.

    Google Scholar 

  • Savery, J. R., & Duffy, T. M. (1995). Problem Based learning: An instructional model and its constructivist framework. Educational Technology, 35(5), 31–38.

    Google Scholar 

  • Scheeler, M. C., Congdon, M., & Stansbery, S. (2010). Providing immediate feedback to co-teachers through bug-in-ear technology: An effective method of peer coaching in inclusion classrooms. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 33(1), 83–96.

    Article  Google Scholar 

  • Schenker, J. D., & Rumrill, P. D., Jr. (2004). Causal-comparative research designs. Journal of Vocational Rehabilitation, 21(3), 117–121.

    Google Scholar 

  • Sepahvand, E., Shehni Yailagh, M., Allipour Birgany, S., & Behroozi, N. (2017). Testing a model of causal relationships of family communication patterns, metacognition and personality traits with critical thinking disposition, mediated by epistemic beliefs of female high school students in Ahvaz. Journal of Psychological Achievements, 24(1), 23–44.

    Google Scholar 

  • Shambaugh, R. N., & Magliaro, S. G. (2001). A reflexive model for teaching instructional design. Educational Technology Research and Development, 49(2), 69–91.

    Article  Google Scholar 

  • Simon, A., & Ward, L. O. (1974). The performance on the Watson-Glaser Critical Thinking Appraisal of university students classified according to sex, type of course pursued, and personality score category. Educational and Psychological Measurement, 34(4), 957–960.

    Article  Google Scholar 

  • Snyder, L. G., & Snyder, M. J. (2008). Teaching critical thinking and problem solvingproblem-solving skills. The Journal of Research in Business Education, 50(2), 90.

    Google Scholar 

  • Sosu, E. M. (2013). The development and psychometric validation of a Critical Thinking Disposition Scale. Thinking Skills and Creativity, 9, 107–119.

    Article  Google Scholar 

  • Soto, V. J. (2013). Which instructional design models are educators using to design virtual world instruction. MERLOT Journal of Online Learning and Teaching, 9(3), 364–375.

    Google Scholar 

  • Spector, J. M., Muraida, D. J., & Dallman, B. E. (1990). Establishing instructional strategies for advanced interactive technologies. In Proceedings of the psychology in the DoD symposium (vol. 12, pp. 347–352).

  • Spector, J. M., Muraida, D. J., & Marlino, M. R. (1992). Cognitively based models of courseware development. Educational Technology Research and Development, 40(2), 45–54.

    Article  Google Scholar 

  • Squires, D. (1999). Educational software and learning: Subversive use and volatile design. Educational technology, 39(3), 48–54.

    Google Scholar 

  • Swanson, H. L. (1990). Influence of metacognitive knowledge and aptitude on problem solving. Journal of Educational Psychology, 82(2), 306.

    Article  Google Scholar 

  • Taylan, S. (1990). Heppner’in problem çözme envanterinin uyarlama, güvenirlik ve geçerlik çalışmaları. [An adaptation, reliability and validity studies of Heppner’s problem-solving inventory]. Yayınlanmamış Yüksek Lisans Tezi, Ankara Üniversitesi, Ankara. [Unpublished master’s thesis, Ankara University, Ankara.].

  • Terenzini, P. T., Springer, L., Pascarella, E. T., & Nora, A. (1995). Influences affecting the development of students’ critical thinking skills. Research in Higher Education, 36(1), 23–39.

    Article  Google Scholar 

  • Tessmer, M., & Wedman, J. (1995). Context-sensitive instructional design models: A response to design research, studies, and criticism. Performance Improvement Quarterly, 8(3), 38–54.

    Article  Google Scholar 

  • Titzer, J. L., Swenty, C. F., & Hoehn, W. G. (2012). An interprofessional simulation promoting collaboration and problem solving among nursing and allied health professional students. Clinical Simulation in Nursing, 8(8), e325–e333.

    Article  Google Scholar 

  • Tripp, S. D., & Bichelmeyer, B. (1990). Rapid prototyping: An alternative instructional design strategy. Educational Technology Research and Development, 38(1), 31–44.

    Article  Google Scholar 

  • Visscher-Voerman, I., & Gustafson, K. L. (2004). Paradigms in the theory and practice of education and training design. Educational Technology Research and Development, 52(2), 69–89.

    Article  Google Scholar 

  • Visscher-Voerman, I., Gustafson, K., & Plomp, T. (1999). Educational design and development: An overview of paradigms. In J. Van der Akker, R. M. Branch, K. Gustafson, N. Nieveen, & T. Plomp (Eds.), Design approaches and tools in education and training (pp. 15–28). Netherlands: Springer.

    Chapter  Google Scholar 

  • Waite, S., & Davis, B. (2006). Collaboration as a catalyst for critical thinking in undergraduate research. Journal of Further and Higher Education, 30(4), 405–419.

    Article  Google Scholar 

  • Wedman, J., & Tessmer, M. (1993). Instructional designers decisions and priorities: A survey of design practice. Performance Improvement Quarterly, 6(2), 43–57.

    Article  Google Scholar 

  • WienerVazquez-Abad, L. R. J. (1995). The present and future of ID practice. Performance Improvement Quarterly, 8(3), 55–67.

    Google Scholar 

  • Winn, W. (1989). Toward a rationale and theoretical basis for educational technology. Educational Technology Research and Development, 37(1), 35–46.

    Article  Google Scholar 

  • Winn, W. (1997). Advantages of a theory based curriculum in instructional technology. Educational Technology, 37(1), 34–41.

    Google Scholar 

  • Yang, Y. T. C., Newby, T. J., & Bill, R. L. (2005). Using Socratic questioning to promote critical thinking skills through asynchronous discussion forums in distance learning environments. The American Journal of Distance Education, 19(3), 163–181.

    Article  Google Scholar 

  • York, C. S., & Ertmer, P. A. (2016). Examining instructional design principles applied by experienced designers in practice. Performance Improvement Quarterly, 29(2), 169–192.

    Article  Google Scholar 

  • Young, M. F. (1993). Instructional design for situated learning. Educational Technology Research and Development, 41(1), 43–85.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sacip Toker.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Toker, S., Baturay, M.H. Developing disposition to critical thinking and problem-solving perception in instructional design projects for producing digital materials. Int J Technol Des Educ 32, 1267–1292 (2022). https://doi.org/10.1007/s10798-020-09646-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10798-020-09646-2

Keywords

Navigation