Process analysis of teachers’ self-regulated learning patterns in technological pedagogical content knowledge development

https://doi.org/10.1016/j.compedu.2021.104169Get rights and content

Highlights

  • Teachers' self-regulated learning has a predictable effect on learning about technological pedagogical content knowledge.

  • This study identified diverse patterns relating to teachers' SRL in response to the levels of TPACK achievements.

  • High TPACK performers are more goal-oriented, engaging more in monitoring, and perform more iterative in SRL processes.

  • Lower performers only partially engaged in SRL while learning about TPACK.

Abstract

Self-regulated learning (SRL) has a predictable and instrumental effect on learning complicated knowledge. This study investigates the role of SRL in acquiring technological pedagogical content knowledge (TPACK), an important aspect of teachers' effective technology use. The present study identified several regulatory procedural patterns used by teachers in the context of their TPACK achievements. A computer-based context, nBrowser, was used to facilitate teachers lesson planning around technology usage. Teachers log file data were analyzed using process mining approaches. Findings indicate that high TPACK performers are more likely to perform self-regulative activities (e.g., monitoring) in developing TPACK compared to the low performers. Higher TPACK performers are more goal-oriented, demonstrate more monitoring and are more iterative in using all SRL processes in contrast to low performers who only partially regulate their problem solving. Such findings support previous research. This study adopts a novel approach for understanding the relations between SRL and TPACK. It offers opportunities to examine how teachers enact SRL as they move from the beginning to later stages of designing lessons and provides insights to researchers who study SRL in TPACK domains. Furthermore, the findings can assist educational designers in developing interventions for promoting TPACK development by concentrating on teachers’ SRL abilities.

Introduction

Self-regulated learning (SRL) is an essential concept in the field of educational psychology. The notion is derived from research on metacognition and discusses how learners deploy metacognitive knowledge and skills to monitor and regulate their cognitive, motivational, and behavioral processes in learning (Pintrich, 2000; Winne & Hadwin, 1998). SRL has a pervasive, predictable, and instrumental effect on learning. Successful SRL enables students to engage in a recursive cycle of analyzing task conditions, constructing goals, monitoring learning strategies, and evaluating the effectiveness of the strategies (Azevedo & Cromley, 2004; Mega et al., 2014). However, dysregulation hampers learning, including failures to update one's standards and adapt to the demands of the task, deploy effective strategies, as well as make accurate judgments of one's progress (Azevedo & Feyzi-Behnagh, 2011). Such findings have been documented in research conducted across disciplines such as science (Deekens, Greene, & Lobczowski, 2018), mathematics (Kramarski & Friedman, 2014), medicine (Lajoie, Poitras, Doleck, & Jarrell, 2014), and psychology (Sonnenberg & Bannert, 2015).

In the context of teacher technology education, technological pedagogical content knowledge (TPACK, Mishra & Koehler, 2006) plays a crucial role in teachers' effective uses of educational technology for teaching. It serves as a heuristic conceptual framework instructing teachers on how to combine their extensive technological knowledge with their content and pedagogical knowledge in an effort to make abstract subject topics more concrete and to assist students in constructing new knowledge (Mishra & Koehler, 2006). However, developing TPACK is complex in that teachers need to consider students’ specific needs as well as the constraints of learning contexts when performing technology-integrated practices (Angeli & Valanides, 2009).

Investigations into the relations between SRL and learning in TPACK commences with Kramarski et al.’s (2009, 2010) study wherein three metacognitive prompts were provided to student teachers during different phases of learning TPACK in a web-based context. Their findings demonstrate that participants obtained higher TPACK comprehension and performance of lesson design with SRL scaffolds in the planning and evaluation phases. In a study of TPACK in secondary in-service teachers Chen and Jiang (2019) found that teachers' SRL capacities play a different role in building TPACK, with planning capacity as the factor that exerts an exceptional influence. Poitras (Poitras, Doleck, Huang, Li, & Lajoie, 2017; Poitras & Fazeli, 2016)) contributes to this field of research by including a computer-based learning environment (CBLE) that is designed to facilitate teachers' SRL and TPACK. Poitras, Fazeli, and Mayne (2018) built a structural model to test several information seeking and acquisition behaviours (e.g., site visits using a CBLE), as predictors for TPACK, assuming that teachers who regulated their information seeking and acquisition behaviours could result in better TPACK performance. Another study using this CBLE analyzed preservice teachers' lesson plans and corroborates the arguments that teachers with high SRL abilities outperform those with lower SRL in terms of TPACK achievements (Huang, Li, Poitras, & Lajoie, 2020). Despite significant findings, further examinations of the relations between SRL and TPACK are needed.

There is necessity to probe further into teachers' self-regulatory processes to establish a sound understanding of the relations between SRL and TPACK. The underlying assumption is that SRL is temporal and dynamic in the way it changes over time and in different contexts (Taub, Azevedo, & Mudrick, 2018). Deeper insight into how SRL is performed can provide opportunities to explain why teachers succeed or fail in learning about TPACK. Studies looking into teachers' SRL processes in TPACK is still somewhat limited in the existing literature. Accordingly, the present study aims to fill this gap through modeling teachers' self-regulatory processes as they conduct a technology-infused task and will present inferences about the relations between SRL and TPACK temporally. The findings will provide insights as to how teachers enact SRL as they move from the beginning to later stages of designing lessons and provides insights to researchers who study SRL in TPACK domains. Furthermore, the findings can assist educational designers in developing interventions for promoting TPACK development by concentrating on teachers’ SRL abilities.

Section snippets

Self-regulated learning

Several scholars have modeled students' SRL with different theoretical perspectives, such as the social-cognitive model of SRL (Zimmerman, 2002), the general framework of SRL (Pintrich, 2000), and the information-processing model of SRL (Winne & Hadwin, 1998). Despite differences, there are some commonly shared assumptions (Panadero, 2017; Puustinen & Pulkkinen, 2001). First, SRL is a constructive cyclical process consisting of phases. The first phase is forethought wherein students analyze the

Participants

The participants in this study were 70 English as second language teachers in a city in the southern region of China. Of them, 49 student teachers (third-year university students), were recruited in a local normal university after we received the approval from the faculty administration and received the Ethics approval from the authors' affiliated university. Participants' personal information was treated in strict confidence. The in-service teachers were working at local public primary schools

Creation of TPACK groups

TPACK groups were created prior to answering the research questions. These groups were associated with the levels of TPACK achievements that were predicted by the scores of the self-report of TPACK and the results of evaluations of lesson plans. The descriptive statistics demonstrated that the average score of perceived TPACK was 4.51 out of 7 (SD = 0.89) and around half of the sample obtained the scores above the mean. In light of the results of the evaluations of lesson plans, the mean score

Discussions

The purpose of this study was to explore the patterns of teachers' SRL processes in the context of TPACK development. Previous empirical research consistently emphasizes that SRL mediates learning outcomes, with higher SRL associating with better achievements (e.g., Huang et al., 2020; Kramarski & Michalsky, 2010). Thus, the present study measured teachers' TPACK achievements by assessing their TPACK understandings and lesson plan and lesson designing performance, which leads to three levels of

Limitations and future directions

Log trace data are subject to being challenged in terms of interpretability and accuracy, although trace-based measure protocols (Siadaty et al., 2016) offer optimal solutions about how to translate raw traces into fine-grained SRL events. The multichannel data and multimodal learning analytics still have to be adopted in future research (Azevedo & Gašević, 2019; Worsley & Blikstein, 2015). Moreover, Fuzzy Miner only builds descriptive models that benefit model development but do not directly

Conclusions

In conclusion, this study identified SRL sequential patterns, a novel approach to inspecting the relations between teachers’ self-regulation and their TPACK development. Although this study is exploratory rather than predictive, we did establish specific regulatory procedural patterns that are generally in line with what previous studies (Chen & Jang, 2019; Kramarski & Michalsky, 2010; Poitras et al., 2018) have indicated which is that high performers are more likely to adaptively perform

Funding sources

This research was supported in part by the doctoral scholarship from Fonds de Recherche du Qúebec - Socí et'e et Culture (FRQSC) awarded to Lingyun Huang, grants from Social Sciences and Humanities Research Council (SSHRC) Partnership Grant of Canada (895-2011-1006) awarded to Dr. Susanne Lajoie.

Credit author statement

Lingyun Huang: Conceptualization, Methodology, Formal analysis, Software, Investigation, Resources, Data curation, Writing – original draft. Susanne P. Lajoie: Supervising, Reviewing and Editing.

Declaration of competing interest

There is no conflict of interest.

Acknowledgment

We thank all research assistants Miss Alejandra Ruiz Segura and Miss Tianshu Li for evaluating lesson plans. We thank Dr. Poitras for his work of updating the learning system and his support in data analysis. We also thank the reviewers and the editors for their constructive comments and feedback.

References (66)

  • P.H. Winne et al.

    Measuring self-regulated learning

  • M. Zhou et al.

    Modeling academic achievement by self-reported versus traced goal orientation

    Learning and Instruction

    (2012)
  • B.J. Zimmerman

    Becoming a self-regulated learner: Which are the key subprocesses?

    Contemporary Educational Psychology

    (1986)
  • W. van der Aalst

    Process mining: Overview and opportunities

    ACM Trans. Manage. Inf. Syst.

    (2012)
  • S.P. Lajoie et al.
  • E.G. Poitras et al.

    Advancing teacher technology education using open-ended learning environments as research and training platforms

    Australasian Journal of Educational Technology

    (2017)
  • R. Azevedo

    Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion

    Metacognition and Learning

    (2009)
  • R. Azevedo et al.

    Metacognition and self-regulated learning in student-centered learning environments

  • R. Azevedo et al.

    Does training on self-regulated learning facilitate students' learning with hypermedia?

    Journal of Educational Psychology

    (2004)
  • R. Azevedo et al.

    Dysregulated learning with advanced learning technologies

    Journal of E-Learning and Knowledge Society

    (2011)
  • M. Bannert et al.

    Process mining techniques for analysing patterns and strategies in students' self-regulated learning

    Metacognition and Learning

    (2014)
  • M.L. Bernacki

    Examining the cyclical, loosely sequenced, and contingent features of self-regulated learning: Trace data and their analysis

  • G. Biswas et al.

    Using a cognitive/metacognitive task model to analyze students learning behaviors

  • R. Cerezo et al.

    Process mining for self-regulated learning assessment in e-learning

    Journal of Computing in Higher Education

    (2019)
  • Y.H. Chen et al.

    Exploring the relationship between self-regulation and TPACK of Taiwanese secondary in-service teachers

    Journal of Educational Computing Research

    (2019)
  • M.H. Cho et al.

    Exploring online students’ self-regulated learning with self-reported surveys and log files: A data mining approach

    Interactive Learning Environments

    (2017)
  • D.V. Cicchetti

    Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology

    Psychological Assessment

    (1994)
  • V.M. Deekens et al.

    Monitoring and depth of strategy use in computer-based learning environments for science and history

    British Journal of Educational Psychology

    (2018)
  • D George et al.

    SPSS for Windows

    (2001)
  • R.J. Gil-Garcia et al.

    A general framework for agglomerative hierarchical clustering algorithms

  • C.R. Graham et al.

    Using TPACK as a framework to understand teacher candidates’ technology integration decisions

    Journal of Computer Assisted Learning

    (2012)
  • J. Greene et al.

    The measurement of learners' self-regulated cognitive and metacognitive processes while using computer-based learning environments

    Educational Psychologist

    (2010)
  • J Greene et al.

    Self-regulation of learning with computer-based learning environments

    New directions for teaching and learning

    (2011)
  • Cited by (0)

    View full text