Abstract The cognitive load imposed by instruction is an important consideration for instructional designers. Theoretical models have traditionally divided total cognitive load into intrinsic, extrinsic, and germane load. The 10-item Cognitive Load Inventory (CLI-10) is designed to measure these three types of cognitive load. It is typically administered immediately following a discrete learning activity

Abstract A simulation study was conducted to explore the impact of differential item functioning (DIF) on general factor difference estimation for bifactor, ordinal data. Common analysis misspecifications in which the generated bifactor data with DIF were fitted using models with equality constraints on noninvariant item parameters were compared under data generation conditions varying by sample size

Abstract Teacher judgments about student achievement may be biased by factors that go beyond students’ actual achievement. Emotional and behavioral disorder (EBD), which is characterized by behavioral problems yet unimpaired general cognitive abilities, may be one such biasing characteristic on student level. Moreover, bias may depend on characteristics at teacher level, such as teachers’ individual

Abstract Using data from 4047 adolescents in three countries, this study was designed to investigate the associations between two important components of the learning process: academic motivation and student engagement. To increase the precision and accuracy of these analyses, preliminary analyses were conducted to identify the optimal measurement structure of both constructs, leading us to retain

Abstract The purpose of this study was to evaluate the population invariance of equating functions across country subgroups in TIMSS 2015 mathematics tests in relation to the raw-score distribution, DIF, and DTF. We used equipercentile and IRT observed-score equating methods. The results of the study indicate that there is a relationship between the population invariance and raw-score and skewness

Abstract Adolescents’ academic achievement goals are associated with their perceptions of teacher and peer goals. Earlier research focused on perceived teacher goals, mostly disregarding perceived peer goals’ effects. However, since peer-group influence becomes prominent during adolescence, research on students’ perceptions of both peer and teacher goals should contribute to understanding achievement

Abstract Many of the analytical models commonly used in educational research often aim to maximize explained variance and identify variable importance within models. These models are useful for understanding general ideas and trends, but give limited insight into the individuals within said models. Data envelopment analysis (DEA), is a method rooted in organizational management that makes such insights

Abstract Productive learning of algebra is supported when students reflect on multiple strategies, compare them and discuss the rationale behind and relative merits of particular strategies. Comparison and Discussion of Multiple Strategies (CDMS) is an instructional approach designed to support these processes in math classrooms. In the current study, 16 Algebra I teachers received professional development

Abstract This study investigated the predictive validity of school-subject-specific self-concepts of ability, intrinsic task values, and cost (operationalized as task effort) for motivation regarding unclassified novel learning content—a fictional project management course—as a function of perceived similarity between school subject and novel learning content. Using an experimental survey design, perceived

Abstract Large-scale education data are collected via complex sampling designs that incorporate clustering and unequal probability of selection. Multilevel models are often utilized to account for clustering effects. The probability weighted approach (PWA) has been frequently used to deal with the unequal probability of selection. In this study, we examine the performance of an intuitive, easy to implement

Abstract Understanding the development of self-regulated learning (SRL) in applied educational contexts is currently an important goal for researchers. There exists a relatively rich literature for most SRL components in isolation yet the field is lacking in understanding their coordination. This study examined the relationship between metacognitive monitoring and causal attributions in a classroom

Abstract Research has shown that teachers’ autonomy support and provision of structure relate to students’ agentic and behavioral engagement. Moreover, agentic engagement elicits higher teacher autonomy support. In the present 5-week diary study, we investigated the dynamic nature of this interplay between teachers and students through their cross-assessment of students’ agentic and behavioral engagement

Abstract Cognitive diagnostic models (CDMs) are a family of psychometric models designed to provide categorical classifications for multiple latent attributes. CDMs provide more granular evidence than other psychometric models and have potential for guiding teaching and learning decisions in the classroom. However, CDMs have primarily been conducted using large samples. This study examines estimating

Abstract We investigated whether three interventions – studying incorrect worked examples, studying correct worked examples, or receiving feedback – improved children’s 0–1,000 (Experiment 1) and adults’ 1 thousand–1 billion (Experiment 2) number-line estimation precision relative to a no intervention control group. At pretest, participants estimated numbers on number lines (without feedback or examples)

Abstract Many colleges and universities seek to promote student success through targeted strategies for individuals or groups of students who are believed to have a higher risk of attrition. Taking a different focused approach, Supplemental Instruction (SI) provides voluntary collaborative learning sessions that are generally linked to specific undergraduate courses with a high percentage of students

Abstract In two-level designs, the total sample is a function of both the number of Level 2 clusters and the average number of Level 1 units per cluster. Traditional multilevel power calculations rely on either the arithmetic average or the harmonic mean when estimating the average number of Level 1 units across clusters of unbalanced size. The current study compares these two approaches with simulation-based

Abstract Two experimental studies investigated the disadvantages faced by female ethnic minority students when they are judged by pre- and inservice teachers. The results suggest that (preservice) teachers’ judgments were affected by the judgment dimension. Study 1 revealed that teachers apply gender stereotypes in their judgments on mathematical ability: Teachers perceived female students’ mathematical

Abstract This paper explores methodological questions in the study of identity through an examination and discussion of the empirical papers in this special issue. Particular attention is paid to the ways identity is operationalized in the study of how learning environments foster changes in students’ sense of self. The paper concludes that identity is a difficult construct to study in the context

Abstract Students’ cost perceptions have been associated with lower retention and academic performance in science, technology, engineering, and mathematics (STEM). Guided by expectancy-value theory, we examined whether relations between perceived costs and physics outcomes (i.e., engagement and achievement) varied as a function of self-efficacy or task values among undergraduate physics students (N = 1

Abstract The utility of homework and its impact on academic achievement has been an ongoing debate for more than 100 years. To date, there is no rigorous experimental research to show whether, and the extent to which, variations in the amount of homework assigned can impact the academic performance of elementary school students. In this study, 440 second-grade students were randomly distributed in

Abstract Decomposing variables into between and within components are often required in multilevel analysis. This method of decomposition should not ignore possible unreliability of an observed group mean (i.e., arithmetic mean) that is due to small cluster sizes and can lead to substantially biased estimates. Adjustment procedures that allow unbiased estimation have been defined and implemented in

Abstract Soft skills are important in several life domains, but their role in academic achievement has not been systematically investigated. This study examines how soft skills work together with self-regulated learning, motivation, and cognitive aspects in sustaining success at school. How extracurricular activities relates to these variables is examined too. A sample of 460 school students in years

Abstract With the increase in online course use (Allen & Seaman, 2017), there is an increasing need to determine the most effective (i.e., the most conducive for learning) way to present lectures online (e.g., video lectures). Lecture graphics that are interesting but extraneous to the content (e.g., a celebrity), have been shown to impair comprehension of the material, likely resulting from an increase

Abstract We build on identity-based motivation theory to integrate research on in-person and virtual learning environments so that we can articulate which features of virtual learning environments are likely to support or impede learning and identity exploration. Although students experience their identities as stable anchors for meaning-making and action, they construct what their identities mean

Abstract In a 21st century context of rapid technological advancement, virtual learning environments (VLEs) such as games have been increasingly designed, implemented, and researched for their capacity to offer immersive and interdisciplinary experiences that support student motivation and learning. As such, VLEs have acquired greater mainstream acceptance as tools for learning that is embodied, enactive

Abstract Artificial neural networks (NN) can help researchers estimate propensity scores for quasi-experimental estimation of treatment effects because they can automatically detect complex interactions involving many covariates. However, NN is difficult to implement due to the complexity of choosing an algorithm for various treatment levels and monitoring model performance. This research aims to develop

Abstract Within-cluster variance homogeneity is one of the key assumptions of multilevel models; however, assuming a constant (i.e. equal) within-cluster variance may not be realistic. Moreover, existent within-cluster variance heterogeneity should be regarded as a source of additional information rather than a violation of a model assumption. This study extends the three-level Rasch item response

Abstract A growing body of research suggests that utility-value interventions can promote students’ academic motivation and achievement. Moreover, there is evidence that minimal interventions are particularly useful for ethnic minority and first-generation students at college. Whether this is also the case with high school students belonging to minorities and having low parental educational background

Abstract Beliefs about academic functioning play an important role in the academic development of students. This study considers perceptions about underachievement, that is, the degree to which accomplishments are believed to be in line with potential. In particular, we examined why these perceptions might deviate from measured underachievement, determined by regressing achievement on a measure of

Abstract The purpose of the experiment reported here was to investigate whether mind mapping adds any value as a studying technique to that of testing. We compared the effects of mind mapping on acquisition on graders (N = 68) in a secondary school in two separate consecutive periods of learning called series. In series 1, half the students used mind mapping plus testing to learn the content of the

Abstract The present research examined how risk-taking protects against consequences of negative gender stereotypes among women in science, technology, engineering, and mathematics (STEM). In Study 1, undergraduate women and men in STEM (N = 1013) took an online survey assessing risk-taking, academic outcomes, and vulnerability to stereotype threat. Risk-taking predicted positive academic outcomes

(2020). Correction. The Journal of Experimental Education. Ahead of Print.

Abstract Optimal design of multisite randomized trials leverages sampling costs to optimize sampling ratios and ultimately identify more efficient and powerful designs. Past implementations of the optimal design framework have assumed that costs of sampling units are equal across treatment conditions. In this study, we developed a more flexible optimal design framework by introducing additional optimal

Abstract Dimensional comparisons between math and verbal achievements affect students’ academic self-concepts by increasing (decreasing) students’ self-concept in the subject with their intraindividual higher (lower) achievement. Dimensional comparison theory assumes that dimensional comparisons are also triggered by external influences. The present research aimed to test this assumption by examining

Abstract This research project applied Projective Reflection (PR) as a theoretical and methodological framework to facilitate learning as identity exploration. PR was used to iteratively design and implement three versions of Virtual City Planning, an augmenting virtual learning environment (AVLE) course in a science museum classroom to support high school students’ exploration of role-possible selves

(2021). Correction. The Journal of Experimental Education: Vol. 89, No. 2, pp. 442-443.

Abstract It is common to include multiple dependent variables (DVs) in single-case experimental design (SCED) meta-analyses. However, statistical issues associated with multiple DVs in the multilevel modeling approach (i.e., possible dependency of error, heterogeneous treatment effects, and heterogeneous error structures) have not been fully investigated. In this study, we first addressed various issues

Abstract Large lecture classes in higher education continue to be a context in which large performance differences between underrepresented minorities and their White and Asian peers are observed. In the current study, we sought to develop a package of interventions that may reduce this gap in a multi-section Micro Economics course. The focus of this intervention was to re-design instruction in students’

Abstract This study compared three approaches for handling a fourth level of nesting when analyzing cluster-randomized trial (CRT) data. Although CRT data analyses may include repeated measures, individual, and cluster levels, there may be an additional fourth level that is typically ignored. This study examined the impact of ignoring this fourth level, accounting for it using a model-based approach

Abstract The end of college is a key transition point when students prepare for the workforce or graduate school, and when competence beliefs that have been shaped throughout college play a particularly important role in decision-making processes. This study examined the roles of two competence beliefs, self-efficacy for scientific tasks and science academic self-efficacy, during the final year of

Abstract In this study, we examined the scoring and generalizability assumptions of an explicit instruction (EI) special education teacher observation protocol using many-faceted Rasch measurement (MFRM). Video observations of classroom instruction from 48 special education teachers across four states were collected. External raters (n = 20) were trained to observe and evaluate instruction using the

Abstract Three studies examine a novel pathway by which the perseverance component of the personality trait grit might predict college students’ behavioral persistence when solving challenging math problems. Specifically, we focus on the intervening role of what we refer to as math-specific self-perceptions of perseverance, which captures students’ perceived tendency and ability to persevere on challenging

Abstract The moment a child walks into a new classroom, teachers and classmates form an impression based on minimal information. Yet, little is known about the accuracy of such impressions when it concerns children’s social functioning at school. The current study examined the accuracy of children’s, teachers’ and adults’ impressions of 18 unacquainted children based on thin slices of behavior. The

Abstract Researchers have recently queried whether musical activities that express mathematical concepts enhance young students’ math skills. The use of abstract notations for math learning is also debated. The current study examined the effect of a music intervention program on pattern and symmetry knowledge. Simple graphical notation-writing was used for clarifying the abstractness of the music form

Abstract The essay reports two studies on confirmatory factor analysis of speeded data with an effect of selective responding. This response strategy leads test takers to choose their own working order instead of completing the items along with the given order. Methods for detecting speededness despite such a deviation from the given order are proposed and investigated. The first study demonstrated

Abstract Considerable research has shown that receiving effort-focused praise affects motivation positively, while ability-focused praise affects motivation negatively. However, these studies have investigated only the effects on the one receiving praise (the praisee). Therefore, we examined the effects of praise on the one offering praise (the praiser), focusing on the student-to-student context.

Abstract A key process in the discipline of science is argumentation, which has recently been receiving more attention in K-12 classrooms. The purpose of this multiple case study was to concurrently examine self-regulated learning processes (SRL) and learning outcomes of three teachers in a professional development (PD) on argumentation in science to assess the relationship between types of learning

Abstract We pilot tested an identity-based relevance-writing intervention designed to support developmental community college students’ (N = 54) educational commitment, value, and persistence. The intervention was embedded within regular journal assignments in two study skills courses with a third section serving as a comparison group. The intervention prompted students to explore how course topics

Abstract Although effective technical communication is an important outcome of undergraduate education in STEM fields, limited process-based writing instruction occurs in these disciplines. This study employed an experimental design to examine the use of Calibrated Peer Review (CPR), an online peer review platform, to improve lab report writing in an environmental engineering course. Students who completed

Abstract A simulation study was conducted to examine the efficacy of nine frequently-used HOV tests, including Levene’s tests with squared residuals and with absolute residuals, Brown and Forsythe (BF) test, Bootstrap BF test, O’Brien test, Z-variance test, Box-Scheffé (BS) test, Bartlett test, and Pseudo jackknife test under comprehensive simulation conditions. The results indicate that O’Brien, Levene’s

Abstract The current study investigated the impact of performance feedback on female students’ motivation following a summative classroom assessment in STEM. Seventh through ninth grade students (N = 161) were randomly assigned by their math or science class to one of the following conditions: grades, written comments, grades and comments, and no feedback. Results revealed complex interactions between

Abstract This study explored the relative effectiveness of generic versus specific reflection prompts on engineering students’ academic performance and engagement with four scales (i.e., behavioral, emotional, social, cognitive). The sample consisted of 208 engineering students in two sections of a required first-year engineering course. By using a quasi-experimental research design in classroom settings

Abstract This paper discusses the role of Multi-User Virtual Environments (MUVEs) in the development of epistemic learner identity. MUVEs might help educators create the types of tasks and intellectual open spaces helping students with learner identity development in the information age. MUVEs can create new possibilities for dissemination and sharing of critical information (e.g. nonhierarchical,

Abstract Researchers are encouraged to report effect size statistics to quantify treatment effects or effects due to group differences. However, estimates of effect sizes, most commonly Cohen’s d, make assumptions about the distribution of data that are not always true. An alternative nonparametric estimate of effect size, relying on the median absolute deviation, is proposed. Comparison of this estimate

Abstract This study examined temporal interrelations among math self-concept and math self-efficacy and their differential relations to two commonly applied math achievement indicators, that is, math achievement test scores and school grades in math. It based on a longitudinal design with four annual assessments of self-concept, self-efficacy, school grades, and achievement test scores in math during

Abstract Many experimental designs in educational and behavioral research involve at least one level of clustering. Clustering affects the precision of estimators and its impact on statistics in cross-sectional studies is well known. Clustering also occurs in longitudinal designs where students that are initially grouped may be regrouped in the following year and regrouped again in subsequent years

Abstract Learners’ monitoring judgments during reading are based on a variety of cues, and the roles of task features in promoting and constraining judgment accuracy are beginning to be understood. This work examined task and item characteristics influencing adults’ monitoring of performance during reading and study tasks. In Study 1a, adults (N = 242) read an expository text, provided text ratings

Abstract Research on young children’s development of executive function (EF) and early mathematics has established relationships between the two, but studies have not investigated whether these relations differ for children with different outcomes in mathematics and EF, especially in the context of interventions. To examine the homogeneity of those relations and the intervention effects, we conducted

Abstract The prevalence of the acronym tl;dr (“too long; didn’t read”) suggests that people intentionally disengage their attention from long sections of text. We studied this real-world phenomenon in an educational context by measuring rates of intentional and unintentional mind-wandering while undergraduate student participants (n = 80) read academic passages that were presented in either short sections

Abstract Educational stakeholders are keen to know the magnitude and importance of different interventions. However, the way evidence is communicated to support understanding of the effectiveness of an intervention is controversial. Typically studies in education have used the standardised mean difference as a measure of the impact of interventions. This measure, commonly known as the effect size,