-
Combining Mokken Scale Analysis with and rasch measurement theory to explore differences in measurement quality between subgroups International Journal of Testing (IF 1.0) Pub Date : 2024-08-16 Stefanie A. Wind, Benjamin Lugu, Yurou Wang
Mokken Scale Analysis (MSA) is a nonparametric approach that offers exploratory tools for understanding the nature of item responses while emphasizing invariance requirements. MSA is often discusse...
-
Examining the construct validity of the MIDUS version of the Multidimensional Personality Questionnaire (MPQ) International Journal of Testing (IF 1.0) Pub Date : 2024-07-29 Khalid ALMamari
The Multidimensional Personality Questionnaire (MPQ) measures a wide range of personality traits associated with affect and temperament. However, the lengthy administration time may have hindered i...
-
The choice between cognitive diagnosis and item response theory: A case study from medical education International Journal of Testing (IF 1.0) Pub Date : 2024-07-24 Youn Seon Lim, Catherine Bangeranye
Feedback is a powerful instructional tool for motivating learning. But effective feedback, requires that instructors have accurate information about their students’ current knowledge status and the...
-
Where nonresponse is at its loudest: Cross-country and individual differences in item nonresponse across the PISA 2018 student questionnaire International Journal of Testing (IF 1.0) Pub Date : 2024-07-24 Kseniia Marcq, Johan Braeken
The Programme for International Student Assessment (PISA) student questionnaire, despite being designed for low cognitive demand, may induce test burden due to its 306-item length, resulting in inc...
-
Social desirability, social-emotional competencies and intelligence: Using quadruplets to estimate evaluative and descriptive content International Journal of Testing (IF 1.0) Pub Date : 2024-07-02 Tatiana di Lucia Faion Franchi, Felipe Valentini, Leonardo Botinhon de Campos, Letícia da Silva de Souza, Pedro Vanni, Leonardo de Barros Mose, Ricardo Primi
This study investigated the application of item quadruplets to control social desirability in measuring socio-emotional competencies and their relationship with intelligence. Quadruplets involve fo...
-
Beyond group comparisons: Accounting for intersectional sources of bias in international survey measures International Journal of Testing (IF 1.0) Pub Date : 2024-07-02 Rujun Xu, James Soland
International surveys are increasingly being used to understand nonacademic outcomes like math and science motivation, and to inform education policy changes within countries. Such instruments assu...
-
Can the dark core of personality be measured briefly, multidimensionally, and invariantly? The D25 measure International Journal of Testing (IF 1.0) Pub Date : 2024-06-28 Pedro Pechorro, Bruno Bonfá-Araujo, João Maroco, Mário R. Simões, Matt DeLisi
The dark core of personality is a recent construct that encompasses the malevolent, antagonistic, and aversive side of human nature that represents the common inner core of dark personality traits....
-
Investigating the acquiescent responding impact in empathy measures International Journal of Testing (IF 1.0) Pub Date : 2024-06-21 Gisele Magarotto Machado, Nelson Hauck-Filho, Ana Celi Pallini, João Lucas Dias-Viana, Leilane Henriette Barreto Chiappetta Santana, Cristina Aparecida Nunes Medeiros da Silva, Felipe Valentini
Our primary objective was to examine the impact of acquiescent responding on empathy measures. We selected the Affective and Cognitive Measure of Empathy (ACME) as the measure for this case study d...
-
Structure and factorial invariance of an irrational beliefs scale in adolescents from Peru and Turkey International Journal of Testing (IF 1.0) Pub Date : 2024-06-21 Cristian Ramos-Vera, Gleni Quispe-Callo, José Vallejos Salvarriaga, Kıvanç Uzun, Jacksaint Saintila
Irrational beliefs (IB) are irrational thinking patterns that limit the interpretation of situations and generate difficulties in daily life. Although there are several instruments to evaluate irra...
-
Development of an indicator for screening the dependent personality disorder using factors of the Dimensional Clinical Personality Inventory 2 in a Brazilian community sample International Journal of Testing (IF 1.0) Pub Date : 2024-03-21 André Pereira Gonçalves, Lucas de Francisco Carvalho
We aimed to verify the capacity of the Dimensional Clinical Personality Inventory 2 (IDCP-2) factors to identify people with high levels of dependent personality disorder (DPD) traits in a Brazilia...
-
Identification and validation of severity standards for the academic anxiety scale International Journal of Testing (IF 1.0) Pub Date : 2024-03-14 W. Holmes Finch, Jerrell C. Cassady, C. Addison Helsper
The Academic Anxiety Scale (AAS; Cassady, 2022; Cassady et al., 2019) is a measure of the construct academic anxiety, which is a generalized representation of anxieties experienced by learners in e...
-
Internal structure and invariance analysis of the EAGrit-LP-R scale for Grit assessment International Journal of Testing (IF 1.0) Pub Date : 2024-03-11 Ana Paula Porto Noronha, Leandro S. Almeida, Caroline T. Reppold
Grit is a stable and measurable trait. It refers to the individual’s ability to maintain efforts and interest in projects that take time to complete and are useful in educational contexts. In this ...
-
A meta-analysis of the relationship between Wonderlic test scores and school success International Journal of Testing (IF 1.0) Pub Date : 2024-02-16 Chet Robie, Sabah Rasheed, Stephen D. Risavy, Piers Steel
This meta-analysis examined the validity of an alternative to traditional assessments called the Wonderlic which is a brief measure of general mental ability. Our results showed significant, positi...
-
Designing classroom assessments with the end user in mind International Journal of Testing (IF 1.0) Pub Date : 2024-02-13 Leanne R. Ketterlin-Geller, Jennifer McMurrer, Tina Barton
Teachers are key users of classroom assessment data; however, their needs and preferences are often overlooked in the design and development of the assessments themselves. We used principles of Hum...
-
The Test Adaptation Reporting Standards (TARES): reporting test adaptations International Journal of Testing (IF 1.0) Pub Date : 2024-01-23 Dragos Iliescu, Dave Bartram, Pia Zeinoun, Matthias Ziegler, Paula Elosua, Stephen Sireci, Kurt F. Geisinger, Aletta Odendaal, Maria Elena Oliveri, Jon Twing, Wayne Camara
The “Test Adaptation Reporting Standards” (TARES), or “TARES statement” was developed to alleviate the problems arising from inadequate reporting of test adaptation procedures. The TARES contains a...
-
Detecting differential item functioning with multiple causes: A comparison of three methods International Journal of Testing (IF 1.0) Pub Date : 2024-01-23 Xiaowen Liu
Differential item functioning (DIF) often arises from multiple sources. Within the context of multidimensional item response theory, this study examined DIF items with varying secondary dimensions ...
-
Prevalence of random responders as a function of scale position and questionnaire length in the TIMSS 2015 eighth-grade student questionnaire International Journal of Testing (IF 1.0) Pub Date : 2024-01-23 Saskia van Laar, Johan Braeken
This study examined the impact of two questionnaire characteristics, scale position and questionnaire length, on the prevalence of random responders in the TIMSS 2015 eighth-grade student questionn...
-
Explaining performance decline over the course of taking comprehensive proficiency tests: the roles of effort and omission propensity International Journal of Testing (IF 1.0) Pub Date : 2023-08-31 Karoline A. Sachse, Sebastian Weirich, Nicole Mahler, Camilla Rjosk
In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance ...
-
An empirical test of a new trait-based measure for psychopathy in a community sample of adults International Journal of Testing (IF 1.0) Pub Date : 2023-08-31 Gisele Magarotto Machado, Nelson Hauck-Filho, Ariela Raissa Lima-Costa, Lucas de Francisco Carvalho
In the current study, we used latent profile analysis to investigate the Dimensional Clinical Personality Inventory 2 capacity to discriminate psychopathy traits in a sample of adults. Participants...
-
Questionnaire-taking motivation: Using response times to assess motivation to optimize on the PISA 2018 student questionnaire International Journal of Testing (IF 1.0) Pub Date : 2023-05-30 Erik Lundgren, Hanna Eklöf
This study aims to assess student motivation to provide valid responses to the PISA student questionnaire. This was done by modeling response times using a three-component finite mixture model, com...
-
The analysis of TIMSS 2015 data with confirmatory mixture item response theory: A multidimensional approach International Journal of Testing (IF 1.0) Pub Date : 2023-05-30 Fatima Munevver Saatcioglu, Sedat Sen
In this study, we illustrated an application of the confirmatory mixture IRT model for multidimensional tests. We aimed to examine the differences in student performance by domains with a confirmat...
-
Can your darkness be measured? Analyzing the full and brief version of the Dark Factor of Personality in Swedish International Journal of Testing (IF 1.0) Pub Date : 2023-04-18 Nico Streckert, Lara Kurtz, Petri J. Kajonius
Abstract The Dark Factor of Personality (D) measures the latent core of antagonistic traits. The present study evaluated the psychometric properties of the Swedish version of the full (D70) and the brief (D16) versions, concerning structural validity, item information, and convergent validity. An online sample (N = 294) was analyzed using CFA (Maximum Likelihood Estimation), IRT (Graded Response Model)
-
A study of Test-Taking strategies of Iranian IELTS repeaters: Any change in the strategy use? International Journal of Testing (IF 1.0) Pub Date : 2023-04-18 Masoomeh Estaji, Zahra Banitalebi
Abstract This study used Latent Growth Curve Modeling (LGCM) to examine the overtime patterns of the score and test-taking strategy changes in an international high-stakes standardized proficiency test. To this end, the test records of 178 Iranian IELTS repeaters were analyzed, using close- and open-ended questionnaires to measure test scores as a function of construct-relevant and construct-irrelevant
-
Investigating the overlap and predictive validity between Criterion A and B in the alternative model for personality disorders in DSM-5 International Journal of Testing (IF 1.0) Pub Date : 2023-04-03 Carla Martí Valls, Kitty Balazadeh, Petri Kajonius
Abstract The Alternative DSM-5 Model for Personality Disorders (AMPD) consists of level of personality functioning (Criterion A) and maladaptive personality traits (Criterion B). The brief scale versions of these are understudied, while often being used by clinicians and researchers. In this study, we wanted to investigate the overlap and predictive validity of Criterion A and B. Participants (N = 253)
-
Post-COVID-19 perceived stigma-discrimination scale: psychometric development and evaluation International Journal of Testing (IF 1.0) Pub Date : 2023-03-10 Carlos Arturo Cassiani-Miranda, John Carlos Pedrozo-Pupo, Adalberto Campo-Arias
Abstract The study aimed to adapt and evaluate a scale to measure COVID-19-CED in COVID-19 survivors. A sample of 330 COVID-19 survivors filled out the COVID-19 Perceived Discrimination Scale (C-19-PDS). C-19-PDS was adapted from the Tuberculosis Perceived Discrimination Scale (11 items). Confirmatory factor analysis showed poor goodness-of-fit indicators. However, the 5-item version of the C-19-PDS
-
Multidimensionality and measurement invariance of the revised developmental work personality scale International Journal of Testing (IF 1.0) Pub Date : 2023-01-18 Rongxiu Wu, Chungyi Chiu, David Dueber, Mirang Park, Dustin Lange, Emre Umucu, David Strauser
Abstract The current study examined the factor structure, measurement invariance, and construct validity of the 14-item Revised Developmental Work Personality Scale (RDWPS) using a sample of 603 college students in a Midwest university of the United States. Exploratory and confirmatory factor analysis results indicated that the 11-item RDWPS resulted in a better fit of the measurement model. Partial
-
Summative assessments in a multilingual context: What comparative judgment reveals about comparability across different languages in Literature International Journal of Testing (IF 1.0) Pub Date : 2022-12-28 Louise Badham, Antony Furlong
Abstract Multilingual summative assessments face significant challenges due to tensions that exist between multiple language provision and comparability. Yet, conventional approaches for investigating comparability in multilingual assessments fail to accommodate assessments that comprise extended responses that target complex constructs. This article discusses a study that investigated whether bilingual
-
Measuring pathological traits of the dependent personality disorder based on the HiTOP International Journal of Testing (IF 1.0) Pub Date : 2022-12-19 Lucas de Francisco Carvalho, André Pereira Gonçalves, Amanda Rizzieri Romano, Antônio da Conceição Montes, Gisele Magarotto Machado, Giselle Pianowski
Abstract We developed and validated a self-report scale for screening pathological traits of dependent personality disorder (DPD) from the Hierarchical Taxonomy of psychopathology (HiTOP) perspective. The sample was 693 adults who answered the new scale, the Dimensional Clinical Personality Inventory DPD (IDCP-DPD), the PID-5, the FFDI, and the FFBI. The IDCP-DPD was composed of six factors grouped
-
Refining the antisocial subscale of the dimensional clinical personality inventory 2: Failed improvements or did we reach the mountain top International Journal of Testing (IF 1.0) Pub Date : 2022-12-19 Lucas de Francisco Carvalho, Camila Grillo Santos, Nelson Fernandes Junior, Rafael Moreton Alves da Rocha, Talita Meireles Flores, Gisele Magarotto Machado
Abstract We aimed to refine the previously proposed antisocial subscale for the Dimensional Clinical Personality Inventory 2 (IDCP-ASPD). The sample involved 628 Brazilian adults between 18 and 81 years old. We administered the revised ASPD subscale (IDCP-ASPD-R), the Affective and Cognitive Measure of Empathy (ACME), the Crime and Analogous Behavior Scale (CAB), and the Levenson Self-Report Psychopathy
-
Technology-based assessments: Novel approaches to testing in organizational, psychological, and educational settings International Journal of Testing (IF 1.0) Pub Date : 2022-11-18 Christopher D. Nye
Published in International Journal of Testing (Vol. 22, No. 3-4, 2022)
-
A psychometric view of technology-based assessments International Journal of Testing (IF 1.0) Pub Date : 2022-11-18 Gloria Liou, Cavan V. Bonner, Louis Tay
Abstract With the advent of big data and advances in technology, psychological assessments have become increasingly sophisticated and complex. Nevertheless, traditional psychometric issues concerning the validity, reliability, and measurement bias of such assessments remain fundamental in determining whether score inferences of human attributes are appropriate. We focus on three technological advances—the
-
You are what you click: using machine learning to model trace data for psychometric measurement International Journal of Testing (IF 1.0) Pub Date : 2022-11-18 Richard N. Landers, Elena M. Auer, Gabriel Mersy, Sebastian Marin, Jason Blaik
Abstract Assessment trace data, such as mouse positions and their timing, offer interesting and provocative reflections of individual differences yet are currently underutilized by testing professionals. In this article, we present a 10-step procedure to maximize the probability that a trace data modeling project will be successful: 1) grounding the project in psychometric theory, 2) building technical
-
Mobile sensing in psychological and educational research: Examples from two application fields International Journal of Testing (IF 1.0) Pub Date : 2022-11-18 Efsun Birtwistle, Ramona Schoedel, Florian Bemmann, Astrid Wirth, Christoph Sürig, Clemens Stachl, Markus Bühner, Frank Niklas
Abstract Digital technologies play an important role in our daily lives. Smartphones and tablet computers are very common worldwide and are available for everybody from a very early age. This trend offers the opportunity to track digital usage data for psychological and educational research purposes. The current paper introduces two research projects, the PhoneStudy and Learning4Kids that both use
-
Generating reading comprehension items using automated processes International Journal of Testing (IF 1.0) Pub Date : 2022-11-18 Jinnie Shin, Mark J. Gierl
Abstract Over the last five years, tremendous strides have been made in advancing the AIG methodology required to produce items in diverse content areas. However, the one content area where enormous problems remain unsolved is language arts, generally, and reading comprehension, more specifically. While reading comprehension test items can be created using many different item formats, fill-in-the-blank
-
Investigating the writing performance of educationally at-risk examinees using technology International Journal of Testing (IF 1.0) Pub Date : 2022-11-18 Mo Zhang, Sandip Sinharay
Abstract This article demonstrates how recent advances in technology allow fine-grained analyses of candidate-produced essays, thus providing a deeper insight on writing performance. We examined how essay features, automatically extracted using natural language processing and keystroke logging techniques, can predict various performance measures using data from a large-scale and high-stakes assessment
-
Correction International Journal of Testing (IF 1.0) Pub Date : 2022-05-17
Published in International Journal of Testing (Vol. 23, No. 1, 2023)
-
Examining patterns of omitted responses in a large-scale English language proficiency test International Journal of Testing (IF 1.0) Pub Date : 2022-05-12 Merve Sarac, Eric Loken
Abstract This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses as missing rather than wrong showed that examinees
-
Using item response theory to understand the effects of scale contextualization: An illustration using decision making style scales International Journal of Testing (IF 1.0) Pub Date : 2022-03-15 Nathaniel M. Voss, Cassandra Chlevin-Thiele, Christopher J. Lake, Chi-Leigh Warren
Abstract The goal of this study was to extend research on scale contextualization (i.e., frame-of-reference effect) to the decision making styles construct, compare the effects of contextualization across three unique decision style scales, and examine the consequences of scale contextualization within an item response theory framework. Based on a mixed experimental design, data gathered from 661 university
-
The development and validation of the Resilience Index International Journal of Testing (IF 1.0) Pub Date : 2022-02-25 Mariza van Wyk, Gosia Lipinska, Michelle Henry, Tyler K. Phillips, P. Etienne van der Walt
Abstract Resilience comprises various neurobiological, developmental, and psychosocial components. However, existing measures lack certain critical components, while having limited utility in low-to-middle-income settings. We aimed to develop a reliable and valid measure of resilience encompassing a broad range of components and that can be used across different income settings. We also set out to
-
Evaluating group differences in online reading comprehension: The impact of item properties International Journal of Testing (IF 1.0) Pub Date : 2022-02-25 Hatice Cigdem Bulut, Okan Bulut, Serkan Arikan
Abstract This study examined group differences in online reading comprehension (ORC) using student data from the 2016 administration of the Progress in International Reading Literacy Study (ePIRLS). An explanatory item response modeling approach was used to explore the effects of item properties (i.e., item format, text complexity, and cognitive complexity), student characteristics (i.e., gender and
-
An investigation of item, examinee, and country correlates of rapid guessing in PISA International Journal of Testing (IF 1.0) Pub Date : 2022-02-09 Joseph A. Rios, James Soland
Abstract The objective of the present study was to investigate item-, examinee-, and country-level correlates of rapid guessing (RG) in the context of the 2018 PISA science assessment. Analyzing data from 267,148 examinees across 71 countries showed that over 50% of examinees engaged in RG on an average proportion of one in 10 items. Descriptive differences were noted between countries on the mean
-
Introduction to International Journal of Testing special issue on equity and fairness in testing and assessment in school admissions International Journal of Testing (IF 1.0) Pub Date : 2022-01-27 Sang Eun Woo, Bart Wille, Stephen G. Sireci
(2022). Introduction to International Journal of Testing special issue on equity and fairness in testing and assessment in school admissions. International Journal of Testing: Vol. 22, Equity and Fairness in Testing and Assessment in School Admissions, pp. 1-4.
-
Using personal statements in college admissions: An investigation of gender bias and the effects of increased structure International Journal of Testing (IF 1.0) Pub Date : 2022-01-27 A. Susan M. Niessen, Marvin Neumann
Abstract Personal statements are among the most commonly used instruments in college admissions procedures. Yet, little research on their reliability, validity, and fairness exists. The first aim of this paper was to investigate hypotheses about adverse impact and underprediction for female applicants, which could result from lower tendencies to use agentic language compared to male applicants. Second
-
Is there bias in alternatives to standardized tests? An investigation into letters of recommendation International Journal of Testing (IF 1.0) Pub Date : 2022-01-27 Dev K. Dalal, Jason G. Randall, Ho Kwan Cheung, Brandon C. Gorman, Sylvia G. Roch, Kevin J. Williams
Abstract Individuals concerned with subgroup differences on standardized tests suggest replacing these tests with holistic evaluations of unstructured application materials, such as letters of recommendation (LORs), which they posit show less bias. We empirically investigate this proposition that LORs are bias-free, and argue that LORs might actually invite systematic, race and gender subgroup differences
-
Dropping the GRE, keeping the GRE, or GRE-optional admissions? Considering tradeoffs and fairness International Journal of Testing (IF 1.0) Pub Date : 2022-01-27 Daniel A. Newman, Chen Tang, Q. Chelsea Song, Serena Wee
Abstract In considering whether to retain the GRE in graduate school admissions, admissions committees often pursue two objectives: (a) performance in graduate school (e.g., admitting individuals who will perform better in classes and research), and (b) diversity/fairness (e.g., equal selection rates between demographic groups). Drawing upon HR research (adverse impact research), we address four issues
-
Using third-party evaluations to assess socioemotional skills in graduate and professional school admissions International Journal of Testing (IF 1.0) Pub Date : 2022-01-27 David Klieger, Jennifer Bochenek, Chelsea Ezzo, Steven Holtzman, Frederick Cline, Margarita Olivera-Aguilar
Abstract Consideration of socioemotional skills in admissions potentially can increase representation of racial and ethnic minorities and women in graduate and professional education as well as identify candidates more likely to succeed in graduate and professional school. Research on one such assessment, the ETS Personal Potential Index (PPI), showed that the PPI produced much smaller racial/ethnic-gender
-
Test efficacy: Refocusing validation from college exams to candidates International Journal of Testing (IF 1.0) Pub Date : 2022-01-27 Alvaro J. Arce, Michael J. Young
Abstract The paper argues that contemporary test validity theory places the consequences of testing on the lives of all college applicants at the back of the test validation argument. It introduces the notion of test efficacy as a process to gather evidence on claims on consequences of testing on all college applicants that can be traced back to validity. The paper proposes a test efficacy framework
-
Metacognitive skills inventory (MSI): development and validation International Journal of Testing (IF 1.0) Pub Date : 2021-10-15 Hajara Abdul Hameed, Reena Cheruvalath
Abstract Metacognitive skills help to control and regulate negative thoughts, emotions, beliefs and sad memories. The objective of the study was to develop and validate an inventory-Metacognitive Skills Inventory (MSI) to assess the variance in adopting metacognitive strategies between those who have depressive symptoms and those who have not. Two studies were carried out among Indian youth (study
-
Cross-country comparability of a social-emotional skills assessment designed for youth in low-resource environments International Journal of Testing (IF 1.0) Pub Date : 2021-11-17 Nina Menezes Cunha, Andres Martinez, Patrick Kyllonen, Sarah Gates
Abstract We evaluate the measurement invariance of a 48-item instrument designed to measure general social and emotional skills of youth in low resource environments. We refer to the skills measured as positive self-concept, negative self-concept, higher order thinking skills, and social and communication skills. These skills are often associated with economic development and can be used to evaluate
-
Examining severity and centrality effects in TestDaF writing and speaking assessments: An extended Bayesian many-facet Rasch analysis International Journal of Testing (IF 1.0) Pub Date : 2021-09-03 Thomas Eckes, Kuan-Yu Jin
Abstract Severity and centrality are two main kinds of rater effects posing threats to the validity and fairness of performance assessments. Adopting Jin and Wang’s (2018) extended facets modeling approach, we separately estimated the magnitude of rater severity and centrality effects in the web-based TestDaF (Test of German as a Foreign Language) writing and speaking assessments using Bayesian MCMC
-
Animated videos in assessment: comparing validity evidence from and test-takers’ reactions to an animated and a text-based situational judgment test International Journal of Testing (IF 1.0) Pub Date : 2021-05-17 Anastasios Karakolidis, Michael O’Leary, Darina Scully
Abstract The linguistic complexity of many text-based tests can be a source of construct-irrelevant variance, as test-takers’ performance may be affected by factors that are beyond the focus of the assessment itself, such as reading comprehension skills. This experimental study examined the extent to which the use of animated videos, as opposed to written text, could (i) reduce construct-irrelevant
-
Exploring task features that predict psychometric quality of test items: the case for the Dutch driving theory exam International Journal of Testing (IF 1.0) Pub Date : 2021-05-27 Erik C. Roelofs, Wilco H. M. Emons, Angela J. Verschoor
Abstract This study reports on an Evidence Centered Design (ECD) project in the Netherlands, involving the theory exam for prospective car drivers. In particular, we illustrate how cognitive load theory, task-analysis, response process models, and explanatory item-response theory can be used to systematically develop and refine task models. Based on a cognitive model for driving, 353 existing items
-
Validating theoretical assumptions about reading with cognitive diagnosis models International Journal of Testing (IF 1.0) Pub Date : 2021-06-09 Ann Cathrice George, Alexander Robitzsch
Abstract Modern large-scale studies such as the Progress in International Reading Literacy Study (PIRLS) do not only report reading competence of students on a global reading scale but also report reading on the level of reading subskills. However, the number of and the dependencies between the subskills are frequently discussed. In this study, different theoretical assumptions regarding the subskills
-
Goal orientation in job search: Psychometric characteristics and construct validation across job search contexts International Journal of Testing (IF 1.0) Pub Date : 2021-03-03 Emmanuel Affum-Osei, Henry Kofi Mensah, Solomon Kwarteng Forkuoh, Eric Adom Asante
Abstract The purpose of this study was to examine the psychometric properties of the goal orientation (GO) scale across job search contexts to facilitate its use in large and varied search settings. A sample of 720 job losers and new entrants’ job seekers in Ghana completed the survey. Confirmatory factor analysis supported the three-factor theoretical structure (Learning goal, Performance-prove goal
-
Examining provision and sufficiency of testing accommodations for English learners International Journal of Testing (IF 1.0) Pub Date : 2021-02-23 Sarina Roschmann, Sara E. Witmer, Martin A. Volker
Abstract Accommodations are commonly provided to address language-related barriers students may experience during testing. Research on the validity of scores from accommodated test administrations remains somewhat inconclusive. The current study investigated item response patterns to understand whether accommodations, as used in practice among English learners (ELs) in the United States, allow for
-
Cognitive diagnosis models and automated test assembly: an approach incorporating response times International Journal of Testing (IF 1.0) Pub Date : 2020-10-26 Matthew D. Finkelman, Jimmy de la Torre, Jeremy A. Karp
Abstract Cognitive diagnosis models (CDMs) have been studied as a means of providing detailed diagnostic information about the skills that have been mastered, and the skills that have not, by examinees. Prior research has examined the use of automated test assembly (ATA) alongside CDMs; however, no previous study has investigated how to perform ATA when a CDM is employed and the total amount of time
-
Coaching β in admission test performance: a study of group differences International Journal of Testing (IF 1.0) Pub Date : 2020-07-31 Anely Ramirez, Mladen Koljatic, Monica Silva
Abstract The study addresses the association between coaching practices and university admission test performance in Chile. Estimates of coaching effects are reported for test-takers from the private and public school systems. Our results indicate that coaching is associated with variations in test scores. The estimated magnitude of coaching appears to vary by subject area, type of coaching strategy
-
Examining the simultaneous change in emotions during a test: relations with expended effort and test performance International Journal of Testing (IF 1.0) Pub Date : 2020-07-25 Sara J. Finney, Beth A. Perkins, Paulius Satkus
Abstract Using a sample of 497 college students, we measured test-taking emotions (anger, worry, pride, enjoyment) after the first third, second third, and last third of a low-stakes cognitive test of sociocultural knowledge. We examined the simultaneous change in emotions and whether change in emotions predicted subsequent test-taking effort and test performance. Latent growth models indicated that
-
Effect of Quality Characteristics of Peer Raters on Rating Errors in Peer Assessment International Journal of Testing (IF 1.0) Pub Date : 2020-02-12 Xiuyan Guo, Pui-Wa Lei
Little research has been done on the effects of peer raters’ quality characteristics on peer rating qualities. This study aims to address this gap and investigate the effects of key variables related to peer raters’ qualities, including content knowledge, previous rating experience, training on rating tasks, and rating motivation. In an experiment where training and motivation interventions were manipulated
-
The Relationship between Response-Time Effort and Accuracy in PISA Science Multiple Choice Items International Journal of Testing (IF 1.0) Pub Date : 2020-01-10 Michalis P. Michaelides, Militsa Ivanova, Christiana Nicolaou
The study examined the relationship between examinees’ test-taking effort and their accuracy rate on items from the PISA 2015 assessment. The 10% normative threshold method was applied on Science multiple-choice items in the Cyprus sample to detect rapid guessing behavior. Results showed that the extent of rapid guessing across simple and complex multiple-choice items was on average less than 6% per