(2021). Obituary. Language Assessment Quarterly: Vol. 18, No. 2, pp. 81-82.

ABSTRACT The purpose of diagnostic language assessment is to identify learner strengths and weaknesses so that subsequent learning activity can be planned according to learner needs, a purpose which aligns with pedagogical recommendations to individualize instruction. Indeed, the extent to which diagnostic assessment can inform the selection of instructional targets and in turn promote individual linguistic

ABSTRACT This paper constitutes an edited transcript of two online panels, conducted with four scholars whose complementary expertise regarding print literacy and migration offers a thought-provoking and innovative window on the representation of print literacy in applied linguistic research and in migration policy. The panel members are experts on language policy, literacy, proficiency and human capital

(2021). English Language Proficiency Testing in Asia: A New Paradigm Bridging Global and Local Contexts. Language Assessment Quarterly. Ahead of Print.

ABSTRACT Expert judgement has been frequently employed with reading assessments to gauge the skills potentially measured by test tasks, for purposes such as construct validation or producing diagnostic information. Despite the critical role it plays in such endeavours, few studies have triangulated its results with other types of data such as reported test-taking processes. A lack of such triangulation

(2021). Local language testing: design, implementation, and development. Language Assessment Quarterly. Ahead of Print.

ABSTRACT A long-standing debate in the testing of listening concerns the authenticity of the listening input. On the one hand, listening texts produced by item-writers often lack spoken language characteristics. On the other hand, real-life recordings are often too context-specific to stand alone, or not suitable for item generation. In this study, we explored the effectiveness of an existing item-writing

ABSTRACT The following interview was conducted with Catherine Elder in spring of 2020, at the beginning of the pandemic. Cathie has had a varied career in language testing, including work at universities in Australia and New Zealand and at the Language Testing Resource Center in Melbourne. In this interview, Cathie shares some highlights of her somewhat serendipitous career as well as lessons she has

ABSTRACT The COVID-19 pandemic led to rapid innovation among language assessment developers who had to adapt their testing processes to address various restrictions from governments and institutions. This overview introduces some of the challenges and opportunities test developers grappled with during this period as well as introduces the six commentaries provided in the special issue. These commentaries

ABSTRACT In this commentary, we describe the English language placement adaptations we were required to make due to the world-wide COVID-19 pandemic. It includes a brief description of our placement test battery which was adapted to address our institution’s move to a remote teaching/learning mode. A discussion of the major challenges we experienced, their impacts, and how we addressed them is also

ABSTRACT When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be administered virtually. The new test (the TU

ABSTRACT The sheer scale of the IELTS testing infrastructure and its unique position in the world of international education dictated some of the particular challenges that the IELTS Partners (British Council, IDP Education and Cambridge Assessment English) faced after the closure of test centres during the COVID-19 pandemic. Decisions taken would have an impact on millions of test-takers globally

ABSTRACT The COVID-19 pandemic pushed the Iowa State University administration to impose face coverings and other safety regulations across the university campus. To comply with these safety measures, several changes to the English Placement Test of Oral Communication (EPT OC) had to be made. This paper discusses how the EPT OC was adapted to comply with the safety regulations mandated by the university

ABSTRACT The TOEFL iBT test was introduced in 2005 to better reflect the language demands of real-life academic tasks than did previous versions of the test. The task-based design of the test was intended to support the interpretation of its scores as a trustworthy measure of international students’ ability to use English in an academic environment. Until recently, the TOEFL iBT test was exclusively

ABSTRACT The online placement test for the Community English Language Program (CLP) at Teachers College, Columbia University has been administered in a computer lab since 2015. While most of the components of this placement exam system are online, including registration, exam delivery, scoring, and score reporting, the COVID-19 pandemic elevated the need to find a solution to the final component, a

ABSTRACT Responding to the challenge of delivering valid assessments during the unprecedented times of the COVID-19 pandemic was certainly not easy. However, the efforts will undoubtedly lead to developments in the field of language assessment. This special issue closes with a brief summary of the commentaries it contains and raises some unanswered questions that need to be addressed moving forward

(2021). “Follow Your Interests Because Those Will Motivate You to Excel”: An Interview with Alister Cumming. Language Assessment Quarterly: Vol. 18, The quest to maintain language assessment quality during a pandemic: Stories from higher education, pp. 56-75.

ABSTRACT The implicit sociocultural functioning of the content of high-stakes English language proficiency tests is a rarely-explored concern in language assessment. This study attempts to bring critical views of language testing and critical discourse studies together to examine the content of IELTS preparation materials in search of topics that are reflected and reproduced through this content. Fourteen

ABSTRACT This study investigated the extent to which an extended time limit in an argumentative writing test affects the quality of argumentation in L2 writing. Thirty-two adult ESL learners each wrote two essays on different prompts, one in 30 minutes and one in 45 minutes in a counter-balanced design. The 64 essays were analytically rated by four trained raters. The results show that the sub-score

ABSTRACT The language assessment issues discussed in this paper are set against the backdrop of the English as an additional language (EAL) provision for students from ethnic and linguistic minority communities in the publicly funded school education system in England. We will first provide a background description of the educational response to linguistic minorities in the school system in England

ABSTRACT Modern vocabulary size tests are generally based on the notion that the more frequent a word is in a language, the more likely a learner will know that word. However, this assumption has been seldom questioned in the literature concerning vocabulary size tests. Using the Vocabulary of American-English Size Test (VAST) based on the Corpus of Contemporary American English (COCA), 403 English

ABSTRACT The increasing representation of young language-minority students in school settings around the world and recent insights into multilingualism as apotential reggsource for language learning and development call for acritical study of theoretical and practical implications for the field of language teaching and assessment. Relatively little attention has been devoted to exploring the assessment

引言

(2021). Evaluating language assessments. Language Assessment Quarterly: Vol. 18, No. 2, pp. 199-203.

ABSTRACT The COVID-19 pandemic led to rapid innovation among language assessment developers who had to adapt their testing processes to address various restrictions from governments and institutions. This overview introduces some of the challenges and opportunities test developers grappled with during this period as well as introduces the six commentaries provided in the special issue. These commentaries

ABSTRACT The online placement test for the Community English Language Program (CLP) at Teachers College, Columbia University has been administered in a computer lab since 2015. While most of the components of this placement exam system are online, including registration, exam delivery, scoring, and score reporting, the COVID-19 pandemic elevated the need to find a solution to the final component, a

ABSTRACT This paper will deal, firstly, with the South African context, that cries out for attention to responsible language assessment. The renewed interest in language testing in South Africa is well illustrated in assessments of language ability for educational purposes generally, and more specifically in the assessment of academic literacy. Secondly, the paper presents a meaningful reminder that

ABSTRACT L2 test developers often use scripted spoken texts in their L2 listening tests, because it is efficient and practical to create scripted spoken texts that meet predetermined test specifications. But because scripted spoken texts differ in a number of fundamental ways from unscripted spoken language, there are potential threats to validity when only scripted spoken texts are used to assess

ABSTRACT Recent research conducted as part of the English Profile identified grammatical criterial features that are characteristic of each Common European Framework of Reference (CEFR) proficiency level. The extent to which these criterial features attest in English learners of various first language backgrounds call for an empirical examination. In this study, I investigated the use of the criterial

(2020). Correction. Language Assessment Quarterly. Ahead of Print.

ABSTRACT Effective listening comprehension skills are an important prerequisite for the academic success of primary school students. However, the assessment of listening skills in the instructional language appears to have received only scant attention in the literature. Therefore, the goal of the present study was twofold. Firstly, a comprehensive listening test was developed and different aspects

ABSTRACT Indices of lexical diversity have been used to estimate the size of a writer’s vocabulary and/or a writer’s lexical proficiency for some time. One issue with many commonly used indices of lexical diversity (e.g., TTR and index) is that they vary as a function of text length. Accordingly, much research has been devoted to the development of indices that are text length independent. However

ABSTRACT The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of proficiency to relate stimulus text information in

(2020). Obituary. Language Assessment Quarterly: Vol. 17, Validity Considerations for Assessing Language Proficiency in Young Language Minority Students, pp. 459-460.

ABSTRACT This commentary highlights major validation challenges raised, explicitly or implicitly, from the four articles in the special issue on “Validity Considerations for Assessing Language Proficiency in Young Language Minority Students.” They are concerned with (a) the construct definition in consideration of young language-minority (LM) students’ characteristics, (b) the integration of scaffolding

ABSTRACT One of the challenges of developing assessments for young language learners is the shortage of evidence-based information about such assessments for languages other than English. In light of this situation, this paper discusses the development of an assessment for young languages learners in the context of Japanese as a second language (JSL). In response to the growing number of young JSL

ABSTRACT Young Indigenous students with a language background of emergent, unrecognised, and/or non-prestigious contact languages are commonly by-passed as English language learners (ELLs). Consequently, they are taught and assessed via undifferentiated mainstream pedagogy and testing, generally characterised by reported underachievement. Long-term social and linguistic minoritisation has effectively

ABSTRACT The population of young language minority (LM) students is rapidly growing worldwide due to global migration and immigration trends. The increasing representation of young LM students in school settings creates high demand for the language assessment of LM students in order to meet the needs of stakeholders, such as governments and language programs. This special issue thus focuses on the

(2021). Foreign Language Proficiency in Higher Education. Language Assessment Quarterly: Vol. 18, The quest to maintain language assessment quality during a pandemic: Stories from higher education, pp. 76-79.

ABSTRACT Children with Developmental language disorder (DLD) have particular difficulty learning language despite otherwise general normal development. When school age bilingual children struggle with language, a common question is if the difficulties they present reflect lack of ability or lack of language experience. To address the question of identification of DLD in the context of bilingualism

ABSTRACT Keystroke logs provide a comprehensive record of observable writing processes. Previous studies examining the keystroke logs of young L1 English writers performing experimental writing tasks have identified writing processes features predictive of the quality of responses. Contrarily, large-scale studies on the dynamic and temporal nature of L2 writing process are scarce, especially in an

ABSTRACT This mixed methods study compared IELTS examiners’ scores when assessing spoken performances under live and two ‘non-live’ testing conditions using audio and video recordings. Six IELTS examiners assessed 36 test-takers’ performances under the live, audio, and video rating conditions. Scores in the three rating modes were calibrated using the many-facet Rasch model (MFRM). For all three modes

ABSTRACT It has been over a decade since the International Civil Aviation Organization proposed Language Proficiency Requirements to improve aviation English proficiency and air safety through adequate aviation English tests. Yet, many of the aviation English assessment procedures appear to not meet international professional standards for language tests. As a preliminary synthesis of the target language

ABSTRACT The purpose of the study was to investigate English language teachers’ perceptions of assessment, their language assessment literacy (LAL) levels and their training needs. 113 teachers from Germany and 379 teachers from Greece completed a survey questionnaire. The data were analyzed through a series of RM ANOVAs, correlation analyses, and confirmatory factor analysis. Data from interviews

ABSTRACT Scoring procedures for many rater-mediated performance assessments include score resolution procedures in which a third rater adjudicates discrepancies between two raters’ ratings of the same performance. There are numerous approaches for calculating resolved scores that involve different combinations of the original and third ratings. Using data from two content-area writing assessments,

(2020). The Interface of Teaching, Research, and Professional Service in Language Assessment: An Interview with James E. Purpura. Language Assessment Quarterly: Vol. 17, No. 3, pp. 316-326.

ABSTRACT The Common European Framework of Reference for Languages Companion Volume (CEFR CV) emphasizes macro-functions of language (i.e., reception, production, interaction, and mediation). However, there seems to be little consensus on whether the macro-functions are commensurable with CEFR-based proficiency tests. This paper focuses on the Examination for the Certificate of Competency in English

ABSTRACT The Duolingo English Test (DET) is a computer adaptive test of English proficiency that is increasingly used for English-medium university admissions purposes. During the COVID-19 pandemic of 2020, test centers were shut down in many countries, and major tests including the TOEFL iBT and IELTS could not be administered. The DET is an “at home” test, and thus many universities began accepting

(2020). Automated Speaking Assessment: Using Language Technologies to Score Spontaneous Speech. Language Assessment Quarterly: Vol. 17, No. 3, pp. 327-330.

ABSTRACT This article presents results from a needs analysis survey conducted in the first year of a European-funded project entitled ‘Teachers’ Assessment Literacy Enhancement (TALE)’. The survey questionnaire used asked 1788 learners of English in Cyprus, Germany, Greece and Hungary about their experiences of assessment; which of these they considered conducive to learning and the role feedback played

ABSTRACT We report on a standard-setting project in which the Item-Descriptor-Matching Method (IDM) and a complementary benchmarking approach were employed to align a suite of English language proficiency exams to the Common European Framework of Reference (CEFR), with a particular focus on the integrated and independent writing exams. Judges’ ratings on eight writing tasks and 48 test taker scripts

(2020). Examining Young Learners: Research and Practice in Assessing the English of School-Aged Learners. Language Assessment Quarterly: Vol. 17, No. 3, pp. 331-335.

ABSTRACT This study investigated whether young Korean students learning English as a foreign language (EFL) engage in similar processes when responding to reading comprehension questions delivered in two different test-presentation modes: paper and computer. It examined the relationship between the two modes and test-takers’ reading comprehension strategies, as well as the degree to which the test-takers’

ABSTRACT In the present study, I examined the effects of rater characteristics, in particular, raters’ familiarity with a foreign accent, on the assessment of second language (L2) pronunciation. Forty-three native English-speaking teachers were divided into three groups according to their reported types of familiarity with Korean accents: heritage, familiar, and unfamiliar. The teachers assessed global

(2020). An Interview with Dr. John Read. Language Assessment Quarterly: Vol. 17, No. 2, pp. 204-215.

ABSTRACT Recently, many universities in Vietnam have adopted the TOEIC (Test of English for International Communication) Listening and Reading test as a language exit test for non-English major students. This study aimed at examining the perceived impact of the TOEIC Listening and Reading test on English teaching and the mechanism by which this test impact occurred. The data were collected by means

ABSTRACT This article reports on a study that was carried out to explore the factors that contribute to a negative washback effect on English language teaching (ELT) in secondary schools in Bangladesh. Twelve secondary school teachers were interviewed to understand their perspectives on which factors influenced their pedagogical choices. The interview data were supplemented with secondary material

(2020). Assessing L2 Listening: Moving towards authenticity. Language Assessment Quarterly: Vol. 17, No. 2, pp. 216-220.

ABSTRACT This article presents a critical review of the Texas English Language Proficiency Assessment System (TELPAS), a large scale standardized English language proficiency (ELP) assessment developed by the Texas Education Agency (TEA) and administered since 2004. TELPAS is used as an annual summative assessment for all English Learners (ELs) in grades K-12 and is administrated annually to approximately

ABSTRACT The Common European Framework of Reference (CEFR), with its illustrative scales and salient features of spoken language at the reference levels, is widely used as the base for rating scales for performance testing. If practitioners want to measure and report even small gains in proficiency, they need to adapt the descriptors to their local context and make further subdivisions. However, progression