Reaching a better understanding of the composing process is essential to improving writing assessment practices. This paper reports a remodeling attempt of written text production processes. The author argues for remodeling writers’ cognitive processes through reviewing the changing conceptualizations in six notable global writing process models (Chenoweth and Hayes, 2001, Flower & Hayes, 1981, Hayes

An assumption underlying replacing traditional paper-based (PB) writing tests with computer-based (CB) tests is that CB writing tests are more authentic than PB tests (Lessien, 2013). This study tested this assumption by examining the effect of test mode on the situational and interactive authenticity of English as a second language (ESL) writing assessments using an embedded correlational model of

Teachers are often underprepared to teach writing, which can negatively impact the performance and attitudes of their students. In teacher preparation programs, one goal should be to specifically develop future teachers of writing. Focusing on self-efficacy beliefs, increasing preservice teachers’ confidence and preparedness for teaching writing could yield positive impacts on classroom writing instructional

This study reports on four Korean students’ test preparation practices for the TOEFL iBT Writing section and their perceptions of the effectiveness of direct test preparation in improving their test scores and overall writing skills. In-depth interviews with the participants indicated that it is commonplace among prospective Korean test takers to seek commercialized coaching services from hagwons—private

This study reports on dynamic assessment of young children’s emergent writing in northern Canadian classrooms. The one-on-one assessments consisted of open-ended tasks: drawing a picture and then talking and writing about it. Our team analyzed transcripts of 124 adult-child interactions in terms of the assessment administrator’s prompts and the children’s responses to the prompts. We wanted to understand

EFL methodology has always recognized the importance of giving student learners of foreign languages regular and quick feedback on student production, both written and oral. The presented paper describes the decisions taken during the development of an application to measure text complexity, and shows how the results achieved with this application were translated into feedback related to the author’s

Having rich and complex vocabulary is a crucial component that contributes to the quality of writing for academic purposes. However, use of academic vocabulary can be challenging for adolescent L2 writers who are developing their academic language proficiency. Thus, understanding lexical needs of adolescent L2 students in composing academic essays is pivotal in supporting this population in their endeavor

While research on various aspects of peer review in ESL/EFL writing has been burgeoning in the past two decades, studies comparing the cognitive processes of trained and untrained L2 peer reviewers have been scant. This case study endeavored to address this gap by recruiting ten senior EFL university students and randomly assigning them into trained and untrained groups. While both groups attended

Many studies have focused on discrepancies in scoring writing, focusing on determining rater types, rubrics and their interpretation, and the factors that make a particular paper hard score. This qualitative study attempts to understand sources of discrepancy from the perspective of the raters themselves. Teachers from an English medium university freshmen academic skills programme provided scores

Directed Self-Placement (DSP) is an approach that brings together self-efficacy and course selection to guide enrollment of college students into first-year writing courses. The study in this article emerged in an institutional scenario in which the DSP process at a U.S. university changed from a reading and writing task with reflective questions to reflective questions only. In turn, the scenario

Mastery-based contract grading is a holistic assessment approach for learning and grading in which students choose their desired effort and outcome by contracting for either an A or B to meet high academic standards. This mixed-methods study examined the impact of mastery-based contract grading on secondary students’ (grades 9–12) perceptions of stress and threat appraisal. Participants were 439 adolescents

This argument-based validation research examines the validity of score interpretations on computer-based graphic-prompt writing (GPW) tasks, centering on the explanation inference. The GPW tasks, designed for English placement testing, measure examinees’ ability to incorporate visual graphic information into their writing. Over 100 ESL students, studying at a public university in the United States

Student feedback literacy, which concerns learners’ understanding and evaluation of feedback information and of self-regulated learning, has recently drawn increasing scholarly attention. Although much discussion is directed to the theoretical complexity of feedback literacy in higher education, academic writing on this subject has remained unfocused, and the issues related to feedback literacy are

This study reports on validation of a writing motivation survey and its relationship with a variety of indicators of academic performance of 566 undergraduate students drawn from six US postsecondary institutions. A writing motivation survey was used to capture students’ writing goals, confidence, beliefs, and affect. Two research questions are addressed in the study: 1) What is the internal factor

Existing writing self-efficacy instruments have assessed the concept through mechanical and process features of writing to the neglect of the influence of situated context. The purpose of this study was to develop and test the Situated Academic Writing Self-Efficacy Scale (SAWSES) based on Bandura’s self-efficacy theory and a model of socially constructed writing. A sequential multimethod approach

This study analyzed the impact of contract grading on adolescents’ perceptions of stress amid Good Shepherd High School’s annual research paper unit. While college instructors have employed contract grading since the 1970s, the alternative assessment approach appears underused and under-analyzed in contemporary high school classrooms. In spring 2019, participants (n = 53) enrolled in one of seven senior-level

This study investigated lexical density and diversity differences in English as L1 vs L2 academic writing of EFL, ESL, and English L1 postgraduate students to compare their lexical proficiency in EFL vs. English L1 academic settings. A corpus of 210 dissertation abstracts was analysed using three natural language processing tools [LCA, TAALED, and Coh-Metrix] where the effects of text length and topic

Abstract The application of integrated writing tasks in academic writing assessment is increasing and research on these tasks is growing. However, the role of individual difference variables in students’ performance in source-based writing is under-researched. Thus, the present study purports to investigate the predictive contribution of L2 writing self-efficacy to the summary writing strategies used

Abstract Lexical diversity (LD) is an important feature of a second language (L2) writer’s lexical knowledge, and indices of LD have been widely used in the field of writing assessment (e.g., Cumming et al., 2006 ; Engber, 1995 ). Research with longer native speaker (L1) texts has indicated, however, that many commonly used LD indices are sensitive to text length and may conflate lexical breadth and

Abstract The developmental patterns that learners follow as their language develops in syntactic complexity has gained much attention in L2 writing research recently. This study aims to contribute to the growing body of empirical literature testing the hypothesis that learners move through a set of stages in their use of complex structures for L1 Turkish learners of L2 English (Biber et al., 2011)

Abstract Despite the recent interest in discovering language teacher beliefs in general, L2 writing teachers’ beliefs remain almost an untouched area. Considering this gap, this study aims at developing and validating a sound and comprehensive inventory that can be used for exploring L2 instructors’ beliefs regarding the nature of L2 writing, teaching L2 writing, and assessing L2 writing. To do that

Several studies have explored complexity, accuracy, and fluency (CAF) as an index of language development, as an index of language performance, and as an index of writing quality. Although there have been studies that dealt with complexity measures as an index of proficiency, none so far have examined it in the company of accuracy and fluency as indices of proficiency. Thus, this study investigates

Abstract Internationally trained doctors wishing to register and practise in an English-speaking country typically have to demonstrate that they can communicate effectively in English, including writing proficiency. Various English language proficiency (ELP) tests are available worldwide and are used for such licensing purposes. This means that medical registration bodies face the question of which

Abstract Researchers have recommended involving domain experts in the design of scoring rubrics of language for specific purpose tests by eliciting profession-relevant, indigenous criteria and applying these to test performances (see, e.g., Douglas, 2001; Jacoby, 1998; Pill, 2016). However, these indigenous criteria, derived as they are from people outside the assessment field, may be difficult to

Since the development of cuneiform script in Mesopotamia for keeping tallies of grain and sheep, written language has been used to document workplace transactions as a safeguard against the unreliability of human memory or deceit. Modern workplaces continue this reliance on written language as a means of mitigating the risk that some important aspect of work will be missed, misunderstood, misrepresented

Abstract This review discusses Moodle quizzes and their potential usefulness for formative assessment of academic writing. Moodle quizzes offer a wide variety of possibilities for the development of formative writing assessment. This is due to the impressive repertoire of choices with regard to specific tasks and to quiz design options available in Moodle. The key strength of Moodle quizzes, as used

Abstract Eli Review is a web-based platform that was built by composition faculty for the primary purpose of scaffolding online peer feedback activities. Eli supports a very particular feedback strategy characterized by students completing frequent small writing assignments, participating in regular peer reviewing activities, and using the feedback received to generate revision plans. Faculty focus

Abstract This study examines the extent to which TOEIC Writing test scores relate to an external criterion: evaluations by linguistic laypersons of the functional adequacy of writing in the international workplace. Test-taker responses to two representative tasks from the TOEIC Writing test (e-mail requests, opinion surveys) were adapted for workplace role-play scenarios that laypersons read and evaluated

Abstract The importance of input from occupational experts in defining valid criteria to assess performance on English for specific purposes (ESP) tests is widely acknowledged. However, few studies have described the process of collecting indigenous criteria and establishing their suitability for a language testing context. The paper reports on this process with specific reference to the writing sub-test

Abstract Unlike general language tests, specific-purpose tests have a greater need for updating should there be changes to context-specific language use. With near continuous inflow of migrant healthcare workers and long-standing language testing practices, the healthcare domain represents a good context for investigating the relationship between changes in the English language assessment standards

Abstract While contemplating a new online assessment framework for global corporations in Turkey, developers faced the dilemma of how to create a modern English for Specific Purpose (ESP) writing proficiency assessment. The result was the Communicative English Proficiency Assessment (CEPA)® Written Communication Assessment™, a computer-based, criterion-referenced proficiency test. In its creation,

Abstract Variable achievements are not only common in students’ writing but pose challenges for teachers seeking to acknowledge these and foster next steps in literacy teaching. If teachers are to ‘lead development’ (Vygotsky, 1978), they need knowledge about how different text types function and what progression in learning to compose these looks like. Drawing on data from a large research project

Abstract The current study aims to explore the development of research on feedback scope in written corrective feedback (WCF), identify unresolved issues concerning feedback scope, and offer recommendations for further research in this domain. To achieve these purposes, we synthesize a total of 59 relevant articles and examine the salient findings on four dimensions: (1) effectiveness of comprehensive

Abstract Many L2 learners demonstrate low motivation when it comes to developing higher competencies in writing. In this study, we propose that by engaging L2 students and their teachers in collaborative co-construction of writing rubrics, students develop better understanding and awareness of writing criteria, thus demonstrating ownership and responsibility for enhancing their writing competency.

Abstract Academic writing ability is an important aspect of success in higher education. Recently, standardized academic language proficiency tests (such as the TOEFL) have begun to include integrated writing tasks, which ask test-takers to read and/or listen to a passage and construct a response that reflects the information in the passage(s). Arguably, integrated tasks more closely resemble authentic

Abstract We propose an alternative to student evaluations of teachers (SETs), arguing that writing programs can use the SET moment to share responsibility for students’ expectations and course experiences. We argue studying students’ perceptions can help writing programs generate research for localizing engagement and aiding professional development. We study the perceived helpfulness of first-year

Abstract The present study examines adolescent and adult English-as-Foreign-Language (EFL) Learners’ linguistic complexity and register flexibility in writing across academic and colloquial contexts. A total of 263 EFL learners from three first language (L1) backgrounds (Chinese, French, and Spanish) participated in this study. Each participant produced two written texts on the same topic: a personal

Abstract To ensure valid measurement in large-scale assessments, avoiding incorporating construct-irrelevant aspects is crucial. We investigated a potential source of construct-irrelevant variance, i.e. the presentation mode of essays (handwritten vs. computer-typed) and its influence on scoring. Further, we investigated whether the presentation-mode effect is moderated by text quality and legibility

Abstract In practices of direct assessment of writing ability, the variability of human decision-making during scoring poses great challenges to the validity of assessment (Kane, 2006). The variables causing differences in individual raters’ scoring interpretations have been widely investigated (e.g. Eckes, 2012; Wolfe et al., 2016). However, the issue of how raters negotiate to resolve discrepancies

Abstract Despite the increased use of automated writing evaluation (AWE) systems and similar programs for assessment purposes in second language (L2) writing classrooms, research on student engagement with automated feedback is scarce. This naturalistic case study explored two ESL college students’ engagement with automated written corrective feedback (AWCF) provided by Grammarly when revising a final

Abstract We investigate students’ implementation of the feedback messages they received in an automated writing evaluation system (eRevise) that aims to improve students’ use of text evidence in their writing. Seven 5th and 6th-grade teachers implemented eRevise (n = 143 students). Qualitative analysis of students’ essays across first and second drafts suggests that the majority of students made changes

Abstract Writing in L2 is a complex phenomenon in which affective factors play an important role. Among others, demotivation can determine the students’ success in orchestrating the complex writing processes and the quality of their L2 writing texts. Although there is a growing body of research investigating demotivating factors (e.g. teacher, self-confidence, materials and methods) in language education

Abstract Many language course providers face the challenge to align internal, often intuitive assessments to internationally recognised proficiency frameworks for accountability reasons. We report a development and validation project for assessing writing in a university languages centre, where an intuitive, achievement-oriented grading system was aligned to the proficiency levels of the CEFR. We took

Abstract The authors discovered a number of minor inaccuracies on pp. 58–59 of this article. However, they do not affect any of the main claims regarding the influence of lexical features on text assessment made in that study. In this note, we provide a corrected proof of the inaccuracies (marked in bold). The authors would like to apologize for any inconvenience caused.

Abstract Analytic rubrics for writing assessments are intended to provide diagnostic information regarding students’ strengths and weaknesses related to several domains, such as the meaning and mechanics of their composition. Although individual domains refer to unique aspects of student writing, the same rating scales are often applied across different domains. Accordingly, the interpretation of rating

Abstract English writing is a key competence for higher education success. However, research on the assessment of writing skills in English as a foreign language in European upper secondary education (i.e. beyond year 9) remains scarce. The Common European Framework of Reference (CEFR) describes language proficiency on a scale of six ascending levels (A1-C2). For writing skills at the end of secondary

Abstract Using content analysis, this review study examines 219 empirical research articles published in Assessing Writing (2000–2018) to give a view of the development of writing assessment over the past 25 years. It reports overall and periodic analyses (2000–2009 and 2010–2018) of the contextual, theoretical, and methodological orientations of those articles to gain a comprehensive understanding

Abstract When Assessing Writing (ASW) was founded 25 years ago, conversations about fairness were very much in the air and illustrated sharp divides between teachers and educational measurement researchers. For teachers, fairness was typically associated with consistency and access. For educational measurement researchers, fairness was a technical issue: an assessment that did not identify the presence

Abstract This reflective essay provides a narrative analysis of the author’s perceptions of US writing assessment over the past twenty-five years. Reflections are provided on four communities involved in the instruction and assessment of writing: teachers, researchers, testing organizations, and students. The essay concludes with an identification of trends in reconciling the goals of these four assessment

Abstract Motivational variables significantly influence learners’ writing experiences and performance. Diagnosing learners’ affective perceptions and beliefs using accurate measures is a prerequisite for identifying the optimal ways for motivating them to write. Though writing motivation has been researched for more than four decades, some issues in defining and assessing its constructs are yet to

Abstract “Writing” is far from the only construct relevant to writing assessment research. The construct “race” is arguably crucial for the field’s considerations of human diversity, difference, and inequity. To examine how race has been constructed within the field, this paper provides a content analysis of explicit race talk in Assessing Writing (1994–2018). Drawing on insights from critical race

Abstract The study presents an attempt to explore the impact of source characteristics on task comparability in integrated writing tasks. To this end, two read-listen-write tasks of TOEFL iBT were selected to differ in topic, structural organization, and lexical and conceptual overlap, suggested to be significant in affecting summary quality ( Cho, Rijmen, & Novak, 2013 ; Li, 2014 ; Yu, 2009 ). The

Abstract This study adopts a mixed-methods design and examines the relation between English proficiency and peer feedback performance. Data sources included peer feedback made by 23 lower English proficiency (LEP) students and 23 higher English proficiency (HEP) students, and semi-structured interviews with four LEP and four HEP students from that sample. Quantitative analysis did not find significant

Abstract The College Board’s ACCUPLACER Automated Writing Placement Tool is administered more than 8.5 million times each year to place students into college-level or developmental writing courses. ACCUPLACER’s writing assessment consists of a multiple-choice Next-Generation Writing Test and an on-demand essay called WritePlacer. In this review, we offer an overview of ACCUPLACER, considering the test

Abstract This review of the University of Utah’s Writing Placement exam evaluates the possibilities of the exam’s construct, addresses the tool's limitations, and analyzes it in light of similar placement tools. The review concludes that although there are challenges specifically related to the scalability, security, and language ideology of the exam, its holistic nature, local assessors, and process-oriented

Abstract This study adopts a novel approach to investigate perceptions of assessment criteria relevance in differentiating writing performance levels. Experienced writing assessors were asked to directly compare pairs of performances. For each comparison, assessors were asked to determine which performance was better and to record which aspects of writing were used to make determinations. To do so

Abstract This review describes in brief the writing sub-sections of the internet-based Test of English as a Foreign Language (TOEFL) and discusses its use in university admissions decisions and potential use as a tool for course placement. The primary purpose of the TOEFL is to measure the academic English proficiency of non-native English speakers seeking admission to English- medium universities

Abstract The Smarter Balanced grade 11 summative assessment is a career and college readiness assessment aligned with the Common Core State Standards. In addition to its use as a measure in the high school, over 200 colleges and universities in 10 states use the results of this assessment as part of a multiple measures approach for placement in writing and mathematics. Our focus in this review is on

Abstract This review examines directed self-placement, a placement tool that provides students with information about curricular options and asks each student to self-select into any first-year writing course. Specific constructs of a given directed self-placement approach vary from institution to institution; in this review we work to synthesize a diverse range of available scholarship to describe

Abstract Assessment is an under-researched challenge of writing development, instruction, and teacher preparation. One reason for the lack of research on writing assessment in teacher preparation is that writing achievement is multi-faceted and difficult to measure consistently. Additionally, research has reported that teacher educators and preservice teaches may have limited assessment literacy knowledge