Abstract:Interest in integrated tasks is increasing in second language writing, accompanied by a concern for appropriate interpretation of performances and scores from these tasks. Integrated writing adds an element not found in traditional independent writing: the use of source text material. This study investigates how source text use appears in performances on an integrated writing task, and how it differs across score levels and task topics. Educational Testing Service (ETS) supplied 480 performances on the writing section of the Internet-based Test of English as a Foreign Language (TOEFL iBT) to explore these questions. The integrated TOEFL task involves a comparative summary of listening and reading texts that present differing views on a topic. In this study, multiple regression analysis was used to consider three areas of source text use: (1) the importance of source text ideas that writers included in their summary, (2) the use of ideas from a reading source text and from a listening text, and (3) the borrowing of exact wording from the source texts (verbatim source use). These three areas were analyzed across nine score levels and indicated that score and source use are related. Overall, these features of source text use explained over 50% of the variance in scores on the reading–listening–writing task. The use of the listening text and the inclusion of important ideas from source texts explained the most variance, while use of the reading text and verbatim source use were less predictive. The latter two held a negative correlation with score, indicating that the lower scoring essays had more of these features. These findings support the claim that integrated writing assessment elicits academic writing processes, which is reflected by score. High-scoring writers selected important ideas from the source texts and used the listening text as the task prompt instructed. Low scoring writers depended heavily on the reading texts for content and direct copying of words and phrases. These findings support the validity of interpreting integrated task scores as a measure of academic writing but provide a nuanced look at the contribution of certain source use features.

Text Cohesion and Prediction of General Proficiency in Reading-Writing Integrated Tasks

Automated speech scoring of dialogue response by Japanese learners of English as a foreign language

Applying Large Language Models for Automated Essay Scoring for Non-Native Japanese

Using multiple texts in an integrated writing assessment: Source text use as a predictor of score

Syntactic Complexity Development in the Writings of EFL Learners: Insights from a Dependency Syntactically-Annotated Corpus

Holistic and Analytic Assessments of the TOEFL iBT® Integrated Writing Task

Assessing Cohesion In Integrated Writing: An Interactive Alignment Perspective

The Influence of EFL Proficiency on Written Products in Independent and Integrated Writing Tasks

Natural language processing in an intelligent writing strategy tutoring system

What accounts for integrated reading-to-write task scores?

The relationship between written discourse features and integrated listening-to-write scores for adolescent English language learners

Toward a Transparent Construct of Reading-to-Write Tasks: The Interface Between Discourse Features and Proficiency

A Computer-Assisted Tool for Automatically Measuring Non-Native Japanese Oral Proficiency

Assessing Students’ Use of Evidence and Organization in Response-to-Text Writing: Using Natural Language Processing for Rubric-Based Automated Scoring

Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension

Linguistic Features Distinguishing Students' Writing Ability Aligned with CEFR Levels

Dependency Distance Measures in Assessing L2 Writing Proficiency

English Language Proficiency Analysis and Prediction using Deep Learning Algorithms

Exploring the relationship of organization and connection with scores in integrated writing assessment

The Role of Task Types and Reading Proficiency on Young English as a Foreign Language Learners' Writing Performances

Exploring and modeling the reading-writing connection in EFL integrated writing