Assessing Language or Content? A comparative study of the assessment practices in three Swedish upper secondary CLIL schools

Helena Reierstam

Abstract:Title: Assessing Language or Content? A comparative study of the assessment practices in three Swedish upper secondary CLIL schools. Author: Helena Reierstam Language: English with a Swedish summary GUPEA: http://hdl.handle.net

Psychology,Education,Linguistics

What problem does this paper attempt to address?

Investigating Content and Language Integrated Learning Insights from Swedish High Schools

Li Xia,Jinfen Xu

DOI: https://doi.org/10.1080/13670050.2019.1648380

2019-01-01

International Journal of Bilingual Education and Bilingualism

Abstract:Content and Language Integrated Learning (CLIL), introduced in the 1990s, has been gaining considerable ground across the globe in recent years. With this as a backdrop, Liss Kerstin Sylven provide...
Cross-curricular CLIL projects in Swedish middle school

Eva Olsson,Liss Kerstin Sylvén

DOI: https://doi.org/10.46364/njltl.v11i2.1181

2024-01-28

Nordic Journal of Language Teaching and Learning

Abstract:In this article, we report and discuss findings from a case-study of cross-curricular CLIL implementation involving English and home economics at a Swedish middle school. The objective was to study teaching strategies for supporting students’ integrated development of content and language knowledge in practical school subjects and to explore the role of the majority language in the CLIL classroom. The study is theoretically grounded in the perspective of languages as being socially constructed (Lantolf, 2000; Lantolf & Thorne, 2006). The focus of the analysis is the role of scaffolding (Walqui, 2006) in CLIL. Data consist of field notes and teaching materials from lesson observations as well as teachers’ plans and evaluations of the CLIL theme. Findings show that practical subjects, such as home economics, offer ample opportunities for visual scaffolding, and that the content is concrete and often close to students’ everyday life. Further, the content of the English lessons becomes highly relevant for the students as it will be used in an authentic situation, i.e. in home economics class. With careful planning, including strategies for scaffolding, and cooperation among teachers, cross-curricular CLIL themesinvolving a practical subject seem highly suitable for CLIL among young learners.
Comparing language ideology, policy and pedagogy – implications for student outcomes in CLIL and immigrant education

Helena Reierstam

DOI: https://doi.org/10.46364/njltl.v11i2.1153

2023-12-31

Nordic Journal of Language Teaching and Learning

Abstract:As linguistic diversity is increasing in many classrooms, teachers across disciplines and educational levels are more often faced with students of different language backgrounds and needs. Concomitant with educational initiatives to develop students’ foreign language skills and multilingual repertoires, urgent needs to fast forward immigrant students’ proficiency in the language of instruction are calling for the attention of educators and policy makers. By comparing and contrasting educational contexts involving content and language integrated learning (CLIL) and mainstream education of newly arrived immigrant students (NAS), this article seeks to bring language policy and its underlying ontology to the fore, highlighting its implications for pedagogy and educational outcomes, as well as for individual students and society. The focus is on the role of language in relation to content, hence a discussion on different variants of language integrated approaches, i.e. CLIL, English medium instruction (EMI) and immersion, to see how the education of immigrants relate to those. The article lends examples from a Swedish comparative research study on teachers’ experiences with language learners in CLIL and among NAS. The contexts differ in some respects, but as this text will argue, the questions of shared character and interest are many, some of which refer to matters of fairness and comparability in education. Teachers in both contexts are struggling with how to handle limitations in students’ academic language skills and students not learning disciplinary content with the same depth and complexity as they might have done if the students had been using their first language, issues which are emphasized in assessment. At the same time as curricula and assessment imply standardized learning outcomes and target language, current discourse advocates translanguaging, leaving many teachers disillusioned as they find incompatibility between students’ flexible use of their linguistic resources and standardized assessment expectations.
Research on foreign language learning, teaching, and assessment in Sweden 2012–2021

Camilla Bardel,Henrik Gyllstad,Jörgen Tholin

DOI: https://doi.org/10.1017/s0261444823000022

2023-03-23

Language Teaching

Abstract:This review provides an account of salient research topics in current Swedish research in the field of foreign language (FL) education, with the aim of making locally published work available outside Sweden. A corpus of work on English and other FLs published between 2012 and 2021 has been scrutinized. Focus has been placed on research conducted and disseminated in Sweden, in some cases adding international publications, in order to portray the work in a wider context. Research on FL learning, teaching, and assessment is reviewed in light of recent policy changes as well as a changing linguistic situation characterized by a plethora of languages spoken in society, among which Swedish as majority language and English as lingua franca share indisputable sovereignty, but where a newly-born interest in the role of other background languages than Swedish can be discerned. The study ends with a discussion of trends observed in the reviewed material and considerations in view of future research.

education & educational research,linguistics
Assessment instruments for primary CLIL: the conceptualisation and evaluation of test tasks

Ute Massler,Daniel Stotz,Claudia Queisser

DOI: https://doi.org/10.1080/09571736.2014.891371

2014-03-28

Abstract:This article explores ways in which learners' achievements can be assessed and reflected in both the domains of linguistic performance and subject-content learning. The content and language integrated learning (CLIL) approach adopted by the authors is one in which language learning and content learning are truly integrated and where neither dominates the other. Due to the dual focus on language and content, CLIL assessment needs to account for the goals and objectives of two different subjects, including knowledge, competences, skills, attitudes and discourse practices, for both language and content. The CLILA project (CLIL Learner Assessment) has developed an enquiry and assessment tool to measure primary school pupils' content and foreign language ability in CLIL lessons. The tool is based on: (1) the Common European Framework of Reference and the lingualevel model; (2) the description of competences in the subject content areas; and (3) the curricula of the subjects involved with their thematic categories. With the help of CLIL teachers, descriptors, evaluation scales and examples of assessment tasks were developed and tested in several classrooms. The article outlines the theoretical background of the assessment tool and reports on the development and improvement of the assessment materials during the trial phase.
Teaching Summative Assessment: A Curriculum Analysis of Pre-Service Language Teacher Education in Sweden and Finland

Ali Yildirim,Anne Dragemark Oscarson,Raili Hilden,Birgitta Fröjdendahl

DOI: https://doi.org/10.1177/00224871231214799

2023-12-08

Journal of Teacher Education

Abstract:Journal of Teacher Education, Ahead of Print. The purpose of this study is to investigate the curricular manifestation of summative assessment literacy in language pre-service teacher education at three universities in Sweden and Finland through multiple case studies. Data sources included program guidelines, course curricula, and study guides. A thematic approach was used to analyze the data based on a theoretical framework involving conceptual understandings, skills, and dispositions in summative assessment. The results indicate that all programs emphasize the basic assessment concepts such as validity and alignment and using assessment to inform teaching and learning. However, compared with formative assessment, summative assessment receives less attention in the curriculum. There are differences in addressing summative assessment through stand-alone and embedded courses and in the literacy areas covered. Implications for teacher education to address summative aspects of assessment in line with teachers' tasks in schools are offered.

education & educational research
Swedish immersion in Finland and Swedish as a second-language subject in Sweden

Christina Hedman,Ulrika Magnusson

DOI: https://doi.org/10.1075/jicb.21032.hed

2023-09-12

Journal of Immersion and Content-Based Language Education

Abstract:Abstract Based on fieldwork and interviews, we explore five teachers’ views about their teaching of Swedish as a second language in an early immersion school in Finland (Larch) and a linguistically heterogeneous primary school in Sweden (Chestnut). Drawing from ecological perspectives, we aim to contribute new knowledge on how second language teachers express their goals, teacher experiences and expertise depending on language and education policy as discursive-material reality. We discuss how societal, discursive and material differences were entangled with the teachers’ discourses, for example, the fact that Swedish immersion at Larch enjoyed a higher social status than Swedish as a second language at Chestnut. Concomitantly, the teachers adhered to pedagogical principles and the value of students’ linguistic and cultural repertoires in similar ways. We specifically discuss teacher autonomy as entwined with prevailing discursive-material realities, including distinct language education policies.

English Else
Linguistic Benefits of the CLIL Approach : Measuring Linguistic Competences

Anna Várkuti

Abstract:This empirical study compares two forms of language learning in Hungary by exploring English language achievement of CLIL secondary school students and those of non-CLIL intensive foreign language learners acting as a control group. The students took the same tests designed to measure conversational and academic language use (BICS and CALP). Data analyses prove that the social and academic language competence of the CLIL students is of a higher level than that of the control group. The CLIL students have significantly better skills in applying their broader lexical knowledge in various context-embedded conversational situations, as well as in taking into account grammar rules, text coherence and sociolinguistic context. In the case of cognitively more demanding academic language proficiency, the CLIL students do significantly better than the control group students with context deprived test problems which demand more subtle meanings, more sophisticated grammar and higher meta-linguistic awareness. The conclusion is that using English as a medium for learning various subjects is a more efficient route in providing functional language proficiency than traditional foreign language learning.

Linguistics
The effect of content and language integrated learning on students' English and history competences – Killing two birds with one stone?

Sara Dallinger,Kathrin Jonkmann,Jan Hollm,Christiane Fiege

DOI: https://doi.org/10.1016/j.learninstruc.2015.09.003

IF: 6.636

2016-02-01

Learning and Instruction

Abstract:By failing to appropriately control for selection effects, most previous research has overestimated the effects of Content and Language Integrated Learning (CLIL) on the development of students' foreign language skills. Furthermore, the CLIL-effect on the content subject is still widely unknown. Therefore, the present study investigated skill development of 1806 German CLIL and non-CLIL eighth-graders in English and History controlling for a wide range of student, classroom and teacher characteristics. Results of multilevel modelling confirmed that CLIL-classrooms showed greater increases in English listening comprehension but not general English skills as measured by a C-test than non-CLIL-classrooms. In History, the increases in subject knowledge over one school year were comparable despite CLIL-students' larger amount of instruction (three instead of two hours per week). The results confirm previous, differential findings for English. For the content subject, they indicate that CLIL-classrooms need to invest substantially more time to achieve comparable learning outcomes.

education & educational research,psychology, educational
Assessment in CLIL: Test development for content and language for teaching natural science in English as a foreign language

J. P. Leal

DOI: https://doi.org/10.5294/LACLIL.2016.9.2.3

2016-11-23

Abstract:On-going bilingual programs without regard to needs analysis; little research on the actual effects of CLIL in Colombia and vague awareness or knowledge about the necessary considerations for effective CLIL programs, underpin the need to address a particular issue of curriculum as it is summative assessment. This small scale study takes place in a Natural Science class using a CLIL approach with thirdgrade students at A2 proficiency level who have been progressively immersed in a bilingual program at a private school in Bogota, Colombia. Regularly scheduled tests were analyzed in order to identify suitable assessment items hat simultaneously report on the content and language achievement in order to provide guidelines for test development that are aligned with the teaching goals, consistently measure students’ progress, and facilitate teaching practices. This study entails a systematic examination of test items using formal item analysis to depict test validity from an assessment grid that integrates content, at different knowledge levels, CALP functions and cognitive skills. The study concludes that the assessment grid is a helpful tool to discriminate language and content achievement in the results of multiple-choice CLIL tests, by increasing teachers’ understanding of the language demands of test items and the level of difficulty of content tasks. doi: 10.5294/laclil.2016.9.2.3

Psychology,Education,Linguistics
Characterizing CLIL teaching: new insights from a lower secondary classroom

Karina Rose Mahan,Lisbeth M. Brevik,Marianne Ødegaard

DOI: https://doi.org/10.1080/13670050.2018.1472206

2018-05-12

International Journal of Bilingual Education and Bilingualism

Abstract:As a bilingual teaching method, Content and Language Integrated Learning (CLIL) is growing in popularity in Europe and research has primarily focused on (language) learning outcomes. Few studies have identified what characterizes teaching in the CLIL classroom in terms of content and language integration. Studying how CLIL is practiced is vital to understanding how it works and how students can benefit from it. In this study, we filmed and observed CLIL lessons in science and mathematics in a 9th grade, Norwegian CLIL class offering subjects in English. The present study uses The Protocol for Language Arts Teaching Observation (PLATO) to analyze video-recordings of CLIL lessons in science and mathematics, emphasizing a within-CLIL focus, and compared this with the English language teaching in the same class, as a baseline. Our findings indicate content-driven and intellectually challenging CLIL teaching with clear instructional explanations and systematic language support. English was used as frequently in the CLIL teaching as in the English teaching. Content and language were clearly integrated in the observed CLIL lessons, underscoring that the CLIL teachers successfully conveyed their subject in the target language.

education & educational research,linguistics
Assessing Content in a Curriculum-based EFL Oral Exam: The Importance of Higher-order Thinking Skills

Henrik Bøhn

DOI: https://doi.org/10.17507/jltr.0901.03

2018-01-01

Journal of Language Teaching and Research

Abstract:In this study data from verbal protocols and semi-structured interviews was analysed to explore Norwegian EFL teacher raters’ (n=10) orientations towards content in an oral English exam at the upper secondary school level, a context characterized by the absence of a common rating scale for the teacher raters. The content construct was mainly analysed in terms a subject matter dimension and a skills and processes dimension. The results indicated that the teachers were more concerned with the skills and processes dimension (e.g. analysis, reflection) than with the subject matter dimension (e.g. cultural knowledge). Moreover, their understanding of subject matter compared fairly well with the subject curriculum, despite instances of construct underrepresentation. The study points to the prominence of guidance for teacher raters in the assessment of content and to the significance of alerting students to the importance of higher-order thinking skills in language education at this level.

English Else
The concept of language in the Swedish preschool curriculum: A theoretical and empirical examination of its productions

Lena Aronsson

DOI: https://doi.org/10.1177/1468798419896059

2019-12-30

Journal of Early Childhood Literacy

Abstract:Children’s language development is a core task in Swedish preschool and central to how educators organize teaching and everyday activities. The curriculum’s definition of language is described as extended, with language as both a prerequisite for learning and a learning effect, i.e. both internal processes and communication. This means that working methods and didactic strategies rely on many different epistemologies and thus different theoretical perspectives. Nevertheless, the research literature, as well as assessments of Swedish preschool services, show that educators’ interpretation of the curriculum is primarily socioculturally oriented. This does not entirely converge with how language is conceptualized in the Swedish preschool curriculum. Against this background, the aim of this paper is to perform a theoretical and empirical investigation of the extended language concept in the curriculum with the intention to understand what the consequences of this extended meaning of language produce in terms of teaching and learning practices. I have traced various epistemologies in language didactic preschool research and related this tracing analysis to empirical examples from preschool practices. The results of my analysis show that the practices are predominantly interpersonally framed, which corresponds to the emphasis in research. In a further analysis, where empirical examples are read from other possible epistemologies, the practices can be perceived as being multi-epistemological in a fashion which corresponds to the curriculum's conceptualization of language. This is discussed as an opportunity for a didactic strengthening of presently neglected perspectives.

education & educational research
Approaches and educational assessments of children’s speech, language and communication development in Swedish preschools

Ann Nordberg,Katharina Jacobsson

DOI: https://doi.org/10.1080/03004430.2019.1697693

2019-12-05

Early Child Development and Care

Abstract:This study aimed to investigate how 33 preschool teachers' and 30 special educational needs teachers in Swedish preschools documented and described children's speech, language and communication development. The views on concepts as 'scientific basis', 'proven experience' and ways to follow language development for children in need of extra-support were examined. A questionnaire, including open and closed questions on teachers' work in the preschool practice, provided quantitative and qualitative data. Thus, a mixed method of triangulation was applied with concurrent data collection and analysis. The following themes emerged through the analysis: 'Reflected', 'Unreflected', 'Trust/rely on employer', 'Uncertain' and 'Conviction'. There were various systematic ways to follow the language development of children in need of extra-support. This indicates challenges for preschool professions, as the understanding of the meaning of important concepts varied which entails difficulties trying to work in the preschool practice based on these concepts.

education & educational research,psychology, developmental
Assessing Spoken EFL Without a Common Rating Scale

Henrik Bøhn

DOI: https://doi.org/10.1177/2158244015621956

IF: 2.032

2015-10-01

SAGE Open

Abstract:This study investigated teacher cognition and behavior in a high-stakes, English as a Foreign Language (EFL) school context where no common rating scale exists. 24 EFL teachers at the upper secondary level in Norway were asked to rate the performance of a student taking her oral English exam and to give an account of what kind of performance aspects they pay attention to in the rating process. The study showed that while the raters had the same general ideas of the constructs to be assessed, there were differences in how they perceived the relative importance of these constructs, particularly as regards topical knowledge. The study has implications for language teaching and assessment practices at the intermediate to upper-intermediate levels (Common European Framework of Reference, level B1/B2), particularly with regard to the role of topical knowledge.

social sciences, interdisciplinary
Analysing students’ content-learning in science in CLIL vs. non-CLIL programmes: empirical evidence from Spain

Javier Fernández-Sanjurjo,Alberto Fernández-Costales,José Miguel Arias Blanco

DOI: https://doi.org/10.1080/13670050.2017.1294142

2017-02-24

International Journal of Bilingual Education and Bilingualism

Abstract:This paper investigates students’ performance in content-subjects in the framework of CLIL programmes in Spain. So far, CLIL research has focused primarily on language attainment in the L2 and the L1, but students’ achievements as regards content-subjects have been largely ignored. Competence in Science in the L1 is analysed by comparing pupils enrolled in mainstream schools with students in the so-called ‘bilingual streams’ offering CLIL-based approaches. The main objective is to assess if students learning Science through the L2 (English) outperform their counterparts studying in the L1 (Spanish) as regards content acquisition. The paper analyses a sample of 709 6th grade Primary Education students enrolled in public schools in the Principality of Asturias (Spain). A test to assess students’ knowledge in Science and a context questionnaire (measuring participants’ socio-economic status) were designed. The main finding is that students learning contents in their L1 perform slightly better than those studying Science through the L2. Furthermore, participants with lower socio-economic status obtain lower scores than those coming from more privileged backgrounds.

education & educational research,linguistics
Students’ content learning in Science in CLIL vs non-CLIL classes in Greece

Marina Mattheoudakis

DOI: https://doi.org/10.46364/njltl.v11i2.1189

2024-01-31

Nordic Journal of Language Teaching and Learning

Abstract:The recent introduction of CLIL instruction in some Greek state schools has given rise to concerns voiced by parents – and sometimes educators as well – regarding students’ ability to learn content in or through an L2. The fear is that students’ low proficiency in L2 will inhibit full understanding of the content and eventually will impact negatively on subject competence. Although there are several studies in the impact of various types of bilingual education programs on students’ L2 development, research in their impact on content learning is scarce (see Murphy et al., 2020). Our study aims to contribute to this research by examining 3rd grade students’ performance in Science when this is taught through English as L2. The main objective is to assess if students learning Science through the L2 (English) will outperform their peers studying the same content in Greek (L1) as regards content acquision. The participants of this study are 90 pupils in grade 3 – 46 CLIL students and 44 non CLIL students. Two Science tests are used to assess students’ performance and the two cohorts are compared on the basis of their scores in those tests. The main finding is quite encouraging for parents and educators alike, as the two cohorts’ performance is very similar in both tests; this indicates that CLIL instruction does not impact negatively on students’ content acquisition and that CLIL programs can support not only L2 instruction but also content knowledge.
Language assessment in EMI: unravelling the implicit-explicit dichotomy

Michela Gronchi

DOI: https://doi.org/10.1515/eduling-2023-0011

2023-12-06

Educational Linguistics

Abstract:Abstract English Medium Instruction (EMI) is a content-focused approach in which language learning seems to have been sidelined. However, there appear to be some inconsistencies between EMI language objectives and actual practices that are reflected in the assessment phase. The literature has revealed that an implicit-explicit dichotomy is being used to explain the role of language in EMI; here explicit refers to the declared language outcomes as opposed to implicit , meaning implied but not stated. In this study, the description of a Linguistics course taught through the medium of English, the final assignment and its evaluative rubric are critically examined. The overall aim is to discuss discrepancies between language objectives and language assessment and identify a theoretical framework that could explain the implicit-explicit dichotomy in EMI. The present study raises the possibility that the discrepancies between language objectives and assessment criteria could be described in terms of teacher practices and beliefs that diverge from the declared language policy. Findings further indicate that the implicit-explicit dichotomy depends on academic literacies constructs, which have implications for the students’ development of linguistic tacit knowledge, which is learnt experientially but cannot be easily codified.
Conceptualising Assessment and Learning in the CLIL Context. An Introduction

Dmitri Leontjev,Mark deBoer

DOI: https://doi.org/10.1007/978-3-030-54128-6_1

2020-01-01

Abstract:Multiple CLIL writers (e.g. Ball et al. 2015) have emphasised the significant role of assessment in promoting learning in CLIL classrooms, where there is a dual focus on learning content and language (Genesee and Hamayan 2016). Because of this dual focus, the assessment process in CLIL becomes more complex. Assessment in CLIL should provide insights into learner content and linguistic knowledge as well as strategies used to learn both content and language in order to identify student progress and needs. This should inform both teachers and students about how to enhance learning. Despite excellent overviews, guidelines, and practical activities in CLIL assessment (Lin 2016; Mehisto and Ting 2017; Quartapelle 2012), teachers express concerns about adopting new assessment practices, principles, and techniques and are underusing the potential to support learning (deLuca and Bellara 2013; Hill 2017a; Tsagari and Vogt 2017).
Beyond Language Scores: How Language Exposure Informs Assessment of Nonword Repetition, Vocabulary and Narrative Macrostructure in Bilingual Turkish/Swedish Children with and without Developmental Language Disorder

Linnéa Öberg,Ute Bohnacker

DOI: https://doi.org/10.3390/children11060704

2024-06-07

Abstract:As in many other countries, baseline data concerning the linguistic development of bilingual children in Sweden are lacking, and suitable methods for identifying developmental language disorder (DLD) in bilinguals are lacking as well. This study presents reference data from 108 typically developing (TD) Turkish/Swedish-speaking children aged 4;0-8;1, for a range of language tasks developed specifically for the assessment of bilinguals (LITMUS test battery, COST Action IS0804). We report on different types of nonword repetition (NWR) tasks (language-specific and language-independent), receptive and expressive vocabulary (Cross-Linguistic Lexical Tasks, CLTs), and narrative macrostructure comprehension and production (Multilingual Assessment Instrument for Narratives, MAIN) in Turkish, the children's home language, and in Swedish, the language of schooling and society. Performance was investigated in relation to age, language exposure, type of task, and (for NWR and narratives) vocabulary size. There was a positive development with age for all tasks, but effects of language exposure and vocabulary size differed between tasks. Six bilingual Turkish/Swedish children with DLD were individually compared to the TD children. TD/DLD performance overlapped substantially, particularly for NWR, and more so for the production than the comprehension tasks. Surprisingly, the discriminatory potential was poor for both language-specific and language-independent NWR. DLD case studies underscored the importance of interpreting language scores in relation to exposure history, and the need for an increased emphasis on functional language skills as reported by parents and teachers when assessing and diagnosing DLD in bilinguals.

Assessing Language or Content? A comparative study of the assessment practices in three Swedish upper secondary CLIL schools

Investigating Content and Language Integrated Learning Insights from Swedish High Schools

Cross-curricular CLIL projects in Swedish middle school

Comparing language ideology, policy and pedagogy – implications for student outcomes in CLIL and immigrant education

Research on foreign language learning, teaching, and assessment in Sweden 2012–2021

Assessment instruments for primary CLIL: the conceptualisation and evaluation of test tasks

Teaching Summative Assessment: A Curriculum Analysis of Pre-Service Language Teacher Education in Sweden and Finland

Swedish immersion in Finland and Swedish as a second-language subject in Sweden

Linguistic Benefits of the CLIL Approach : Measuring Linguistic Competences

The effect of content and language integrated learning on students' English and history competences – Killing two birds with one stone?

Assessment in CLIL: Test development for content and language for teaching natural science in English as a foreign language

Characterizing CLIL teaching: new insights from a lower secondary classroom

Assessing Content in a Curriculum-based EFL Oral Exam: The Importance of Higher-order Thinking Skills

The concept of language in the Swedish preschool curriculum: A theoretical and empirical examination of its productions

Approaches and educational assessments of children’s speech, language and communication development in Swedish preschools

Assessing Spoken EFL Without a Common Rating Scale

Analysing students’ content-learning in science in CLIL vs. non-CLIL programmes: empirical evidence from Spain

Students’ content learning in Science in CLIL vs non-CLIL classes in Greece

Language assessment in EMI: unravelling the implicit-explicit dichotomy

Conceptualising Assessment and Learning in the CLIL Context. An Introduction

Beyond Language Scores: How Language Exposure Informs Assessment of Nonword Repetition, Vocabulary and Narrative Macrostructure in Bilingual Turkish/Swedish Children with and without Developmental Language Disorder