Putting Tests to the Test

Ming Liu,Victoria C. Yan,Bin Xu,Zhaohui

2005-01-01

Abstract:Tests are usually a big part of a teacher's life. They are part of the ritual of the classroom. Students expect them. Administrators, school boards and legislators require them. They are important to us in our work; we think about them often and have a lot to say about them.

What problem does this paper attempt to address?

Understanding the Mechanism of Conducting Benchmark Test for the Infrastructure of Physical Education Curricula in the Age of Artificial Intelligence

Mayasa Abd Ali Kadhim,Anwar Abd Alkader Mashi,Lamia Hassan Al-Diwan,Mohammed Asim Ghazi

DOI: https://doi.org/10.11648/j.ijeedu.20241301.12

2024-03-13

International Journal of Elementary Education

Abstract:The study aims to propose a vision for creating a standardized test according to the development of physical education curricula in the era of artificial intelligence, so that we can be able to measure student achievement and master the new curriculum standards. Based on the results, the following can be concluded: directing the teaching and learning process, and determining levels. For students, students’ teaching performance, students’ level of understanding and knowledge, application and achievement of lesson objectives in physical education. There is a strong correlation between most of the skills, knowledge, and behaviors that were measured in the study. This suggests that these skills, knowledge, and behaviors are related to each other, and that students who are high in one are more likely to have a high level in the other skills, knowledge, and behaviors. This is due to the fact that the students who participated in the study had a good level of performance in all the criteria that were measured. Based on the results, the following recommendations can be made: Focus on developing teaching skills and interaction with students, as they are closely related to the level of understanding and knowledge of students. Focus on developing knowledge and understanding of mathematical concepts, mathematical skills, and sporting values and behaviors’, as these skills and knowledge are closely linked to the application and achievement of lesson objectives in physical education.
The Analysis of English Classroom Test in Senior High School

Qi Qinyi

DOI: https://doi.org/10.22158/eltls.v5n4p227

2023-10-16

English Language Teaching and Linguistics Studies

Abstract:Teaching and testing have been two crucial elements in education. They are complementary and mutually influential. As a part of senior high school English teaching, English language testing has been important in gauging students’ competence. Scientific and reliable classroom teaching tests and assessments can effectively help teachers achieve objectives, change pedagogical approaches, and continuously innovate their methods. Through the use of questionnaires and data gathered from 40 English teachers from senior high school, this paper found that there are still many problems in the senior high school English classroom tests, which are mainly manifested by arbitrary test planning, lack of logic and stratification in questions proposal as well as insufficient research on the washback. The reasons for this situation are mainly due to factors like teachers’ scant understanding of the educational function of classroom tests, the irrationality of the existing evaluation mechanism and inadequate knowledge of students. practical suggestions are made in this regard in order to maximize the value of English classroom assessments zzand facilitate a productive English teaching and learning environment in the future.
Preparing for the Speaking Tasks of the TOEFL iBT® Test: An Investigation of the Journeys of Chinese Test Takers

Guoxing Yu,Lianzhen He,Pauline Rea-Dickins,Richard Kiely,Yanbin Lu,Jing Zhang,Yan Zhang,Shasha Xu,Lin Fang

DOI: https://doi.org/10.1002/ets2.12145

2017-01-01

ETS Research Report Series

Abstract:Language test preparation has often been studied within the consequential validity framework in relation to ethics, equity, fairness, and washback of assessment. The use of independent and integrated speaking tasks in the TOEFL iBT® test represents a significant development and innovation in assessing speaking ability in academic contexts. Integrated tasks that involve synthesizing and summarizing information presented in reading and listening materials have the potential to generate new test preparation strategies. This study investigated the experiences of over 1,500 Chinese test takers and 23 teachers who were preparing for the TOEFL iBT speaking tasks. It examined the frequency of use of a number of different test preparation activities and materials, reasons, and expectations for taking preparation courses and the features of preparation courses. In addition, we examined the usefulness of test preparation from two perspectives: studentsu0027 and teachersu0027 perceptions as well as the relationship between test preparation and performance. Data were collected via questionnaires, focus group discussions, interviews with test takers and teachers, and classroom observations. The data showed that (a) test preparation was a hugely complex, multiple-components construct, and teaching and learning test-taking strategies compose the most prominent feature of intensive preparation courses; (b) there were significant age-related differences in studentsu0027 preparation activities and focuses, although with small effect sizes; (c) there was a high agreement between teachers and students in their views on the usefulness of test preparation activities; and (d) there existed only a weak relationship between test preparation and performance. The only significant predictor of studentsu0027 test performance was the frequency of their use of the TOEFL Practice Online TPO® practice tests. The findings of the study can enhance our understanding of the pedagogical practices that characterize test preparation programs and contribute to the ongoing validity argument for the TOEFL iBT Speaking test. The implications of the findings for test publishers, test takers, teachers, and test preparation schools are discussed with reference to the instructional, learning, and affective aspects of the multifaceted construct of test preparation.
Beyond the Tyranny of Testing

Kenneth J. Gergen,Scherto R. Gill

DOI: https://doi.org/10.1093/oso/9780190872762.003.0001

2020-10-22

Abstract:This book starts by highlighting the different purposes of evaluation in education, including its contribution to student learning, teachers’ professional development, the school community’s progress, and the informed participation of parents and other stakeholders. However, largely owing to the current educational system that structures schools as factories, the pursuit of these goals has led to increased reliance on assessment devices such as exams, grades, and high-stakes testing. Functioning as a form of quality control, such practices now dominate the schooling process. Students are tested more than ever before, teachers and schools undergo measurement on a continuing basis, and nations compete for places on international league tables. The result is student test performance becoming the only aim of education, turning the measurement into the goal itself. Furthermore, standardization as such masks individual potential and suppresses creativity. Combined with mounting stress on students, teachers, and school leaders, alternatives to assessment must be sought.
How test-use policy in the educational system influences stakeholders—A case study of CET-4

ZHOU Jiming,LIU Kun

2011-01-01

Abstract:Researches on language testing have long been focused on the improvement of intrinsic quality of validity and reliability,or on the washback effects on language teaching,but rarely on the social dimension.This research reviews some reflections on the social dimension in the field of language testing,based on which a case study of CET-4 in China is conducted to investigate how the "linked" policy between CET-4 certificate and degree diploma influences test results as well as students' and teachers' perceptions and behaviors in relation to CET-4.
“It’s Important for Them to Know Who They Are”: Teachers’ Efforts to Sustain Students’ Cultural Competence in an Age of High-Stakes Testing

Melody Zoch

DOI: https://doi.org/10.1177/0042085915618716

2015-12-16

Urban Education

Abstract:This article examines how four urban elementary teachers designed their literacy instruction in ways that sought to sustain students’ cultural competence—maintaining their language and cultural practices while also gaining access to more dominant ones—amid expectations to prepare students for high-stakes testing. A large part of their teaching involved taking their students’ backgrounds into account and selecting classroom texts to provide examples of the contributions made by successful culturally, ethnically, and linguistically diverse people with space for dialogue about inequity.

education & educational research,urban studies
Advances in Unit Testing

Tao Xie,Nikolai Tillmann,Pratap Lakshman

DOI: https://doi.org/10.1145/2889160.2891056

2016-01-01

Abstract:Parameterized unit testing, recent advances in unit testing, is a new methodology extending the previous industry practice based on traditional unit tests without parameters. A parameterized unit test (PUT) is simply a test method that takes parameters, calls the code under test, and states assertions. Parameterized unit testing allows the separation of two testing concerns or tasks: the specification of external, black-box behavior (i.e., assertions or specifications) by developers and the generation and selection of internal, white-box test inputs (i.e., high-code-covering test inputs) by tools. PUTs have been supported by various testing frameworks. Various open source and industrial testing tools also exist to generate test inputs for PUTs. This technical briefing presents latest research on principles and techniques, as well as practical considerations to apply parameterized unit testing on real-world programs, highlighting success stories, research and education achievements, and future research directions in developer testing.
Getting at Student Understanding - the Key to Teachers’ Use of Test Data

Jonathan Supovitz

DOI: https://doi.org/10.1177/016146811211401105

2012-11-01

Abstract:Background/Context Much has been written about the efficacy of formative assessment. However, relatively little of that research focuses on the design qualities of the assessment instruments themselves that might provide useful information to teachers. Purpose/Objective/Research Question/Focus of Study This article decomposes the formative assessment process and reviews the empirical literature on the feedback from an assessment event to the teacher to investigate two research questions. First, what are the design elements of assessments that can enhance their embedded information to help teachers understand how students are thinking about a particular content area? Second, what do teachers need to know to be able to take advantage of more sophisticated assessment designs? Research Design The article reviews the literature on test design qualities, focusing on empirical studies that have examined how the qualities of tests inform teachers about student understanding. Overall, 117 articles were synthesized to extract three qualities of test design that enable or constrain their potential to provide insight to teachers about student thinking. Findings/Results The literature review identified three crucial test qualities that improve their potential value to teachers. First, tests can convey information about students’ developmental path toward a learning goal. Second, tests can provide information about students’ thought processes. Third, tests can be designed to reveal information about students’ misconceptions within a content area. Conclusions/Recommendations The article concludes with a conceptual framework to guide future research on ways to maximize the potential feedback that teachers can receive from assessments. The framework, and hence suggestions for future research, focuses on conducting research on the hypothesized relationships between the qualities of a test itself, the analyses that teachers conduct from the resulting data of student answers, teachers’ instructional responses, and the effect of this process on student learning.

education & educational research
Organization and Implementation of Intelligence Test on "criterion on Health of Constitution" for College Students

陆淳,刘静民,郑丽君,赖柳明,王俊华

DOI: https://doi.org/10.3969/j.issn.1006-7116.2004.05.028

2004-01-01

Journal of Physical Education

Abstract:After the Organization and implementation of intelligence test on Criterion on Health of Constitution,a few teachers still could not understand the importance of the test.The application of the intelligence test could help us acquire the data and the assessment scores quickly and efficiently,thus reducing the burden of data-entry and the errors produced by human factors.Step test lags behind other tests.The computers used to collect data should be positioned out of the students' access.Winter is not recommended to take tests in.And it is suggested that standing long jumping be tested in PE classes.
Cultivating teacher thinking: ideas and practice

Jia-Li Huang

DOI: https://doi.org/10.1007/s10671-015-9184-1

2015-09-11

Educational Research for Policy and Practice

Abstract:This paper aims to develop, through a literature analysis, a portrait of the functioning and practice of teacher thinking at government and university levels. Teacher thinking is defined as habits and strategies or the habit of thinking used to collect information, analyze, understand institution, reflect, solve problems, inform decisions, initiate action, and accumulate practical wisdom. Teachers develop the habit of accumulating practical wisdom to make good decisions for student learning. To cultivate thinking skills, governments can enact teacher professional standards and teacher education curricula. Field experience at the university level should also be designed to involve multiple teaching strategies and a coherent and consistent learning experience in different educational courses, which will help foster thinking habits to accumulate practical wisdom. Portfolio assessment, performance-based assessment, and teacher situational judgment tests can be used to assess teacher candidates’ thinking and cognition regarding teaching and learning.
A Meaningful Attempt; Adopting Large Percentage of Subjective Items in College English Tests

Wenxia Zhang

2003-01-01

Abstract:In 1996, 8 universities nationwide were chosen as experimental units to construct their own college English tests, which can be different from the National College English Test Band 4 and Band 6. As one of the experimental units, Tsinghua University constructed its own English Proficiency Test (1)(abbr. TEPT-1)in Autumn, 1996, whose candidates are Tsinghua undergraduates who have completed the English study of Foundation Stage. The most obvious feature of TEPT-1 is to have a large percentage of subjective items to test students' ability of using English fluently. This test got the approval of the Chinese Ministry of Education in 1999. This paper has made a brief introduction to the construction and implementation of TEPT-1, and executed a general evaluation of its reliability and validity as well. Meanwhile, the results of the questionnaires made among some English teachers and students in Tsinghua have been analyzed.
Reflections on the History of the Reform of College Entrance Examination

Muzhou Li

DOI: https://doi.org/10.3969/j.issn.1672-4038.2014.03.011

2014-01-01

Abstract:Reflecting the reform process of college entrance examination, we find that there have been greater breakthroughs in the form, scope of knowledge, and the tests themselves. To a certain extent, it promoted diversified assessments and recognition of different talents. However, due to the overall progress of Chinese reform, the reform in college entrance examination is still in a stage of transformation, with various forms of the tests to improved and integrated, the variety of examinations to be adjusted, the structure and designing of test content to be optimized. There are still problems in the quality of the tests and fairness. According to the institutional change theory, changes in the college entrance examination will be from the“mandatory” to the “induced” phases; while the incentives will be less “political” than “technical” , and the single test will give way to more diversified assessments.
A Practical Study on Improving the Professionalism of Elementary School English Teachers Based on Compulsory Education Testing

Jinhua CAI,

DOI: https://doi.org/10.48014/pcp.20231102001

2024-03-28

Abstract:In the face of the ever-opening contemporary China, English has become an indispensable communication tool. Based on the results of basic education quality monitoring and existing research results on teacher professional quality, this paper investigates the professional quality of English teachers in representative primary school in Xi'an, examining the teachers’ professional quality in five dimensions, namely, the basic situation, professionalism, professional knowledge and professional abilities, and training status and conducting interviews with relevant teachers. Through the survey, it was found that elementary school English teachers in Xi'an have high professional ideals and good professionalism, have a high sense of teaching effectiveness, and have a good grasp of English education professional knowledge. The teachers' professional abilities basically meet the requirements of English teaching, and they hope to receive further regular training in teaching methods, skills training, and the ability to write papers. At the same time, some problems were also discovered: the gender ratio of teachers is disproportionate, and teaching philosophy is not fully implemented; teachers lack mastery of theoretical knowledge and scientific research knowledge, and their oral English expression still needs to be improved; parent resources cannot be better utilized; the adoption of teaching methods requires to be further improved, teaching methods need to be further improved; teachers’ scientific research capabilities are weak, etc. In view of the existing problems, the article puts forward suggestions for improving the professional quality of elementar school English teachers in Xi'an: strengthening teachers' professional emotional quality; deepening teachers' understanding of teaching concepts; strengthening the cultivation of teachers' professional knowledge and professional abilities; strengthening the cultivation of teacher's educational research ability.
Exploring fundamental engineering course instructors' test usage beliefs and behaviors: A multicase study

Kai Jun Chew,Holly M. Matusovich

DOI: https://doi.org/10.1002/jee.20614

IF: 3.288

2024-09-03

Journal of Engineering Education

Abstract:Background Tests are commonly and heavily used in fundamental engineering courses (FECs) to assess student learning of concepts. With existing literature presenting mixed benefits and disadvantages of testing to students' motivation to learn and documenting widely alternative assessments, the lack of questioning of heavy and common test usage must be addressed to diversify classroom assessment and promote intentionality in test usage. Purpose/Hypothesis This study begins to address the lack of questioning by exploring and uncovering test usage beliefs and behaviors of seven FEC instructors from two engineering departments in a land‐grant, public, Research 1 university Design/Method Grounded in the Situated Expectancy–Value Theory (SEVT), we conducted a multicase study. Data include two interviews, course syllabi, and sample tests provided by the participants, and public documents from the institution and departments. We conducted a priori and emergent coding and thematic analysis to identify the beliefs and behaviors before developing individual case summaries for cross‐case analysis to identify groupings. Results Three test usage groups emerged: enthusiastic, default, and questioning. All test usage groups featured tests heavily in their FECs, resulting in varying alignment between these participants' test usage beliefs and behaviors. Conclusions Our findings reveal the various factors that can shape FEC instructors' test usage beliefs and behaviors, and the complexity in terms of alignment. This work lays important implications, including laying the foundations for future scholarship on testing in engineering education research and leveraging findings to begin efforts in diversifying assessment approaches and promoting intentional test usage in FECs.

engineering, multidisciplinary,education & educational research,education, scientific disciplines
Using Burke's Dramatistic Pentad to Interpret Chinese "Gao-Kao" High Stakes Testing and Stressing - Paralelled Testing in the U.S. As Cross-Cultural Context

Lei Wang,Xiaoting Huang,Jim Schnell

DOI: https://doi.org/10.17646/kome.2013.15

2013-01-01

Abstract:The Chinese College Entrance Examination (“Gao-Kao”) is the mosthigh stakes assessment in China and parallels the most competitive examinations globally. Although it can provide Chinese educators and policy makers with an enormous pool of information about student achievement growth, school efficiency, etc., the current use of the test is mainly limited to ranking students by their raw scores. In this study, we tried two modifications to the traditional test toconnect the assessment outcomes with school accountability. First, we linked the Gao-Kao English tests from 2010 and 2011 and aligned them on a Rasch scale. Secondly, we collected background information of the examinees via a background survey.The result showed that students from Hainan province improved a little in 2011 overall. In addition, school level reports were generated to show the school’s growth as well as the county and province averages. By implementing test equating and background survey measures, this study demonstrated that Gao-Kao data can be used to construct a longitudinal data source as an initial step to build a value-added school accountability system.The aforementioned findings and how they are communicated help to frame global use of such high stakes testing. Kenneth Burke’s Dramatistic Pentad is used as foundation for communicative interpretation of these findings. The international context provides backdrop within which the findings are nested. Contrast with testing in the U.S. serves to highlight unique features of the Gao-Kao examination approach.
The Learning Power of Testing

Richard G. Kunkel

DOI: https://doi.org/10.1111/jlse.12140

2024-02-08

Journal of Legal Studies Education

Abstract:Abstract For many professors, testing is primarily a tool for assessing the learning of students. However, research into the “testing effect” has established the value of testing also as a learning tool, not just as an assessment tool. This article provides an overview of this research and also of my own experiences in using a variety of testing approaches. Based on these experiences, the article offers a process for adopting testing as a learning tool, along with a review of design choices. By increasing their use of testing in business law instruction, business law professors will improve learning.
Importance and Realization of Self-Service Analysis and Testing System

章斐

DOI: https://doi.org/10.3969/j.issn.1006-7167.2008.11.043

2008-01-01

Abstract:The concepts of self-service analysis and testing and the related service system were proposed.The contents,importance,and guarantee measures of self-service analysis and testing system of the intermediate instrument laboratory in the college of chemistry and molecular engineering,Peking University,were introduced in this article.
An Experimental Study of Four Typical Test Suite Reduction Techniques

Hao Zhong,Lu Zhang,Hong Mei

DOI: https://doi.org/10.1016/j.infsof.2007.06.003

IF: 3.9

2008-01-01

Information and Software Technology

Abstract:In software development, developers often rely on testing to reveal bugs. Typically, a test suite should be prepared before initial testing, and new test cases may be added to the test suite during the whole testing process. This may usually cause the test suite to contain more or less redundancy. In other words, a subset of the test suite (called the representative set) may still satisfy all the test objectives. As the redundancy can increase the cost of executing the test suite, quite a few test suite reduction techniques have been brought out in spite of the NP-completeness of the general problem of finding the optimal representative set of a test suite. In the literature, there have been some experimental studies of test suite reduction techniques, but the limitations of the these experimental studies are quite obvious. Recently proposed techniques are not experimentally compared against each other, and reported experiments are mainly based on small programs or even simulation data. This paper presents a new experimental study of the four typical test suite reduction techniques, including Harrold et al.'s heuristic, and three other recently proposed techniques such as Chen and Lau's GRE heuristic, Mansour and El-Fakin's genetic algorithm-based approach, and Black et al.'s ILP-based approach. Based on the results of this experimental study, we also provide a guideline for choosing the appropriate test suite reduction technique and some insights into why the techniques vary in effectiveness and efficiency.
Wearing New Shoes to Walk the Old Road: The Negotiation of Opposing Imperatives in High School New Curriculum Classes in China

Tanja Sargent,Mingyu Chen,Yi-Jung Wu,Chentong Chen

DOI: https://doi.org/10.1108/s1479-3679(2011)0000015007

2011-12-30

Abstract:When college entrance examinations act as gatekeepers to modern-sector jobs, the entire education system then becomes oriented toward these examinations. This occurs at the expense of learning for the sake of learning and other aspects of education that address the holistic development and well-being of students. In recent years in China, there has been growing concern that examination competition has compromised the quality of classroom teaching and learning and is detrimental to the development of skills necessary for the global knowledge economy. These concerns have given rise to a far-reaching set of education reforms known as the New Curriculum reforms which have aimed to move students to the center of teaching and learning and to transform teaching and learning so as to foster such capacities as creativity, innovation, collaboration, self-expression, engagement, enjoyment of learning, inquiry skills, problem-solving abilities, and ability to apply knowledge in practice. In this chapter, we use videotaped high school New Curriculum demonstration lessons to examine teaching and learning practices that are regarded as exemplary in the current reform context. We investigate how teachers are negotiating the competing demands of preparing students for the examinations and addressing the aims of the New Curriculum reforms. The nature of student participation in the classroom emerges in the analysis as a key indicator of the success of this negotiation.
Compiler testing: a systematic literature analysis

Yixuan Tang,Zhilei Ren,Weiqiang Kong,He Jiang

DOI: https://doi.org/10.1007/s11704-019-8231-0

IF: 2.6688

2019-03-07

Frontiers of Computer Science

Abstract:Compilers are widely-used infrastructures in accelerating the software development, and expected to be trustworthy. In the literature, various testing technologies have been proposed to guarantee the quality of compilers. However, there remains an obstacle to comprehensively characterize and understand compiler testing. To overcome this obstacle, we propose a literature analysis framework to gain insights into the compiler testing area. First, we perform an extensive search to construct a dataset related to compiler testing papers. Then, we conduct a bibliometric analysis to analyze the productive authors, the influential papers, and the frequently tested compilers based on our dataset. Finally, we utilize association rules and collaboration networks to mine the authorships and the communities of interests among researchers and keywords. Some valuable results are reported. We find that the USA is the leading country that contains the most influential researchers and institutions. The most active keyword is “random testing”. We also find that most researchers have broad interests within small-scale collaborators in the compiler testing area.

computer science, information systems, theory & methods, software engineering

Putting Tests to the Test

Understanding the Mechanism of Conducting Benchmark Test for the Infrastructure of Physical Education Curricula in the Age of Artificial Intelligence

The Analysis of English Classroom Test in Senior High School

Preparing for the Speaking Tasks of the TOEFL iBT® Test: An Investigation of the Journeys of Chinese Test Takers

Beyond the Tyranny of Testing

How test-use policy in the educational system influences stakeholders—A case study of CET-4

“It’s Important for Them to Know Who They Are”: Teachers’ Efforts to Sustain Students’ Cultural Competence in an Age of High-Stakes Testing

Advances in Unit Testing

Getting at Student Understanding - the Key to Teachers’ Use of Test Data

Organization and Implementation of Intelligence Test on "criterion on Health of Constitution" for College Students

Cultivating teacher thinking: ideas and practice

A Meaningful Attempt; Adopting Large Percentage of Subjective Items in College English Tests

Reflections on the History of the Reform of College Entrance Examination

A Practical Study on Improving the Professionalism of Elementary School English Teachers Based on Compulsory Education Testing

Exploring fundamental engineering course instructors' test usage beliefs and behaviors: A multicase study

Using Burke's Dramatistic Pentad to Interpret Chinese "Gao-Kao" High Stakes Testing and Stressing - Paralelled Testing in the U.S. As Cross-Cultural Context

The Learning Power of Testing

Importance and Realization of Self-Service Analysis and Testing System

An Experimental Study of Four Typical Test Suite Reduction Techniques

Wearing New Shoes to Walk the Old Road: The Negotiation of Opposing Imperatives in High School New Curriculum Classes in China

Compiler testing: a systematic literature analysis