Intelligent Computer-aided Test Specification Management Inquiry

Wei Jiang

2011-01-01

Abstract:This article from the practice of computer-aided Proficiency Test from the hair,summed up the problems in computer-aided testing,and the need to strengthen in the future areas for improvement are described.

What problem does this paper attempt to address?

Computerized Test System Based on Specifications

李弋,姜志刚,赵一鸣

DOI: https://doi.org/10.3969/j.issn.1000-3428.2004.10.074

2004-01-01

Abstract:This paper summarizes some features of domestic existed computerized test system and introduces a test specification made by IMS organization. According to the test specifications made by international organization, test is refined into a four processes model. Finally, a general test system with high extensibility is designed and implemented on J2EE platform.
A Robust Computerized Adaptive Testing Approach in Educational Question Retrieval

Yan Zhuang,Qi Liu,Zhenya Huang,Zhi Li,Binbin Jin,Haoyang Bi,Enhong Chen,Shijin Wang

DOI: https://doi.org/10.1145/3477495.3531928

2022-01-01

Abstract:Computerized Adaptive Testing (CAT) is a promising testing mode in personalized online education (e.g., GRE), which aims at measuring student's proficiency accurately and reducing test length. The "adaptive" is reflected in its selection algorithm that can retrieve best-suited questions for student based on his/her estimated proficiency at each test step. Although there are many sophisticated selection algorithms for improving CAT's effectiveness, they are restricted and perturbed by the accuracy of current proficiency estimate, thus lacking robustness. To this end, we investigate a general method to enhance the robustness of existing algorithms by leveraging student's "multi-facet" nature during tests. Specifically, we present a generic optimization criterion Robust Adaptive Testing (RAT) for proficiency estimation via fusing multiple estimates at each step, which maintains a multi-facet description of student's potential proficiency. We further provide theoretical analyses of such estimator's desirable statistical properties: asymptotic unbiasedness, efficiency, and consistency. Extensive experiments on perturbed synthetic data and three real-world datasets show that selection algorithms in our RAT framework are robust and yield substantial improvements.
Intelligentized Course of Computer Assisted Instruction and Its Enlightenment

Zhang Jianping,Chen Shipin

2008-01-01

Educational Research

Abstract:The application of computers in teaching experienced a course from programmed instruction to computer assisted instruction(CAI).Currently,it is developing from intelligent computer assisted instruction(ICAI)to adaptive learning support(ALS).Because ICAI system over emphasizes indealized instruction,it is difficult to overcome the contradictions between technology realization and application effect for many years.ALS system both exerts the advantage of ICAI system and pays attention to the adaptive support for learning,which is a research hotspot of the current cyber learning platform intellectualization.As a cross research field,CAI should pay attention to learn from the new idea,new technology and new method of other disciplines,taking the cognitive theory of multimedia learning as its guiding ideology.
An Exploratory Study of the Computer-Assisted Test Paper Composition for College English Test

朱正才,杨惠中

DOI: https://doi.org/10.3969/j.issn.1001-5795.2008.06.001

2008-01-01

Abstract:This paper,based on the analysis of cognitive process of language test exporter,presents an approach on computer-assisted test paper composition.The method is mainly depended on genetic algorithm and Item bank technology.The test paper constitution was expressed firstly in mathematics,in the paper,and then treated as an optimal question of solution.The author executed the compute,with an item bank,which had 5000 items.
The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course

Hung-Yi Chen,Ying-Chieh Liu,Xuan-Qi Liu,Victoria Chiu

DOI: https://doi.org/10.1109/access.2023.3311615

IF: 3.9

2023-01-01

IEEE Access

Abstract:The teaching method of mastery learning requires the lecturers to conduct their regular formative assessments so as to monitor each student’s learning progress. However, regularly preparing quality test forms for these assessments has caused a tremendous workload on the lecturers and has prevented them from effectively executing the master learning instruction. To resolve the problem, this study has built an automatic test assembly system with the automatic and manual test assembly functions for preparing fixed-length testing forms. Our system is implemented in a Structural Query Language (SQL) mastery course that helps students prepare for the ORACLE SQL Certification (OCE SQL) examination. OCE SQL is a program offered by the Oracle Corporation to validate and recognize the skills of professionals in the SQL programming. By applying the Hambleton and De Gruijter’s method, our system can automatically assemble items to a test form with a quality indication of the maximum probability of misclassifying mastery. Furthermore, our system can evaluate the prementioned probability for a manually assembled test form. The present study has also investigated the numeric methods for converting the domain cutoff score to the latent ability scale for items with heterogeneous parameters when applying the method. The empirical computing results showed that the secant method is superior to the bisection method for the conversion. This study contributes an automatic test assembly system to the engineering education practice so as to lighten the lecturers’ burden of preparing quality assessments and to further facilitate the execution of the regular formative assessments in the mastery learning instruction.
Design and Application of a Response-Driven Adaptive Test System

JianPing Zhang,Bo Mu,Shipin Chen

DOI: https://doi.org/10.1109/ITCS.2009.87

2009-01-01

Abstract:Unlike the traditional paper-and-pencil tests, computer adaptive testing (CAT) presents the next item based on his or her past responses, which is more appropriate for a particular individual. However, it is rarely seen in a smaller-scale scenario, such as in classrooms or business, because of the complexity of Item Response Theory (IRT) and the possible usages of services may not be known or may increase due to the development of new services. Our approach to this problem is self-adaptive functional testing, which is a combination of monitoring and active testing at runtime. We present a Response-Driven Adaptive Test System (RDATS) to get userpsilas response data which has been detected during monitoring, existing test cases are adapted automatically to the specific situation and applied afterwards based on userpsilas response at runtime. In this paper, we discuss the structure and functionality of the system with particular emphasis on adaptive test Mechanisms and SQL database design. Finally, we discuss some practical issues related to the application of the system and its future works.
An Overview of Approaches to the Automated Assessment of Subjective Tests

高思丹,袁春风

DOI: https://doi.org/10.3969/j.issn.1001-3695.2004.02.059

2004-01-01

Abstract:As one of the key techniques of network teaching system,computerized assessment of subjective tests has become more and more important.This paper presents some prominent approaches to automated assessment of subjective tests,which were developed in recent years,including PEG,LSA,ATM,AutoMark,etc.
Research and Applying of Intelligent Computer Assisted Instruction

Weiping Ding,Xianfeng Gu

2006-01-01

Abstract:Intelligent Computer Assisted Instruction has been one trend of the modern computer education development.First the structure and characteristic are expounded in this paper,then the Intelligent Computer Assisted Instruction System is designed according to the constructing fact of data structure emphasis course.The system in the application of the teaching practice is proved that better study effect and it has the stronger applicability and the spreaded value.
Internet-based intelligent test and evaluation system for electronic technique experiment

JIN Ping,MA Cao-yuan,ZHANG Zun-qiao

DOI: https://doi.org/10.3969/j.issn.1002-4956.2008.08.030

2008-01-01

Abstract:The Internet-based intelligent test and evaluation system for electronic technique experiment include many broadly topics and focused knowledge points.Furthermore,the system introduces the parameters of difficult coefficient,and adjusts the parameters of difficult coefficient by use of the integration of the statistis,experience and knowledge points.By testing,the system can analyze the student's master degree and give the corresponding unpersonality evaluation.
A General Automatic Test System for Instruments in IC Equipment

Xiaoshan Su,Ling Tian

DOI: https://doi.org/10.1109/tim.2012.2188659

IF: 5.6

2012-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:This paper proposes a general testing model for instruments and several testing approaches to test instruments in integrated circuit (IC) equipment. Three levels of mirror models are built to describe the hierarchical construction of units under test in IC equipment, which is used to simulate the internal structure and component relationship of tested instruments. By using different types of data acquisition (DAQ) cards and corresponding drivers, a concept of virtual pin is proposed to establish a bridge between the software and hardware aspects of the automatic test system (ATS). To improve the flexibility of the ATS, the testing procedure for a single instrument or equipment is divided into mirror model configuration and runtime control. By this way, the same mirror model can be adapted to different testing applications. To meet the needs of reusability of mirror models and transportability of testing applications, various configurations are serialized and deserialized via Extensible Markup Language files. Based on industrial personal computer and DAQ cards, an ATS prototype named IC Equipment Tester (ICETester) was developed to support the proposed mirror model and testing methods. The prototype was implemented for the development of plasma-enhanced chemical vapor deposition (PECVD) equipment, which proved that ICETester is efficient and flexible to test instruments in the PECVD equipment.
"Interest+Test+Certification" of Computer Science Students' Practice Innovation Ability Training

Xu Hao-sh

Abstract:For computer science students, the development of the information society for its innovative ability put forward higher requirements. In this paper, a series of problems that exist in computer science teaching, practice and innovation ability to train students in computer science and put forward the "interest + test + certification" approach and the specific aspects of each analysis in order for the relevant workers provide a reference.

Education,Computer Science
Computer Aided Quality Assurance in CIM—Its Methodology and Architecture

YC DING,GP HE,BH LU

DOI: https://doi.org/10.1016/s1474-6670(17)49525-5

1992-01-01

IFAC Proceedings Volumes

Abstract:This paper presents a strategy for designing and implementation of computer aided quality assurance systems (CAQ). Systematic structured approaches are utilized to develop the functional and information models for this sophisticated quality system. A case study of CAQ for JFMT CIM (Jinan First Machine Tools Inc. CIM, one of the four pioneering CIM demonstration projects of China) is given in the coverage.
Development and Research of Intelligent Testing Information System for Full Performance Test of Metrology Equipment

Xiaofang Ma,Haili Ding,Yuanfeng Zhou,Pengyuan Liu,Tingting Hu,Shaokui Yan

DOI: https://doi.org/10.1088/1742-6596/1982/1/012045

2021-07-01

Journal of Physics: Conference Series

Abstract:Abstract Aiming at the measurement laboratory with many types of testing equipment, many test items, low automation of instruments and equipment, inconsistent data interface standards, ineffective coordination of testing services, low level of laboratory testing resources and data sharing, and difficulty in achieving effective data and resources connection, etc. Problem, design and develop an intelligent detection system for full performance test of measurement equipment. The research and development of the full-performance test intelligent detection system replaces manual operation with standardized automatic operation, which improves the consistency, standardization and reliability of the full-performance test of the measurement equipment, and realizes the reproducibility and traceability of the test. The automatic collection of full performance test data has been realized, laying a solid foundation for the construction of the national industrial basic database.
Computer-aided tutorials and tests for use in distance learning

N Nirmalakhandan

Abstract:Compared to the traditional on-campus students, remote students in distance education courses find it more difficult to develop problem-solving skills. In this paper, we propose the use of computer-aided tutorials and tests (CATTs) as convenient tools for remote students to practice and improve problem-solving and test taking skills at their own pace. Example of CATTs developed with Authorware software for use in distance education is presented.
Task Based Automatic Examination System for Sequenced Test

Song Luo,Jianbin Hu,Zhong Chen

DOI: https://doi.org/10.1109/ICECT.2009.115

2009-01-01

Abstract:Computer greatly influences our educational environment. Over the last years, automatic computer examination systems have been widely used for computer-based tests. But these systems are based on traditional question-answer examination style which is not fit for the sequenced test. The sequenced test should consider the context of the examinee, e.g. the order of questions or the permissions of the examinee, to grade an examinee. In this paper, we propose an effective and practical automatic examination architecture based on task. The task is abstracted from the examination process and can meet the requests of the sequenced test, such as order and dependency. At the end of the paper, we implement an automatic examination system based on task for the stake test which proves quite efficient in practice.
Research on the Influence of Computer Aided Intelligent Tutoring System on Teacher’s Self-Efficacy

Jianfei Su,Yuqiang Feng,Luning Liu

DOI: https://doi.org/10.3233/jifs-169627

2018-01-01

Journal of Intelligent & Fuzzy Systems

Abstract:With the progress of modern society, human knowledge explodes, which calls for more convenient, faster and more effective methods of education. In this research, we focus on the construction of the computer aided intelligent tutoring system based on a new teaching model, and its influence on teachers’ teaching self-efficacy. Firstly, on the basis of the actual demand of ICAI system, the theoretical basis and development principle of intelligent tutoring system were expounded, and the system construction of student model and teacher model was studied. Secondly, the implementation of the quantitative assessment of cognitive ability and the teaching strategy base in DCB-ITS student model were studied and the implementation of the intelligent tutoring system was analyzed. Finally, in order to test the efficiency of the system, we carried through an empirical study. A survey to 209 college teachers was conducted, the results show that teachers who make use of the intelligent tutoring system during the teaching activities report higher scores of teaching self-efficacy, which indicates that compared with the traditional teaching model, the computer aided intelligent teaching model is of great help for teachers in making them feel more confident about teaching effectively.
The Design and Development of A Semi-Auto Computer Generated Testing Paper System - A Case Study in the School of Continuing Education at China University of Geosciences

Juan Yang,Xibin Han,Qian Zhou

2011-01-01

Abstract:With the rapidly increasing entrance examinations for the School of Continuing education of CUGB, there is an urgent need of the examination papers that have the parallel testing ability for the same academic program. Based on the analysis of parallel factors and the comparison of the manual generated mode and the computer generated mode, the most time-consuming and experience-consuming steps are found. By providing supports to those steps automatically, a semi-auto computer generated testing paper system was designed and developed for reducing the workload of the experienced faculties to generate testing papers. The papers were generated based on a gradually constructed item-bank. The system offered multiple templates of the testing paper structure plan for assisting semi-auto paper generated procedure and guaranteeing the parallel of the generated papers. In order to construct an item-bank in a short time, an easy-to-use authoring tool with powerful functions was designed and developed. The system supported the spring entrance examination of SCECUGB in 2010 successfully. Faculties gave positive feedback toward the system.
A Study on the Effectiveness of the iTEST Paperless Testing System in English Listening Course

Yu Xia

DOI: https://doi.org/10.11648/j.her.20240901.13

2024-02-20

Higher Education Research

Abstract:In the intelligent teaching environment empowered by information technology, the methods and approaches for course examinations have become increasingly diverse, with a greater emphasis on assessing the learning process and linking it to final exams. Computer-assisted testing, as a new examination system, has gained attention and recognition from educators. It has reformed traditional teaching models to a certain extent, liberating teachers from repetitive and labor-intensive teaching activities while improving the overall teaching quality. Taking the application of the iTEST paperless testing system in English Listening course as an example, this study establishes a testing template and evaluates the role of the iTEST system in teaching. The research methods used in this study include quantitative and qualitative research methods, such as interviews and statistical analysis. By collecting feedback from students and teachers who have used the iTEST system, the study aims to understand the advantages and limitations of the iTEST system as perceived by teachers. Through statistical analysis, the study evaluates the examination results of the iTEST system and compares them with those of traditional paper-based tests. The results indicate that the iTEST paperless testing system can effectively enhance the teaching outcomes of English Listening courses, providing students and teachers with a more flexible, efficient, and accurate testing experience.
A Case Study of Adaptive Combinatorial Testing

Changhai Nie,Siyang Chen,Hareton Leung,Kai-Yuan Cai

DOI: https://doi.org/10.1109/COMPSACW.2013.22

2013-01-01

Abstract:The ability of Combinatorial Testing (CT) to detect and locate the interaction triggered failure has been well studied. But CT still suffers from many challenges, such as modeling for CT, sampling mechanisms for test generation, applicability and effectiveness. To overcome these issues of CT, adaptive combinatorial testing (ACT) is proposed in this paper, which improves the traditional CT with a well established adaptive testing method as the counter part of adaptive control and aims to make CT more flexible and practical. ACT can significantly enhance testing quality, software reliability and support testing strategy adjustment dynamically. To support further investigation, a preliminary form of concrete strategy for ACT is given as a heuristic guideline, and a case study is presented to illustrate its operations.
Design principles of the Internet-Based College English Test

Jin Yan,Wu Jiang

2009-01-01

Abstract:The project of developing the Internet-Based College English Test(IB CET) was approved by the Ministry of Education in 2007,with a view to improving the validity and administration efficiency of the CET.The trial test of the IB CET 4 was implemented in December 2008.This paper elaborates the major principles of the test design with focuses on the purposes of the test,the authenticity of test tasks,the ratio between constructed and selected response items,and the practicality of marking.The authors believe that the IB CET will have a positive impact on the reform of college English teaching and on the implementation of the computer-and classroom-based college English teaching models.

Intelligent Computer-aided Test Specification Management Inquiry

Computerized Test System Based on Specifications

A Robust Computerized Adaptive Testing Approach in Educational Question Retrieval

Intelligentized Course of Computer Assisted Instruction and Its Enlightenment

An Exploratory Study of the Computer-Assisted Test Paper Composition for College English Test

The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course

Design and Application of a Response-Driven Adaptive Test System

An Overview of Approaches to the Automated Assessment of Subjective Tests

Research and Applying of Intelligent Computer Assisted Instruction

Internet-based intelligent test and evaluation system for electronic technique experiment

A General Automatic Test System for Instruments in IC Equipment

"Interest+Test+Certification" of Computer Science Students' Practice Innovation Ability Training

Computer Aided Quality Assurance in CIM—Its Methodology and Architecture

Development and Research of Intelligent Testing Information System for Full Performance Test of Metrology Equipment

Computer-aided tutorials and tests for use in distance learning

Task Based Automatic Examination System for Sequenced Test

Research on the Influence of Computer Aided Intelligent Tutoring System on Teacher’s Self-Efficacy

The Design and Development of A Semi-Auto Computer Generated Testing Paper System - A Case Study in the School of Continuing Education at China University of Geosciences

A Study on the Effectiveness of the iTEST Paperless Testing System in English Listening Course

A Case Study of Adaptive Combinatorial Testing

Design principles of the Internet-Based College English Test