Abstract:Automatic test paper design is critical in education to reduce workloads for educators and facilitate an efficient teaching process. However, current designs fail to satisfy the realistic teaching requirements of educators, including the consideration of both test quality and efficiency. This is the main reason why teachers still manually construct tests in most teaching environments. In this paper, the quality of tests is quantitatively defined while considering multiple objectives, including a flexible coverage of knowledge points, cognitive levels, and question difficulty. Then, a model based on the technique of linear programming is delicately designed to explore the optimal results for this newly defined problem. However, this technique is not efficient enough, which cannot obtain results in polynomial time. With the consideration of both test quality and generation efficiency, this paper proposes a genetic algorithm (GA) based method, named dynamic programming guided genetic algorithm with adaptive selection (DPGA-AS). In this method, a dynamic programming method is proposed in the population initialization part to improve the efficiency of the genetic algorithm. An adaptive selection method for the GA is designed to avoid prematurely falling into the local optimal for better test quality. The question bank used in our experiments is assembled based on college-level calculus questions from well-known textbooks. The experimental results show that the proposed techniques can construct test papers with both high effectiveness and efficiency. The computation time of the test assembly problem is reduced from 3 hours to 2 seconds for a 5000-size question bank as compared to a linear programming model with similar test quality. The test quality of the proposed method is better than the other baselines.

Multi-objective Test Paper Evaluation in the Process of Composing with Computer

An Intelligent Test Sheet Composition System

A Method of Computer Automatic Scoring for Subjective Questions

An Exploratory Study of the Computer-Assisted Test Paper Composition for College English Test

Method of Composing Test Papers in Self-Examination System

META: Multidimensional Evaluation of Testing Ability

The Strategy of Automatically Generating Test Papers Based on Evaluation Function of Dynamic of Multi-Goals

Test-Sheet Composition Using Analytic Hierarchy Process and Hybrid Metaheuristic Algorithm TS/BBO

The Design and Development of A Semi-Auto Computer Generated Testing Paper System - A Case Study in the School of Continuing Education at China University of Geosciences

Test-Managing and Creating Exam Pater System Design Based on LaTeX

Exploring Multiple-Objective Optimization for Efficient and Effective Test Paper Design with Dynamic Programming Guided Genetic Algorithm

Research on Intelligent Test Paper Generation Based on Multi-Variable Asymptotic Optimization

A Novel Test-sheet Composition Approach using Differential Evolution Algorithm for Computer-aided Testing Systems

A Computer Aided Grading System for Subjective Tests

Research and Design of College PE Theory's Examination Paper Bank Based on Combinatorial Optimization

Design and Analysis on Test Quality

Automated Evaluation for Performance Test Scripts

Analysis and Study of Volume Pattern in Network Test System

An Analysis of the Problems and Measurements about the Examination System in Engineering Training

Research on Intelligent Generating Test Paper Based on Parallel Genetic Algorithm

The Design And Implementation For Automatic Evaluation System Of Virtual Experiment Report