Scoring method of English composition integrating deep learning in higher vocational colleges

Shuo Feng,Lixia Yu,Fen Liu
DOI: https://doi.org/10.1038/s41598-024-57419-x
IF: 4.6
2024-03-29
Scientific Reports
Abstract:Along with the progress of natural language processing technology and deep learning, the subjectivity, slow feedback, and long grading time of traditional English essay grading have been addressed. Intelligent English automatic scoring has been widely concerned by scholars. Given the limitations of topic relevance feature extraction methods and traditional automatic grading methods for English compositions, a topic decision model is proposed to calculate the topic relevance score of the topic richness in English composition. Then, based on the Score of Relevance Based on Topic Richness (TRSR) calculation method, an intelligent English composition scoring method combining artificial feature extraction and deep learning is designed. From the findings, the Topic Decision (TD) model achieved the best effect only when it was iterated 80 times. The corresponding accuracy, recall and F1 value were 0.97, 0.93 and 0.95 respectively. The model training loss finally stabilized at 0.03. The Intelligent English Composition Grading Method Integrating Deep Learning (DLIECG) method has the best overall performance and the best performance on dataset P. To sum up, the intelligent English composition scoring method has better effectiveness and reliability.
multidisciplinary sciences
What problem does this paper attempt to address?
The paper attempts to address the issues of subjectivity, slow feedback, and long grading times in traditional English essay scoring. Specifically, the authors propose a Topic Richness-based Relevance Scoring method (TRSR) and an intelligent English essay grading method (DLIECG) that combines manual feature extraction with deep learning to improve the objectivity and efficiency of grading. ### Background Issues 1. **Subjectivity**: Traditional manual grading is easily influenced by the subjective factors of teachers, leading to inconsistent grading standards. 2. **Slow Feedback**: Due to the large number of students, it is difficult for teachers to provide detailed feedback on each student's essay in a timely manner. 3. **Long Grading Time**: Manual grading requires a significant amount of time, especially in large-scale exams, resulting in low grading efficiency. ### Solutions 1. **TRSR Model**: This model is used to calculate the topic relevance score of English essays by extracting topic richness features to evaluate the quality of the essays. 2. **DLIECG Method**: This method combines manual feature extraction and deep learning techniques to achieve more objective and efficient intelligent grading. ### Experimental Results - **TD Model**: The model achieved the best results after 80 iterations, with accuracy, recall, and F1 scores of 0.97, 0.93, and 0.95, respectively. The model training loss finally stabilized at 0.03. - **Performance Comparison**: Compared to the traditional RNN model, the TD model performed better in terms of accuracy and F1 score, reaching 97.83% and 95.36%, respectively, while the RNN model's accuracy and F1 score were 92.16% and 90.67%, respectively. ### Conclusion By introducing deep learning and manual feature extraction methods, the proposed method in the paper demonstrates excellent performance in improving the objectivity and efficiency of English essay grading, showing good practical application prospects.