Intelligent Interface: Enhancing Lecture Engagement with Didactic Activity Summaries

Anna Wróblewska,Marcel Witas,Kinga Frańczak,Arkadiusz Kniaź,Siew Ann Cheong,Tan Seng Chee,Janusz Hołyst,Marcin Paprzycki

2024-06-20

Abstract:Recently, multiple applications of machine learning have been introduced. They include various possibilities arising when image analysis methods are applied to, broadly understood, video streams. In this context, a novel tool, developed for academic educators to enhance the teaching process by automating, summarizing, and offering prompt feedback on conducting lectures, has been developed. The implemented prototype utilizes machine learning-based techniques to recognise selected didactic and behavioural teachers' features within lecture video recordings. Specifically, users (teachers) can upload their lecture videos, which are preprocessed and analysed using machine learning models. Next, users can view summaries of recognized didactic features through interactive charts and tables. Additionally, stored ML-based prediction results support comparisons between lectures based on their didactic content. In the developed application text-based models trained on lecture transcriptions, with enhancements to the transcription quality, by adopting an automatic speech recognition solution are applied. Furthermore, the system offers flexibility for (future) integration of new/additional machine-learning models and software modules for image and video analysis.

Artificial Intelligence,Human-Computer Interaction

What problem does this paper attempt to address?

The problem that this paper aims to solve is how to use existing machine - learning methods to design a system that can take lecture videos as input and output a set of improvement suggestions for teachers. Specifically, the paper focuses on enhancing the academic lecture process through automation, summarization, and providing rapid feedback, especially concentrating on lecturers' teaching behaviors and other techniques that can be used to visualize lecture topics.

To achieve this goal, the work described in the paper mainly focuses on the following aspects:

1. **Determining teaching features that can be automatically annotated and detected**: Researchers first defined a set of teaching features that can be automatically detected in lecture videos.
2. **Collecting a data set containing selected features**: Next, they collected a data set of lecture videos containing these selected teaching features.
3. **Designing a deep - learning model for identifying selected teaching features**: Finally, a series of deep - learning models were designed, and these models were trained to identify the selected teaching features present in the collected data set.

Through the above steps, this research hopes to develop a tool that can help teachers obtain objective evaluation feedback on their teaching styles and effects, thereby promoting the improvement of teaching quality and student participation.