The effect of multi-modality on listening comprehension and word retention:An empirical study

Qiu Donglin,Li Hongye
2010-01-01
Abstract:Based on Baddeley's model of working memory,this research makes a comparative study of the effect of audio-visual mode and audio mode on listening comprehension and word retention.Attention focalization and cognitive load of two groups (50 subjects) are studied during the listening process of a documentary video clip and a talkshow clip.The results show that both content visuals and context-only visuals can enhance general comprehension;however,they hinder retention of vocabulary and phonetic features in varying degrees.Further analysis of each question item reveals that pictures in both videos can direct and delegate attention to key linguistic features,with documentary pictures playing a more significant role than paralinguistic features in talkshows,whereas recalling and internalization of linguistic input without corresponding video hints are hindered.
What problem does this paper attempt to address?