SATE: A Self-Attention Based Text Topic Extraction Mechanism for Customer Service Dialog System.

Ziqi Xu,Bo Cheng,Meng Niu
DOI: https://doi.org/10.1145/3587716.3587802
2023-01-01
Abstract:AI customer service system has been widely used in various industries. It is a research hotspot that accurately understanding customers’ intent and extracting key information from customer service dialogues. However, customer service dialog texts are short, specialized, and sparse. Those features lead to the poor performance of existing topic extraction mechanisms. This paper proposed a self-attention based topic extraction mechanism for customer service dialogue text, which is abbreviated as SATE. It consists of a corpus expansion model that can adaptively expand a suitable number of words based on words’ class and frequency. Then, SATE introduces the self-attention mechanism to train the corpus word vectors and mine their potential semantics. The self-attention mechanism can solve the semantic confusion caused by the polysemy of words in word expansion. Finally, SATE adopts the LDA topic model to extract topics of the expanded corpus. The experimental results show that the proposed SATE method can work better than the state-of-art methods.
What problem does this paper attempt to address?