Abstract:Automatic psychological counseling requires mass of professional knowledge that can be found in online counseling forums. Motivated by this, we propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system, transferring forum knowledge to response generation. We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q\&A forum. Experiment results show that the proposed method outperforms existing baselines on both automatic evaluation and human evaluation, which shows that our approach significantly improves the correlation and diversity of responses and provides more comfort and better suggestion for the seeker.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively inject professional emotional support knowledge in automatic psychological counseling services to improve the response quality and diversity of the dialogue system. Specifically:
1. **Lack of professional data**: Psychological counseling services require a large amount of professional knowledge, but the existing psychological counseling data is scarce, making it difficult to fully train the model.
2. **High professionalism requirements**: Different from general dialogue systems, psychological counseling services require more professional background knowledge, and the existing pre - trained language models (PLMs) have limited performance in this regard.
To solve these problems, the author proposes K - ESConv, a knowledge injection method based on prompt learning, aiming to integrate the knowledge in online psychological counseling forums into the emotional support dialogue system, so as to generate more professional and targeted responses.
### Main contributions
- **Knowledge injection**: By retrieving and integrating knowledge from external professional emotional Q&A forums, the response quality of the dialogue system is improved.
- **Prompt learning**: Using the prompt learning mechanism, the model can better understand and utilize context information and external knowledge.
- **Experimental verification**: Experiments were carried out on the ESConv dataset, and the results show that K - ESConv is superior to the existing baseline models in both automatic evaluation and manual evaluation, especially in the relevance and diversity of responses.
### Formula representation
The formulas involved in this paper are mainly used to describe the model structure and optimization process. The following is the Markdown - format representation of the key formulas:
1. **Prompt encoding optimization**:
\[
s_i^k=\text{MLP}(\text{KPE}(k_1,k_2,\dots,k_K,p_i^k))
\]
\[
s_i^c = \text{MLP}(\text{CPE}(x_1,x_2,\dots,x_N,p_i^c))
\]
2. **Prompt combination**:
\[
[\mathbf{s}_k,\mathbf{s}_c]=[\mathbf{s}_k^1,\mathbf{s}_k^2,\dots,\mathbf{s}_k^d,\mathbf{s}_c^1,\mathbf{s}_c^2,\dots,\mathbf{s}_c^{d'}]
\]
These formulas ensure that the model can effectively combine context and knowledge to generate high - quality responses.