How Generative-AI can be Effectively used in Government Chatbots

Zeteng Lin

2023-11-29

Abstract:With the rapid development of artificial intelligence and breakthroughs in machine learning and natural language processing, intelligent question-answering robots have become widely used in government affairs. This paper conducts a horizontal comparison between Guangdong Province's government chatbots, ChatGPT, and Wenxin Ernie, two large language models, to analyze the strengths and weaknesses of existing government chatbots and AIGC technology. The study finds significant differences between government chatbots and large language models. China's government chatbots are still in an exploratory stage and have a gap to close to achieve "intelligence." To explore the future direction of government chatbots more deeply, this research proposes targeted optimization paths to help generative AI be effectively applied in government chatbot conversations.

Computation and Language,Artificial Intelligence,Machine Learning,General Economics

What problem does this paper attempt to address?

The paper primarily explores how to apply advanced Artificial Intelligence Generated Content (AIGC) technology to government service chatbots and proposes some specific optimization directions.

The paper first introduces the concept of Generative Artificial Intelligence (AIGC) and its applications in different fields, especially its potential in government services. Subsequently, the paper evaluates the advantages and disadvantages of existing government chatbots by comparing and analyzing the Guangdong government chatbot, ChatGPT, and Ernie (Wenxin Yiyan), among other large language models. The study finds that chatbots used by Chinese government departments are still in the exploratory stage and lag behind mature large language models.

To further explore the future development direction of government chatbots, the paper designs a series of experiments, including the application of natural language processing techniques such as text analysis, metric evaluation, and joint experiments on the aforementioned models. In the experiments, researchers input a series of procedural and complex questions into these models and conducted preliminary analyses of the models' responses, such as similarity analysis and sentiment analysis.

Through these analyses, the paper draws several key conclusions:
- In terms of thematic analysis, both Ernie and ChatGPT provide responses with clear informativeness and guidance.
- Similarity analysis shows that the average similarity calculated using the BERT model is relatively high, indicating that the responses of the two models are semantically close.
- Responsibility analysis indicates that Ernie's responses perform better in sentence depth and the proportion of complex words, showing stronger responsibility; while ChatGPT's responses slightly outperform in terms of sentence quantity and the use of complex words.
- Sentiment analysis results show that both Ernie and ChatGPT tend to use encouraging language or express positive emotions in their responses.

In summary, the paper aims to explore how to effectively integrate AIGC technology into government service chatbots through comparative experiments to improve service quality and efficiency. Finally, the paper proposes a scoring system based on three dimensions: responsibility, communication ability, and user-friendliness, to further promote the application and development of intelligent Q&A robots in government services.