Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base

Yuchen Wang,Yin-Shan Lin,Ruixin Huang,Jinyin Wang,Sensen Liu

DOI: https://doi.org/10.59400/cai.v2i1.535

2024-05-19

Abstract:This paper begins with a theoretical exploration of the rise of large language models (LLMs) in Human-Computer Interaction (HCI), their impact on user experience (HX), and related challenges. It then discusses the benefits of Human-Centered Design (HCD) principles and the possibility of their application within LLMs, subsequently deriving six specific HCD guidelines for LLMs. Following this, a preliminary experiment is presented as an example to demonstrate how HCD principles can be employed to enhance user experience within GPT by using a single document input to GPT's Knowledge base as a new knowledge resource to control the interactions between GPT and users, aiming to meet the diverse needs of hypothetical software learners as much as possible. The experimental results demonstrate the effect of different elements' forms and organizational methods in the document, as well as GPT's relevant configurations, on the interaction effectiveness between GPT and software learners. A series of trials are conducted to explore better methods to realize text and image displaying, and jump action. Two template documents are compared in the aspects of the performances of the four interaction modes. Through continuous optimization, an improved version of the document was obtained to serve as a template for future use and research.

Human-Computer Interaction

What problem does this paper attempt to address?

The paper explores the impact and challenges of large language models (LLMs) on user experience (UX) in human-computer interaction (HCI), and proposes improving UX through human-centered design (HCD) principles. The authors first analyze the rise of LLMs in HCI, their impact on UX, and the challenges they face. Then, the paper discusses the benefits of HCD and proposes six HCD guidelines for LLMs. Through a preliminary experiment, the study demonstrates how to improve the user experience of GPT through HCD principles by controlling the interaction between GPT and users through a single document knowledge base to meet the needs of different software learners. The experiment results show that the form and organization of elements in the document, as well as the configuration of GPT, have an impact on the interaction effect. It also explores better methods for displaying text and images, as well as navigation operations. Finally, through continuous optimization, an improved document template is obtained, providing a basis for future research and usage. The paper also emphasizes the ethical considerations and technical complexity issues that LLMs face in terms of UX, as well as the potential of HCD in addressing these problems.

Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base

Understanding User Experience in Large Language Model Interactions

Task Supportive and Personalized Human-Large Language Model Interaction: A User Study

How Can Large Language Models Help Humans in Design and Manufacturing?

Challenges and Contributing Factors in the Utilization of Large Language Models (LLMs)

Contextualizing Problems to Student Interests at Scale in Intelligent Tutoring System Using Large Language Models

Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

Supervised Knowledge Makes Large Language Models Better In-context Learners

Large Language Models Meet User Interfaces: The Case of Provisioning Feedback

Understanding Large-Language Model (LLM)-powered Human-Robot Interaction

Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understanding

DB-GPT: Empowering Database Interactions with Private Large Language Models

KnowledGPT: Enhancing Large Language Models with Retrieval and Storage Access on Knowledge Bases

Human-in-the-loop Machine Translation with Large Language Model

Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements

CourseGPT-zh: an Educational Large Language Model Based on Knowledge Distillation Incorporating Prompt Optimization

Scaling Evidence-based Instructional Design Expertise through Large Language Models

Self-Evolving GPT: A Lifelong Autonomous Experiential Learner

Synergizing Human Expertise and AI Efficiency with Language Model for Microscopy Operation and Automated Experiment Design

Optimizing Multi-Task Learning for Enhanced Performance in Large Language Models

The Future of Learning: Large Language Models through the Lens of Students