Abstract:In human-centered design, developing a comprehensive and in-depth understanding of user experiences, i.e., empathic understanding, is paramount for designing products that truly meet human needs. Nevertheless, accurately comprehending the real underlying mental states of a large human population remains a significant challenge today. This difficulty mainly arises from the trade-off between depth and scale of user experience research: gaining in-depth insights from a small group of users does not easily scale to a larger population, and vice versa. This paper investigates the use of Large Language Models (LLMs) for performing mental inference tasks, specifically inferring users' underlying goals and fundamental psychological needs (FPNs). Baseline and benchmark datasets were collected from human users and designers to develop an empathic accuracy metric for measuring the mental inference performance of LLMs. The empathic accuracy of inferring goals and FPNs of different LLMs with varied zero-shot prompt engineering techniques are experimented against that of human designers. Experimental results suggest that LLMs can infer and understand the underlying goals and FPNs of users with performance comparable to that of human designers, suggesting a promising avenue for enhancing the scalability of empathic design approaches through the integration of advanced artificial intelligence technologies. This work has the potential to significantly augment the toolkit available to designers during human-centered design, enabling the development of both large-scale and in-depth understanding of users' experiences.

Sniff AI: Is My 'Spicy' Your 'Spicy'? Exploring LLM's Perceptual Alignment with Human Smell Experiences

Exploring Human-AI Perception Alignment in Sensory Experiences: Do LLMs Understand Textile Hand?

More than meets the AI: The possibilities and limits of machine learning in olfaction

Predicting human olfactory perception from chemical features of odor molecules

Unveiling aromas: Virtual reality and scent identification for sensory analysis

ScentClue: Enhancing Story Engagement in Virtual Reality Through Hedonically Varied Olfactory Hints

Data Science In Olfaction

Sniffing Like a Wine Taster: Multiple Overlapping Sniffs (MOSS) Strategy Enhances Electronic Nose Odor Recognition Capability

OlfacEnhancer: A Vision-Based Scented Necklace for Cross-Modal Perception and Olfaction Augmentation

Sniffing Like a Wine Taster: Multiple Overlapping Sniffs (MOSS) Strategy Enhances Electronic Nose Odor Recognition Capability (Adv. Sci. 7/2024)

Learning to smell for wellness

SensorLLM: Aligning Large Language Models with Motion Sensors for Human Activity Recognition

MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception

Integration of Animal Behavioral Assessment and Convolutional Neural Network to Study Wasabi-Alcohol Taste-Smell Interaction

Reading Users' Minds from What They Say: An Investigation into LLM-based Empathic Mental Inference

The Moral Turing Test: Evaluating Human-LLM Alignment in Moral Decision-Making

A Perceptual Model of Smellscape Pleasantness

Intelligent wearable olfactory interface for latency-free mixed reality and fast olfactory enhancement

OdorAgent: Generate Odor Sequences for Movies Based on Large Language Model

Understanding smellscapes: Sense-making of smell-triggered emotions in place

SurveyLM: A platform to explore emerging value perspectives in augmented language models' behaviors