Abstract:Abstract Long-term informal caregiving for older adults with dementia is exhausting and poses risks to caregivers’ health outcomes. Most informal caregivers are not well prepared for their new role, facing various challenges and receiving limited support. With the advent of artificial intelligence (AI) and information and communication technologies (ICTs), assistive technology is increasingly useful for supporting caregivers. However, limited research assesses the potential for AI to facilitate a privacy-preserving computation environment to provide proactive assistance to caregivers. This project aims to fill this gap by leveraging the tremendous potential of Multimodal Machine Learning and Large Language Models (LLMs) to develop a prototype of an AI-powered emotionally intelligent, interactive agent for informal caregivers. We introduce an effective context-driven instruction tuning technique that enables LLMs to finetune various caregiving-related tasks (tips generation, answering questions, elaborating a specific training module) with instructions. The project will also deliver a first-of-its-kind custom dataset augmented with manualized instructions for relevant caregiving tasks, which is used for finetuning several state-of-the-art LLM models. Our intelligent interactive agent prototype currently has the ability to evaluate caregivers’ unique affective states at query times to provide personalized assistance, addressing various types of caregivers’ situation-specific queries (e.g., managing agitation, wandering, or medications). The prototype is capable of understanding and responding to the user’s natural language queries and designing short, machine-driven persuasive conversations on a pre-defined set of topics. Our prototype has the potential to provide individualized and contextualized support for caregiving tasks which in turn may greatly reduce caregiver burden.

Telepathy Lamp: Remote Affective Interaction Based on Ambient Metaphor for Emotional Caring of the Elderly

Can Digital Technology Enhance Social Connectedness Among Older Adults? A Feasibility Study

Telepresence Lantern -- Designing an Immersive Video-Mediated Communication Device for Older Adults

Tangible Light: Back to Metaphor-Based Interaction

QianLi: A Modular System for Connecting Distant Family Members Through Tacit Interaction

Tech-care: designing remote-controlled interfaces for communication and interaction within Chinese family

Remote Care and Collaboration for Empty Nest Family: Smart Home, Digital Twin and Mixed Reality

"This really lets us see the entire world:" Designing a conversational telepresence robot for homebound older adults

Emotional Interaction between Artificial Companion Agents and the Elderly

From Collaborative Habituation to Everyday Togetherness: A Long-Term Study of Use of the Messaging Kettle

Design and Development of Dew: An Emotional Social-Interactive Robot.

Research on the Interactive System of Long-Distance Relationship for Elderly Users

Development and application of a communication robot to improve the emotional state of elderly living alone

Remote Assistance for Elderly to Find Hidden Objects in a Kitchen

Cultural Design Method on Multi-Sensor Technology Design: A Case of Interactive Lamp Design

DEVELOPMENT OF AN AI-POWERED EMOTIONALLY INTELLIGENT, INTERACTIVE AGENT PROTOTYPE TO SUPPORT INFORMAL CAREGIVERS

The EMPATHIC Project: Building an Expressive, Advanced Virtual Coach to Improve Independent Healthy-Life-Years of the Elderly

Affective Interaction Technology of Companion Robots for the Elderly: A Review

Integrating Care into Design: Addressing Emotional Isolation in Interactive Products for Empty Nesters

LiveNature

Design of a Gaze-Controlled Interactive Art System for the Elderly to Enjoy Life