Abstract:This article presents the development of a robot-integrated smart home (RiSH) which can be used for research in assistive technologies for elderly care. The RiSH integrates a home service robot, a home sensor network, a body sensor network, a mobile device, cloud servers, and remote caregivers. A layered architecture is proposed to guide the design and implementation of the RiSH software. Basic service functions are developed to allow the RiSH to recognize human body activity using an inertial measurement unit (IMU) and the home service robot to perceive the environment through audio signals. Based on these functions, we developed two low-level applications: (1) particle filter-based human localization and tracking using wearable motion sensors and distributed binary sensors; (2) Dynamic Bayesian Network-based human activity recognition using microphones and distributed binary sensors. Both applications extend the robot’s perception beyond its onboard sensors. Utilizing the low-level applications, a high-level application is realized that detects and responds to human falls. We conducted experiments in our RiSH testbed to evaluate auditory perception services, human body activity recognition, human position tracking, sound-based human activity monitoring, and fall detection and rescue. Twelve human subjects were asked to conduct daily activities in the testbed and mimic falls. All data of their movement, body activities, and sound events were collected by the robot. Human trajectories were estimated with a root mean square error of less than 0.2 m. The robot was able to recognize 37 human activities through sound events with an average accuracy of 88% and detect falling sounds with an accuracy of 80% at the frame level. The experiments show the operation of the various components in the RiSH and the capabilities of the home service robot in monitoring and assisting the resident.

Finding Misplaced Items Using a Mobile Robot in a Smart Home Environment.

Retrieval of Misplaced Items Using a Mobile Robot Via Visual Object Recognition

A Gait Recognition System for Interaction with a Homecare Mobile Robot

An IoT-Enabled Telerobotic-Assisted Healthcare System Based on Inertial Motion Capture.

Real-time Localization, Mapping and Navigation for Quadruped Robots

Efficient Active Sensing with Categorized Further Explorations for a Home Behavior-Monitoring Robot

Novel RFID and Ontology Based Home Localization System for Misplaced Objects

Passive Infrared (PIR)-Based Indoor Position Tracking for Smart Homes Using Accessibility Maps and A-Star Algorithm

Detecting More Objects Indoors: a Depth-guided Detector for Mobile Robots

Robot Path Planning for Human Search in Indoor Environments

Home Service Robot Location Based on AdaBoost and Haar-like Feature

Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Application of Intelligent Robot Based on Multi-sensor Control in Modern Home Life

A Smart Home Based on Multi-heterogeneous Robots and Sensor Networks for Elderly Care

Semantic Grounding for Long-Term Autonomy of Mobile Robots Towards Dynamic Object Search in Home Environments

Development of Robust Behaviour Recognition for an At-Home Biomonitoring Robot with Assistance of Subject Localization and Enhanced Visual Tracking.

Home localization system for misplaced objects

RiSH: A Robot-Integrated Smart Home for Elderly Care

Robot Semantic Mapping Through Human Activity Recognition: A Wearable Sensing and Computing Approach.

CamFi: an AI-driven and Camera-based System for Assisting Users in Finding Lost Objects in Multi-Person Scenarios

The Design and Implementation of a Mobile RFID Tag Sorting Robot