A Multimodal System for Empathy Expression: Impact of Haptic and Auditory Stimuli

Guo, Jingru; Ishiguro, Hiroshi; Sumioka, Hidenobu

Conference on Human Factors in Computing Systems - Proceedings, 2025, 44

Number of Access:155（2025-10-25 01:40 Counts）

Identifier to cite or link to this item: https://hdl.handle.net/11094/101961

Link to primary information 

File Format Terms of use Size Views Date.Available Description information
ConfHumFactComputSystProc pdf None 10.4 MB 20 2025.06.18  

Item Information

Output File Export EndNote Basic Export Mendeley

Title
A Multimodal System for Empathy Expression: Impact of Haptic and Auditory Stimuli
Creator
ORCID
0009-0001-9830-0436 0009-0001-9830-0436
CreatorName
Guo, Jingru
NRID
1000010232282 1000010232282
ORCID
0000-0002-0805-7648 0000-0002-0805-7648
researchmap permalink
read0013747 read0013747
Scopus Author ID
26643316500 26643316500
CreatorName
Ishiguro, Hiroshi
NRID
1000080636423 1000080636423
ORCID
0000-0003-1511-9525 0000-0003-1511-9525
CreatorName
Sumioka, Hidenobu
Subject
empathy expression
haptic and auditory interaction
huggable multimodal system
interaction design
user studies
Description
Guo J., Ishiguro H., Sumioka H.. A Multimodal System for Empathy Expression: Impact of Haptic and Auditory Stimuli. Conference on Human Factors in Computing Systems - Proceedings , 44 (2025); https://doi.org/10.1145/3706599.3719823.
Abstract
Empathy plays a crucial role in Human-Robot Interaction (HRI), enhancing emotional transmission and interaction experiences while breaking psychological barriers. Although many HRI systems focus on empathy expression, few have investigated the combined effects of spatial haptic parameters and auditory cues on emotional and cognitive empathy. To address this gap, we developed a multimodal HRI system based on a huggable robot. It is integrated with spatial haptic patterns and auditory cues. Two exploratory experiments were conducted to evaluate the effectiveness of these parameters in emotional transmission and cognitive support. Results revealed that spatial haptic parameters primarily influenced arousal, while music significantly impacted valence. Synergistic effects between haptic and auditory modalities were observed under specific conditions. For cognitive support, participants preferred vibration combined with voice over voice-only feedback, while random haptic paths performed poorly across the cognitive dimensions. These findings suggest the potential of multimodal feedback in improving empathetic HRI systems.
Conference Information
Conference Name
CHI 2025
Conference Date
April 26-May 1, 2025
Conference Venue
PACIFICO Yokohama
Conference Place
Yokohama
Conference Country
Japan
Publisher
Association for Computing Machinery
Source Title
Conference on Human Factors in Computing Systems - Proceedings
Page
44
Date of Issued
2025-04-26
Language
English
Handle URL
https://hdl.handle.net/11094/101961
Relation.isVersionOf
DOI (Publisher Version)
https://doi.org/10.1145/3706599.3719823
Access Rights
open access
CopyRight
© Authors 2025. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Proceedings of Conference on Human Factors in Computing Systems 2025, https://doi.org/10.1145/3706599.3719823.
oaire:version
Accepted Manuscript
Category
会議発表論文 Conference Paper