Multi-Moji: Combining thermal, vibrotactile & visual stimuli to expand the affective range of feedback

Graham Wilson, Stephen A. Brewster

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

57 Citations (Scopus)
14 Downloads (Pure)

Abstract

This paper explores the combination of multiple concurrent modalities for conveying emotional information in HCI: temperature, vibration and abstract visual displays. Each modality has been studied individually, but can only convey a limited range of emotions within two-dimensional valence-arousal space. This paper is the first to systematically combine multiple modalities to expand the available affective range. Three studies were conducted: Study 1 measured the emotionality of vibrotactile feedback by itself; Study 2 measured the perceived emotional content of three bimodal combinations: vibrotactile + thermal, vibrotactile + visual and visual + thermal. Study 3 then combined all three modalities. Results show that combining modalities increases the available range of emotional states, particularly in the problematic top-right and bottom-left quadrants of the dimensional model. We also provide a novel lookup resource for designers to identify stimuli to convey a range of emotions.

Original languageEnglish
Title of host publicationCHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems
Subtitle of host publicationExplore, Innovate, Inspire
Place of PublicationNew York, NY.
Pages1743-1755
Number of pages13
ISBN (Electronic)9781450346559
DOIs
Publication statusPublished - 2 May 2017
Event2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017 - Denver, United States
Duration: 6 May 201711 May 2017

Publication series

NameConference on Human Factors in Computing Systems - Proceedings
Volume2017-May

Conference

Conference2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017
Country/TerritoryUnited States
CityDenver
Period6/05/1711/05/17

Keywords

  • emotion
  • thermal feedback
  • vibration
  • visual feedback
  • human-computer interaction
  • HCI

Fingerprint

Dive into the research topics of 'Multi-Moji: Combining thermal, vibrotactile & visual stimuli to expand the affective range of feedback'. Together they form a unique fingerprint.

Cite this