Systematic literature review of hand gestures used in human computer interaction interfaces

Tijana Vuletic, Alex Duffy, Laura Hay, Chris McTeague, Gerard Campbell, Madeleine Grealy

Research output: Contribution to journalArticlepeer-review

151 Citations (Scopus)
105 Downloads (Pure)

Abstract

Gestures, widely accepted as a humans' natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence.
Original languageEnglish
Pages (from-to)74-94
Number of pages21
JournalInternational Journal of Human Computer Studies
Volume129
Early online date30 Mar 2019
DOIs
Publication statusPublished - 30 Sept 2019

Keywords

  • human computer interfaces
  • hand gestures
  • touchless gestures
  • in-air gestures
  • gesture elicitation
  • framework

Fingerprint

Dive into the research topics of 'Systematic literature review of hand gestures used in human computer interaction interfaces'. Together they form a unique fingerprint.
  • Curiosity Live

    Duffy, A. (Participant), Grealy, M. (Participant), McTeague, C. (Participant), Campbell, G. (Participant) & Hay, L. (Participant)

    6 Nov 20199 Nov 2019

    Activity: Participating in or organising an event typesParticipation in workshop, seminar, course

Cite this