Systematic literature review of hand gestures used in human computer interaction interfaces

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Gestures, widely accepted as a humans' natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence.
LanguageEnglish
Pages74-94
Number of pages21
JournalInternational Journal of Human Computer Studies
Volume129
Early online date30 Mar 2019
DOIs
Publication statusPublished - 30 Sep 2019

Fingerprint

Human computer interaction
Interfaces (computer)
interaction
Air
literature
engineering science
science
maturity
village
air
engineering

Keywords

  • human computer interfaces
  • hand gestures
  • touchless gestures
  • in-air gestures
  • gesture elicitation
  • framework

Cite this

@article{310a276ab6cb4a03b2b5e14f49693f9b,
title = "Systematic literature review of hand gestures used in human computer interaction interfaces",
abstract = "Gestures, widely accepted as a humans' natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence.",
keywords = "human computer interfaces, hand gestures, touchless gestures, in-air gestures, gesture elicitation, framework",
author = "Tijana Vuletic and Alex Duffy and Laura Hay and Chris McTeague and Gerard Campbell and Madeleine Grealy",
year = "2019",
month = "9",
day = "30",
doi = "10.1016/j.ijhcs.2019.03.011",
language = "English",
volume = "129",
pages = "74--94",
journal = "International Journal of Human Computer Studies",
issn = "1071-5819",

}

TY - JOUR

T1 - Systematic literature review of hand gestures used in human computer interaction interfaces

AU - Vuletic, Tijana

AU - Duffy, Alex

AU - Hay, Laura

AU - McTeague, Chris

AU - Campbell, Gerard

AU - Grealy, Madeleine

PY - 2019/9/30

Y1 - 2019/9/30

N2 - Gestures, widely accepted as a humans' natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence.

AB - Gestures, widely accepted as a humans' natural mode of interaction with their surroundings, have been considered for use in human-computer based interfaces since the early 1980s. They have been explored and implemented, with a range of success and maturity levels, in a variety of fields, facilitated by a multitude of technologies. Underpinning gesture theory however focuses on gestures performed simultaneously with speech, and majority of gesture based interfaces are supported by other modes of interaction. This article reports the results of a systematic review undertaken to identify characteristics of touchless/in-air hand gestures used in interaction interfaces. 148 articles were reviewed reporting on gesture-based interaction interfaces, identified through searching engineering and science databases (Engineering Village, Pro Quest, Science Direct, Scopus and Web of Science). The goal of the review was to map the field of gesture-based interfaces, investigate the patterns in gesture use, and identify common combinations of gestures for different combinations of applications and technologies. From the review, the community seems disparate with little evidence of building upon prior work and a fundamental framework of gesture-based interaction is not evident. However, the findings can help inform future developments and provide valuable information about the benefits and drawbacks of different approaches. It was further found that the nature and appropriateness of gestures used was not a primary factor in gesture elicitation when designing gesture based systems, and that ease of technology implementation often took precedence.

KW - human computer interfaces

KW - hand gestures

KW - touchless gestures

KW - in-air gestures

KW - gesture elicitation

KW - framework

UR - https://www.sciencedirect.com/journal/international-journal-of-human-computer-studies

U2 - 10.1016/j.ijhcs.2019.03.011

DO - 10.1016/j.ijhcs.2019.03.011

M3 - Article

VL - 129

SP - 74

EP - 94

JO - International Journal of Human Computer Studies

T2 - International Journal of Human Computer Studies

JF - International Journal of Human Computer Studies

SN - 1071-5819

ER -