Yawn analysis with mouth occlusion detection

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

One of the most common signs of tiredness or fatigue is yawning. Naturally, identification of fatigued individuals would be helped if yawning is detected. Existing techniques for yawn detection are centred on measuring the mouth opening. This approach, however, may fail if the mouth is occluded by the hand, as it is frequently the case. The work presented in this paper focuses on a technique to detect yawning whilst also allowing for cases of occlusion. For measuring the mouth opening, a new technique which applies adaptive colour region is introduced. For detecting yawning whilst the mouth is occluded, Local Binary Pattern (LBP) features are used to also identify facial distortions during yawning. In this research, the Strathclyde Facial Fatigue (SFF) database which contains genuine video footage of fatigued individuals is used for training, testing and evaluation of the system.
LanguageEnglish
Pages360-369
Number of pages10
JournalBiomedical Signal Processing and Control
Volume18
Early online date6 Mar 2015
DOIs
Publication statusPublished - 1 Apr 2015

Fingerprint

Yawning
Mouth
Fatigue of materials
Fatigue
Color
Testing
Hand
Databases
Research

Keywords

  • yawning
  • fatigue
  • mouth opening
  • Local Binary Pattern (LBP)
  • Strathclyde Facial Fatigue (SFF)
  • occlusion

Cite this

@article{b3b3056968664d0cb45d19d5eb66d6df,
title = "Yawn analysis with mouth occlusion detection",
abstract = "One of the most common signs of tiredness or fatigue is yawning. Naturally, identification of fatigued individuals would be helped if yawning is detected. Existing techniques for yawn detection are centred on measuring the mouth opening. This approach, however, may fail if the mouth is occluded by the hand, as it is frequently the case. The work presented in this paper focuses on a technique to detect yawning whilst also allowing for cases of occlusion. For measuring the mouth opening, a new technique which applies adaptive colour region is introduced. For detecting yawning whilst the mouth is occluded, Local Binary Pattern (LBP) features are used to also identify facial distortions during yawning. In this research, the Strathclyde Facial Fatigue (SFF) database which contains genuine video footage of fatigued individuals is used for training, testing and evaluation of the system.",
keywords = "yawning, fatigue, mouth opening, Local Binary Pattern (LBP), Strathclyde Facial Fatigue (SFF), occlusion",
author = "{Mat Ibrahim}, Masrullizam and Soraghan, {John J.} and Lykourgos Petropoulakis and {Di Caterina}, Gaetano",
year = "2015",
month = "4",
day = "1",
doi = "10.1016/j.bspc.2015.02.006",
language = "English",
volume = "18",
pages = "360--369",
journal = "Biomedical Signal Processing and Control",
issn = "1746-8094",

}

Yawn analysis with mouth occlusion detection. / Mat Ibrahim, Masrullizam; Soraghan, John J.; Petropoulakis, Lykourgos; Di Caterina, Gaetano.

In: Biomedical Signal Processing and Control, Vol. 18, 01.04.2015, p. 360-369.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Yawn analysis with mouth occlusion detection

AU - Mat Ibrahim, Masrullizam

AU - Soraghan, John J.

AU - Petropoulakis, Lykourgos

AU - Di Caterina, Gaetano

PY - 2015/4/1

Y1 - 2015/4/1

N2 - One of the most common signs of tiredness or fatigue is yawning. Naturally, identification of fatigued individuals would be helped if yawning is detected. Existing techniques for yawn detection are centred on measuring the mouth opening. This approach, however, may fail if the mouth is occluded by the hand, as it is frequently the case. The work presented in this paper focuses on a technique to detect yawning whilst also allowing for cases of occlusion. For measuring the mouth opening, a new technique which applies adaptive colour region is introduced. For detecting yawning whilst the mouth is occluded, Local Binary Pattern (LBP) features are used to also identify facial distortions during yawning. In this research, the Strathclyde Facial Fatigue (SFF) database which contains genuine video footage of fatigued individuals is used for training, testing and evaluation of the system.

AB - One of the most common signs of tiredness or fatigue is yawning. Naturally, identification of fatigued individuals would be helped if yawning is detected. Existing techniques for yawn detection are centred on measuring the mouth opening. This approach, however, may fail if the mouth is occluded by the hand, as it is frequently the case. The work presented in this paper focuses on a technique to detect yawning whilst also allowing for cases of occlusion. For measuring the mouth opening, a new technique which applies adaptive colour region is introduced. For detecting yawning whilst the mouth is occluded, Local Binary Pattern (LBP) features are used to also identify facial distortions during yawning. In this research, the Strathclyde Facial Fatigue (SFF) database which contains genuine video footage of fatigued individuals is used for training, testing and evaluation of the system.

KW - yawning

KW - fatigue

KW - mouth opening

KW - Local Binary Pattern (LBP)

KW - Strathclyde Facial Fatigue (SFF)

KW - occlusion

UR - http://www.sciencedirect.com/science/journal/17468094

U2 - 10.1016/j.bspc.2015.02.006

DO - 10.1016/j.bspc.2015.02.006

M3 - Article

VL - 18

SP - 360

EP - 369

JO - Biomedical Signal Processing and Control

T2 - Biomedical Signal Processing and Control

JF - Biomedical Signal Processing and Control

SN - 1746-8094

ER -