Improving conversational dynamics with reactive speech synthesis

Mateusz Dubiel, Martin Halvey, Leif Azzopardi, Matthew Aylett, Miriam Wester, David A. Braude

Research output: Contribution to conference › Paper

Abstract

The active exchange of ideas and/or information is a crucial feature of human-human conversation. Yet it is a skill that present-day ‘conversational’ interfaces are lacking, which effectively hampers the dynamics of interaction and makes it feel artificial. In this paper, we present a reactive speech synthesis system that can handle user’s interruptions. Initial results of evaluation of our interactive experiment indicate that participants prefer a reactive system to a non-reactive one. Based on participants’ feedback, we suggest potential applications for reactive speech synthesis systems (i.e. interactive tutor and adventure game) and propose further interactive user experiments to evaluate them. We anticipate that the reactive system can offer more engaging and dynamic interaction and improve user experience by making it feel more like a natural human-human conversation.
LanguageEnglish
Publication statusPublished - 22 Apr 2018
EventVoice-based Conversational UX Studies and Design Workshop - Montreal, Canada
Duration: 22 Apr 2018 → 22 Apr 2018
https://voiceux.wordpress.com/

Workshop

WorkshopVoice-based Conversational UX Studies and Design Workshop
CountryCanada
CityMontreal
Period22/04/18 → 22/04/18
Internet address

Fingerprint

Speech synthesis
Experiments
Feedback

Keywords

  • UX design
  • conversational agents
  • usability testing
  • human-computer interaction
  • reactive HCI
  • user interaction

Cite this

Dubiel, M., Halvey, M., Azzopardi, L., Aylett, M., Wester, M., & Braude, D. A. (2018). Improving conversational dynamics with reactive speech synthesis. Paper presented at Voice-based Conversational UX Studies and Design Workshop , Montreal, Canada.
Dubiel, Mateusz ; Halvey, Martin ; Azzopardi, Leif ; Aylett, Matthew ; Wester, Miriam ; Braude, David A. / Improving conversational dynamics with reactive speech synthesis. Paper presented at Voice-based Conversational UX Studies and Design Workshop , Montreal, Canada.
@conference{c57cce4ee4414d229f6ae81e5b990a78,
title = "Improving conversational dynamics with reactive speech synthesis",
abstract = "The active exchange of ideas and/or information is a crucial feature of human-human conversation. Yet it is a skill that present-day ‘conversational’ interfaces are lacking, which effectively hampers the dynamics of interaction and makes it feel artificial. In this paper, we present a reactive speech synthesis system that can handle user’s interruptions. Initial results of evaluation of our interactive experiment indicate that participants prefer a reactive system to a non-reactive one. Based on participants’ feedback, we suggest potential applications for reactive speech synthesis systems (i.e. interactive tutor and adventure game) and propose further interactive user experiments to evaluate them. We anticipate that the reactive system can offer more engaging and dynamic interaction and improve user experience by making it feel more like a natural human-human conversation.",
keywords = "UX design, conversational agents, usability testing, human-computer interaction, reactive HCI, user interaction",
author = "Mateusz Dubiel and Martin Halvey and Leif Azzopardi and Matthew Aylett and Miriam Wester and Braude, {David A.}",
note = "Voice-based Conversational UX Studies and Design Workshop. Held as part of the ACM CHI Conference on Human Factors in Computing Systems 2018, Montreal, Canada. ; Voice-based Conversational UX Studies and Design Workshop ; Conference date: 22-04-2018 Through 22-04-2018",
year = "2018",
month = "4",
day = "22",
language = "English",
url = "https://voiceux.wordpress.com/",

}

Dubiel, M, Halvey, M, Azzopardi, L, Aylett, M, Wester, M & Braude, DA 2018, 'Improving conversational dynamics with reactive speech synthesis' Paper presented at Voice-based Conversational UX Studies and Design Workshop , Montreal, Canada, 22/04/18 - 22/04/18, .

Improving conversational dynamics with reactive speech synthesis. / Dubiel, Mateusz; Halvey, Martin; Azzopardi, Leif; Aylett, Matthew; Wester, Miriam; Braude, David A.

2018. Paper presented at Voice-based Conversational UX Studies and Design Workshop , Montreal, Canada.

Research output: Contribution to conference › Paper

TY - CONF

T1 - Improving conversational dynamics with reactive speech synthesis

AU - Dubiel, Mateusz

AU - Halvey, Martin

AU - Azzopardi, Leif

AU - Aylett, Matthew

AU - Wester, Miriam

AU - Braude, David A.

N1 - Voice-based Conversational UX Studies and Design Workshop. Held as part of the ACM CHI Conference on Human Factors in Computing Systems 2018, Montreal, Canada.

PY - 2018/4/22

Y1 - 2018/4/22

N2 - The active exchange of ideas and/or information is a crucial feature of human-human conversation. Yet it is a skill that present-day ‘conversational’ interfaces are lacking, which effectively hampers the dynamics of interaction and makes it feel artificial. In this paper, we present a reactive speech synthesis system that can handle user’s interruptions. Initial results of evaluation of our interactive experiment indicate that participants prefer a reactive system to a non-reactive one. Based on participants’ feedback, we suggest potential applications for reactive speech synthesis systems (i.e. interactive tutor and adventure game) and propose further interactive user experiments to evaluate them. We anticipate that the reactive system can offer more engaging and dynamic interaction and improve user experience by making it feel more like a natural human-human conversation.

AB - The active exchange of ideas and/or information is a crucial feature of human-human conversation. Yet it is a skill that present-day ‘conversational’ interfaces are lacking, which effectively hampers the dynamics of interaction and makes it feel artificial. In this paper, we present a reactive speech synthesis system that can handle user’s interruptions. Initial results of evaluation of our interactive experiment indicate that participants prefer a reactive system to a non-reactive one. Based on participants’ feedback, we suggest potential applications for reactive speech synthesis systems (i.e. interactive tutor and adventure game) and propose further interactive user experiments to evaluate them. We anticipate that the reactive system can offer more engaging and dynamic interaction and improve user experience by making it feel more like a natural human-human conversation.

KW - UX design

KW - conversational agents

KW - usability testing

KW - human-computer interaction

KW - reactive HCI

KW - user interaction

M3 - Paper

ER -

Dubiel M, Halvey M, Azzopardi L, Aylett M, Wester M, Braude DA. Improving conversational dynamics with reactive speech synthesis. 2018. Paper presented at Voice-based Conversational UX Studies and Design Workshop , Montreal, Canada.

Access to Document