Verifying a sense of agency with a real-time movement sonification system for stroke survivors with hemiparesis

Research output: Contribution to conferencePoster


Movement Sonification is an audio-based intervention of interest to motor relearning. A prototype real-time movement sonification system for rehabilitating the paretic upper-limb has been developed at the University of Strathclyde. The system utilises an Azure Kinect SDK, to obtain the position of a selected hand, and co-ordinates were translated to audio pitch. Currently a study is underway to investigate whether users with a paretic upper-limb obtain a sense of agency with the system.
The study has currently recruited seven volunteers, with recruitment still ongoing. Each participant completed a consent form and subsequently a MoCA, and ARAT. Each volunteer sat at a table and performed reaching actions. 40 reaching trials were performed with 10 trials each of four different sound conditions, participants were informed that each sound condition partly comprised mapping hand position to audio pitch, as such hearing an increasing pitch as they extended and decreasing pitch as they contracted their reach. For three sound configurations, a pitch-modulating triangle wave component was added halfway during reach, with a variation in amplitude between each configuration. A demonstration of sound with highest amplitude modulation, and no modulation, was given prior to study commencement. Following each trial the participant rated their perceived audio-movement association on a seven-point Likert scale ranging from ‘Strongly Agree’ to ‘Strongly Disagree’.
Preliminary results show promise that users can associate system output with their reaching movements. Dependent on outcome, future work will look to evaluate feasibility of real-time movement sonification with this system or lead to further system development.
Original languageEnglish
Publication statusPublished - 9 Nov 2022
EventJoint 2022 SRR & Scottish Stroke AHP Forum Winter Conference: Rehabilitation to Support Self-Management - Sir Jules Thorne Centre for Co-Creation of Rehabilitation Technology, University of Strathclyde, Glasgow, United Kingdom
Duration: 9 Nov 20229 Nov 2022


ConferenceJoint 2022 SRR & Scottish Stroke AHP Forum Winter Conference
Country/TerritoryUnited Kingdom


  • movement sonification
  • paretic upper-limb
  • physical rehabilitation


Dive into the research topics of 'Verifying a sense of agency with a real-time movement sonification system for stroke survivors with hemiparesis'. Together they form a unique fingerprint.

Cite this