Abstract
Movement Sonification is an audio-based intervention of interest to motor relearning. A prototype real-time movement sonification system for rehabilitating the paretic upper-limb has been developed at the University of Strathclyde. The system utilises an Azure Kinect SDK, to obtain the position of a selected hand, and co-ordinates were translated to audio pitch. Currently a study is underway to investigate whether users with a paretic upper-limb obtain a sense of agency with the system.
The study has currently recruited seven volunteers, with recruitment still ongoing. Each participant completed a consent form and subsequently a MoCA, and ARAT. Each volunteer sat at a table and performed reaching actions. 40 reaching trials were performed with 10 trials each of four different sound conditions, participants were informed that each sound condition partly comprised mapping hand position to audio pitch, as such hearing an increasing pitch as they extended and decreasing pitch as they contracted their reach. For three sound configurations, a pitch-modulating triangle wave component was added halfway during reach, with a variation in amplitude between each configuration. A demonstration of sound with highest amplitude modulation, and no modulation, was given prior to study commencement. Following each trial the participant rated their perceived audio-movement association on a seven-point Likert scale ranging from ‘Strongly Agree’ to ‘Strongly Disagree’.
Preliminary results show promise that users can associate system output with their reaching movements. Dependent on outcome, future work will look to evaluate feasibility of real-time movement sonification with this system or lead to further system development.
The study has currently recruited seven volunteers, with recruitment still ongoing. Each participant completed a consent form and subsequently a MoCA, and ARAT. Each volunteer sat at a table and performed reaching actions. 40 reaching trials were performed with 10 trials each of four different sound conditions, participants were informed that each sound condition partly comprised mapping hand position to audio pitch, as such hearing an increasing pitch as they extended and decreasing pitch as they contracted their reach. For three sound configurations, a pitch-modulating triangle wave component was added halfway during reach, with a variation in amplitude between each configuration. A demonstration of sound with highest amplitude modulation, and no modulation, was given prior to study commencement. Following each trial the participant rated their perceived audio-movement association on a seven-point Likert scale ranging from ‘Strongly Agree’ to ‘Strongly Disagree’.
Preliminary results show promise that users can associate system output with their reaching movements. Dependent on outcome, future work will look to evaluate feasibility of real-time movement sonification with this system or lead to further system development.
Original language | English |
---|---|
Publication status | Published - 9 Nov 2022 |
Event | Joint 2022 SRR & Scottish Stroke AHP Forum Winter Conference: Rehabilitation to Support Self-Management - Sir Jules Thorne Centre for Co-Creation of Rehabilitation Technology, University of Strathclyde, Glasgow, United Kingdom Duration: 9 Nov 2022 → 9 Nov 2022 |
Conference
Conference | Joint 2022 SRR & Scottish Stroke AHP Forum Winter Conference |
---|---|
Country/Territory | United Kingdom |
City | Glasgow |
Period | 9/11/22 → 9/11/22 |
Keywords
- movement sonification
- paretic upper-limb
- physical rehabilitation
Fingerprint
Dive into the research topics of 'Verifying a sense of agency with a real-time movement sonification system for stroke survivors with hemiparesis'. Together they form a unique fingerprint.Projects
-
Developing a Real-Time Movement Sonification System for Stroke Rehabilitation
Nown, T. (Principal Investigator)
Project: Research - Studentship