Hardware accelerated image processing to enable real-time adaptive radiotherapy

Fraser Robinson, Louise Crockett, Bill Nailon, Bob Stewart, Duncan McLaren

Research output: Contribution to conferencePoster

Abstract

The accuracy of radiotherapy is constrained by organ motion and deformation occurring between the acquisition of CT and MR images used to plan the treatment and the time at which the treatment is delivered. Adaptive radiotherapy uses image data acquired at the time of treatment to adapt the original treatment plan to match the current patient anatomy. Currently, the image processing and dose calculation algorithms required to perform this plan adaptation cannot be executed in a clinically acceptable timeframe. Hardware acceleration has the potential to speedup these algorithms, making real-time adaptive radiotherapy a clinical possibility[1]. Hardware acceleration is a technique where an algorithm is implemented using hardware that is better suited to the specific algorithm than more general purpose processors in order to reduce the execution time of the algorithm. This can be achieved using field programmable gate arrays (FPGA), which are devices consisting of reconfigurable hardware, allowing their function to be customised for a specific application. These devices have been shown to be able to accelerate image processing algorithms pertinent to adaptive radiotherapy[2]. In this study a global thresholding algorithm based on Otsu’s method combined with a three dimensional mean filter was used to segment a series of CT images of a Modus QUASAR respiratory motion phantom into three unique classes. A Xilinx Zynq Z-7020 device consisting of a dual-core ARM Cortex-A9 central processing unit (CPU) coupled to an 85 000 logic cell FPGA was used to accelerate the algorithm by implementing sections of it in the reconfigurable hardware. The execution time of this implementation was compared to an implementation running on an ARM CPU and Intel Core-i5 CPU. The execution times of the implementations are shown in table 1. The hardware accelerated implementation was found to execute nearly sixty times as fast as the un-accelerated algorithm. The hardware accelerated implementation was also found to run around 14% faster than on the more powerful Intel Core-i5 CPU. Figure 1 shows an example of the segmentation results where the blue contour represents the boundary between two of the classes. In the algorithms presented here the overhead of transferring data to the hardware represents a significant proportion of the algorithm execution time. It is anticipated that greater acceleration will be possible for algorithms with greater computational complexity because the data transfer overhead will represent a smaller proportion of the overall execution time. The requirement for fast processing in radiotherapy is likely to increase as the amount of data available to more accurately guide treatment increases through the use of techniques such as 4D CT and image-guided radiotherapy. FPGA have been shown to be effective at accelerating certain algorithms required for real-time adaptive radiotherapy, however, more research is required to establish which will execute faster on other types of hardware, such as CPU and graphical processing units (GPU). It is likely that heterogeneous computing platforms, composed of a mixture of hardware architectures, will be used in the future implementation of real-time adaptive radiotherapy. References: 1.K. Østergaard Noe, B.D. De Senneville, U.V. Elstrøm, K. Tanderup, T.S. Sørensen, “Acceleration and validation of optical flow based deformable registration for image-guided radiotherapy,” Acta Oncologica, vol. 47, no. 7, pp.1286-1293, 2008 2.O. Dandekar, R. Shekhar, “FPGA-Accelerated Deformable Image Registration for Improved Target-Delineation During CT-Guided Interventions,” IEEE Trans. Biomed. Circuits Syst., vol. 1, no. 2, pp.116-127, 2007

Conference

ConferenceThe Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025
CountryUnited Kingdom
CityLondon
Period19/05/1619/05/16

Fingerprint

Radiotherapy
Image processing
Hardware
Program processors
Field programmable gate arrays (FPGA)
Reconfigurable hardware
Optical flows
Image registration
Data transfer
Processing
Computer hardware
Computational complexity

Keywords

  • FPGA
  • hardware acceleration
  • image processing
  • adaptive radiotherapy

Cite this

Robinson, F., Crockett, L., Nailon, B., Stewart, B., & McLaren, D. (2016). Hardware accelerated image processing to enable real-time adaptive radiotherapy. Poster session presented at The Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025, London, United Kingdom.
Robinson, Fraser ; Crockett, Louise ; Nailon, Bill ; Stewart, Bob ; McLaren, Duncan. / Hardware accelerated image processing to enable real-time adaptive radiotherapy. Poster session presented at The Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025, London, United Kingdom.
@conference{5dc3bdd1d4234ff58a5f51933c80db59,
title = "Hardware accelerated image processing to enable real-time adaptive radiotherapy",
abstract = "The accuracy of radiotherapy is constrained by organ motion and deformation occurring between the acquisition of CT and MR images used to plan the treatment and the time at which the treatment is delivered. Adaptive radiotherapy uses image data acquired at the time of treatment to adapt the original treatment plan to match the current patient anatomy. Currently, the image processing and dose calculation algorithms required to perform this plan adaptation cannot be executed in a clinically acceptable timeframe. Hardware acceleration has the potential to speedup these algorithms, making real-time adaptive radiotherapy a clinical possibility[1]. Hardware acceleration is a technique where an algorithm is implemented using hardware that is better suited to the specific algorithm than more general purpose processors in order to reduce the execution time of the algorithm. This can be achieved using field programmable gate arrays (FPGA), which are devices consisting of reconfigurable hardware, allowing their function to be customised for a specific application. These devices have been shown to be able to accelerate image processing algorithms pertinent to adaptive radiotherapy[2]. In this study a global thresholding algorithm based on Otsu’s method combined with a three dimensional mean filter was used to segment a series of CT images of a Modus QUASAR respiratory motion phantom into three unique classes. A Xilinx Zynq Z-7020 device consisting of a dual-core ARM Cortex-A9 central processing unit (CPU) coupled to an 85 000 logic cell FPGA was used to accelerate the algorithm by implementing sections of it in the reconfigurable hardware. The execution time of this implementation was compared to an implementation running on an ARM CPU and Intel Core-i5 CPU. The execution times of the implementations are shown in table 1. The hardware accelerated implementation was found to execute nearly sixty times as fast as the un-accelerated algorithm. The hardware accelerated implementation was also found to run around 14{\%} faster than on the more powerful Intel Core-i5 CPU. Figure 1 shows an example of the segmentation results where the blue contour represents the boundary between two of the classes. In the algorithms presented here the overhead of transferring data to the hardware represents a significant proportion of the algorithm execution time. It is anticipated that greater acceleration will be possible for algorithms with greater computational complexity because the data transfer overhead will represent a smaller proportion of the overall execution time. The requirement for fast processing in radiotherapy is likely to increase as the amount of data available to more accurately guide treatment increases through the use of techniques such as 4D CT and image-guided radiotherapy. FPGA have been shown to be effective at accelerating certain algorithms required for real-time adaptive radiotherapy, however, more research is required to establish which will execute faster on other types of hardware, such as CPU and graphical processing units (GPU). It is likely that heterogeneous computing platforms, composed of a mixture of hardware architectures, will be used in the future implementation of real-time adaptive radiotherapy. References: 1.K. {\O}stergaard Noe, B.D. De Senneville, U.V. Elstr{\o}m, K. Tanderup, T.S. S{\o}rensen, “Acceleration and validation of optical flow based deformable registration for image-guided radiotherapy,” Acta Oncologica, vol. 47, no. 7, pp.1286-1293, 2008 2.O. Dandekar, R. Shekhar, “FPGA-Accelerated Deformable Image Registration for Improved Target-Delineation During CT-Guided Interventions,” IEEE Trans. Biomed. Circuits Syst., vol. 1, no. 2, pp.116-127, 2007",
keywords = "FPGA, hardware acceleration, image processing, adaptive radiotherapy",
author = "Fraser Robinson and Louise Crockett and Bill Nailon and Bob Stewart and Duncan McLaren",
year = "2016",
month = "5",
day = "19",
language = "English",
note = "The Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025 ; Conference date: 19-05-2016 Through 19-05-2016",

}

Robinson, F, Crockett, L, Nailon, B, Stewart, B & McLaren, D 2016, 'Hardware accelerated image processing to enable real-time adaptive radiotherapy' The Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025, London, United Kingdom, 19/05/16 - 19/05/16, .

Hardware accelerated image processing to enable real-time adaptive radiotherapy. / Robinson, Fraser; Crockett, Louise; Nailon, Bill; Stewart, Bob; McLaren, Duncan.

2016. Poster session presented at The Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025, London, United Kingdom.

Research output: Contribution to conferencePoster

TY - CONF

T1 - Hardware accelerated image processing to enable real-time adaptive radiotherapy

AU - Robinson, Fraser

AU - Crockett, Louise

AU - Nailon, Bill

AU - Stewart, Bob

AU - McLaren, Duncan

PY - 2016/5/19

Y1 - 2016/5/19

N2 - The accuracy of radiotherapy is constrained by organ motion and deformation occurring between the acquisition of CT and MR images used to plan the treatment and the time at which the treatment is delivered. Adaptive radiotherapy uses image data acquired at the time of treatment to adapt the original treatment plan to match the current patient anatomy. Currently, the image processing and dose calculation algorithms required to perform this plan adaptation cannot be executed in a clinically acceptable timeframe. Hardware acceleration has the potential to speedup these algorithms, making real-time adaptive radiotherapy a clinical possibility[1]. Hardware acceleration is a technique where an algorithm is implemented using hardware that is better suited to the specific algorithm than more general purpose processors in order to reduce the execution time of the algorithm. This can be achieved using field programmable gate arrays (FPGA), which are devices consisting of reconfigurable hardware, allowing their function to be customised for a specific application. These devices have been shown to be able to accelerate image processing algorithms pertinent to adaptive radiotherapy[2]. In this study a global thresholding algorithm based on Otsu’s method combined with a three dimensional mean filter was used to segment a series of CT images of a Modus QUASAR respiratory motion phantom into three unique classes. A Xilinx Zynq Z-7020 device consisting of a dual-core ARM Cortex-A9 central processing unit (CPU) coupled to an 85 000 logic cell FPGA was used to accelerate the algorithm by implementing sections of it in the reconfigurable hardware. The execution time of this implementation was compared to an implementation running on an ARM CPU and Intel Core-i5 CPU. The execution times of the implementations are shown in table 1. The hardware accelerated implementation was found to execute nearly sixty times as fast as the un-accelerated algorithm. The hardware accelerated implementation was also found to run around 14% faster than on the more powerful Intel Core-i5 CPU. Figure 1 shows an example of the segmentation results where the blue contour represents the boundary between two of the classes. In the algorithms presented here the overhead of transferring data to the hardware represents a significant proportion of the algorithm execution time. It is anticipated that greater acceleration will be possible for algorithms with greater computational complexity because the data transfer overhead will represent a smaller proportion of the overall execution time. The requirement for fast processing in radiotherapy is likely to increase as the amount of data available to more accurately guide treatment increases through the use of techniques such as 4D CT and image-guided radiotherapy. FPGA have been shown to be effective at accelerating certain algorithms required for real-time adaptive radiotherapy, however, more research is required to establish which will execute faster on other types of hardware, such as CPU and graphical processing units (GPU). It is likely that heterogeneous computing platforms, composed of a mixture of hardware architectures, will be used in the future implementation of real-time adaptive radiotherapy. References: 1.K. Østergaard Noe, B.D. De Senneville, U.V. Elstrøm, K. Tanderup, T.S. Sørensen, “Acceleration and validation of optical flow based deformable registration for image-guided radiotherapy,” Acta Oncologica, vol. 47, no. 7, pp.1286-1293, 2008 2.O. Dandekar, R. Shekhar, “FPGA-Accelerated Deformable Image Registration for Improved Target-Delineation During CT-Guided Interventions,” IEEE Trans. Biomed. Circuits Syst., vol. 1, no. 2, pp.116-127, 2007

AB - The accuracy of radiotherapy is constrained by organ motion and deformation occurring between the acquisition of CT and MR images used to plan the treatment and the time at which the treatment is delivered. Adaptive radiotherapy uses image data acquired at the time of treatment to adapt the original treatment plan to match the current patient anatomy. Currently, the image processing and dose calculation algorithms required to perform this plan adaptation cannot be executed in a clinically acceptable timeframe. Hardware acceleration has the potential to speedup these algorithms, making real-time adaptive radiotherapy a clinical possibility[1]. Hardware acceleration is a technique where an algorithm is implemented using hardware that is better suited to the specific algorithm than more general purpose processors in order to reduce the execution time of the algorithm. This can be achieved using field programmable gate arrays (FPGA), which are devices consisting of reconfigurable hardware, allowing their function to be customised for a specific application. These devices have been shown to be able to accelerate image processing algorithms pertinent to adaptive radiotherapy[2]. In this study a global thresholding algorithm based on Otsu’s method combined with a three dimensional mean filter was used to segment a series of CT images of a Modus QUASAR respiratory motion phantom into three unique classes. A Xilinx Zynq Z-7020 device consisting of a dual-core ARM Cortex-A9 central processing unit (CPU) coupled to an 85 000 logic cell FPGA was used to accelerate the algorithm by implementing sections of it in the reconfigurable hardware. The execution time of this implementation was compared to an implementation running on an ARM CPU and Intel Core-i5 CPU. The execution times of the implementations are shown in table 1. The hardware accelerated implementation was found to execute nearly sixty times as fast as the un-accelerated algorithm. The hardware accelerated implementation was also found to run around 14% faster than on the more powerful Intel Core-i5 CPU. Figure 1 shows an example of the segmentation results where the blue contour represents the boundary between two of the classes. In the algorithms presented here the overhead of transferring data to the hardware represents a significant proportion of the algorithm execution time. It is anticipated that greater acceleration will be possible for algorithms with greater computational complexity because the data transfer overhead will represent a smaller proportion of the overall execution time. The requirement for fast processing in radiotherapy is likely to increase as the amount of data available to more accurately guide treatment increases through the use of techniques such as 4D CT and image-guided radiotherapy. FPGA have been shown to be effective at accelerating certain algorithms required for real-time adaptive radiotherapy, however, more research is required to establish which will execute faster on other types of hardware, such as CPU and graphical processing units (GPU). It is likely that heterogeneous computing platforms, composed of a mixture of hardware architectures, will be used in the future implementation of real-time adaptive radiotherapy. References: 1.K. Østergaard Noe, B.D. De Senneville, U.V. Elstrøm, K. Tanderup, T.S. Sørensen, “Acceleration and validation of optical flow based deformable registration for image-guided radiotherapy,” Acta Oncologica, vol. 47, no. 7, pp.1286-1293, 2008 2.O. Dandekar, R. Shekhar, “FPGA-Accelerated Deformable Image Registration for Improved Target-Delineation During CT-Guided Interventions,” IEEE Trans. Biomed. Circuits Syst., vol. 1, no. 2, pp.116-127, 2007

KW - FPGA

KW - hardware acceleration

KW - image processing

KW - adaptive radiotherapy

UR - http://www.theiet.org/events/2016/233408.cfm?origin=meganav

M3 - Poster

ER -

Robinson F, Crockett L, Nailon B, Stewart B, McLaren D. Hardware accelerated image processing to enable real-time adaptive radiotherapy. 2016. Poster session presented at The Royal Society of Medicine & IET conference on the future of medicine - the role of doctors in 2025, London, United Kingdom.