Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays

Dong Xiao; Zhenya Zang; Quan Wang; Ziao Jiao; Francescopaolo Mattioli Della Rocca; Yu Chen; David Day Uei Li

doi:10.1109/embc48229.2022.9870996

Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays

Dong Xiao, Zhenya Zang, Quan Wang, Ziao Jiao, Francescopaolo Mattioli Della Rocca, Yu Chen, David Day Uei Li

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution book

6 Downloads (Pure)

Abstract

Wide-field fluorescence lifetime imaging (FLIM) is a promising technique for biomedical and clinic applications. Integrating with CMOS single-photon avalanche diode (SPAD) sensor arrays can lead to cheaper and portable real-time FLIM systems. However, the FLIM data obtained by such sensor systems often have sophisticated noise features. There is still a lack of fast tools to recover lifetime parameters from highly noise-corrupted fluorescence signals efficiently. This paper proposes a smart wide-field FLIM system containing a 192×128 COMS SPAD sensor and a field-programmable gate array (FPGA) embedded deep learning (DL) FLIM processor. The processor adopts a hardware-friendly and light-weighted neural network for fluorescence lifetime analysis, showing the advantages of high accuracy against noise, fast speed, and low power consumption. Experimental results demonstrate the proposed system's superior and robust performances, promising for many FLIM applications such as FLIM-guided clinical surgeries, cancer diagnosis, and biomedical imaging

Original language	English
Title of host publication	2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
Place of Publication	Piscataway, NJ
Publisher	IEEE
Pages	1887-1890
Number of pages	4
Volume	2022
ISBN (Electronic)	9781728127828
ISBN (Print)	9781728127835
DOIs	https://doi.org/10.1109/embc48229.2022.9870996
Publication status	Published - 8 Sep 2022
Event	44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'22) - Scottish Event Campus (SEC) , Glasgow, United Kingdom Duration: 11 Jul 2022 → 15 Jul 2022 https://embc.embs.org/2022/#:~:text=About%20the%20Conference&text=The%20IEEE%20Engineering%20in%20Medicine,from%2011%2D15%20July%202022.

Conference

Conference	44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'22)
Country/Territory	United Kingdom
City	Glasgow
Period	11/07/22 → 15/07/22
Internet address	https://embc.embs.org/2022/#:~:text=About%20the%20Conference&text=The%20IEEE%20Engineering%20in%20Medicine,from%2011%2D15%20July%202022.

Keywords

array signal processing
neural networks
surgery
fluorescence
sensor systems
field programmable gate arrays (FPGA)
single-photon avalanche diodes

Access to Document

10.1109/embc48229.2022.9870996

Xiao-etal-IEEE-EMBS-2022-Smart-wide-field-fluorescence-lifetime-imaging-system-with-CMOSAccepted author manuscript, 1.25 MBLicence: Strath_1

1 Finished
1 Active

SPRINT: A SuPer-Resolution time-resolved ImagiNg and specTroscopy facility for rapid biomolecular analysis
Li, D., Chamberlain, L., Chen, Y., Cunningham, M. R., Gould, G., Hoskisson, P., McConnell, G., Rattray, Z. & Van de Linde, S.
BBSRC (Biotech & Biological Sciences Research Council)
1/07/21 → 31/05/23
Project: Research
A new approach for imaging RNA at the single cell level
Chen, Y., Birch, D. & Yu, J.
BBSRC (Biotech & Biological Sciences Research Council)
29/07/13 → 28/01/15
Project: Research

Cite this

Xiao, D., Zang, Z., Wang, Q., Jiao, Z., Rocca, F. M. D., Chen, Y., & Li, D. D. U. (2022). Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (Vol. 2022, pp. 1887-1890). IEEE. https://doi.org/10.1109/embc48229.2022.9870996

@inproceedings{4012944d87884d4388683f83e1ec5f3d,

title = "Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays",

abstract = "Wide-field fluorescence lifetime imaging (FLIM) is a promising technique for biomedical and clinic applications. Integrating with CMOS single-photon avalanche diode (SPAD) sensor arrays can lead to cheaper and portable real-time FLIM systems. However, the FLIM data obtained by such sensor systems often have sophisticated noise features. There is still a lack of fast tools to recover lifetime parameters from highly noise-corrupted fluorescence signals efficiently. This paper proposes a smart wide-field FLIM system containing a 192×128 COMS SPAD sensor and a field-programmable gate array (FPGA) embedded deep learning (DL) FLIM processor. The processor adopts a hardware-friendly and light-weighted neural network for fluorescence lifetime analysis, showing the advantages of high accuracy against noise, fast speed, and low power consumption. Experimental results demonstrate the proposed system's superior and robust performances, promising for many FLIM applications such as FLIM-guided clinical surgeries, cancer diagnosis, and biomedical imaging",

keywords = "array signal processing, neural networks, surgery, fluorescence, sensor systems, field programmable gate arrays (FPGA), single-photon avalanche diodes",

author = "Dong Xiao and Zhenya Zang and Quan Wang and Ziao Jiao and Rocca, {Francescopaolo Mattioli Della} and Yu Chen and Li, {David Day Uei}",

note = "{\textcopyright} 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.; 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'22) ; Conference date: 11-07-2022 Through 15-07-2022",

year = "2022",

month = sep,

day = "8",

doi = "10.1109/embc48229.2022.9870996",

language = "English",

isbn = "9781728127835",

volume = "2022",

pages = "1887--1890",

booktitle = "2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)",

publisher = "IEEE",

url = "https://embc.embs.org/2022/#:~:text=About%20the%20Conference&text=The%20IEEE%20Engineering%20in%20Medicine,from%2011%2D15%20July%202022.",

}

Xiao, D , Zang, Z , Wang, Q , Jiao, Z, Rocca, FMD, Chen, Y & Li, DDU 2022, Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays. in 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). vol. 2022, IEEE, Piscataway, NJ, pp. 1887-1890, 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'22) , Glasgow, United Kingdom, 11/07/22. https://doi.org/10.1109/embc48229.2022.9870996

Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays. / Xiao, Dong ; Zang, Zhenya ; Wang, Quan et al.

2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). Vol. 2022 Piscataway, NJ : IEEE, 2022. p. 1887-1890.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution book

TY - GEN

T1 - Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays

AU - Xiao, Dong

AU - Zang, Zhenya

AU - Wang, Quan

AU - Jiao, Ziao

AU - Rocca, Francescopaolo Mattioli Della

AU - Chen, Yu

AU - Li, David Day Uei

N1 - © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

PY - 2022/9/8

Y1 - 2022/9/8

N2 - Wide-field fluorescence lifetime imaging (FLIM) is a promising technique for biomedical and clinic applications. Integrating with CMOS single-photon avalanche diode (SPAD) sensor arrays can lead to cheaper and portable real-time FLIM systems. However, the FLIM data obtained by such sensor systems often have sophisticated noise features. There is still a lack of fast tools to recover lifetime parameters from highly noise-corrupted fluorescence signals efficiently. This paper proposes a smart wide-field FLIM system containing a 192×128 COMS SPAD sensor and a field-programmable gate array (FPGA) embedded deep learning (DL) FLIM processor. The processor adopts a hardware-friendly and light-weighted neural network for fluorescence lifetime analysis, showing the advantages of high accuracy against noise, fast speed, and low power consumption. Experimental results demonstrate the proposed system's superior and robust performances, promising for many FLIM applications such as FLIM-guided clinical surgeries, cancer diagnosis, and biomedical imaging

AB - Wide-field fluorescence lifetime imaging (FLIM) is a promising technique for biomedical and clinic applications. Integrating with CMOS single-photon avalanche diode (SPAD) sensor arrays can lead to cheaper and portable real-time FLIM systems. However, the FLIM data obtained by such sensor systems often have sophisticated noise features. There is still a lack of fast tools to recover lifetime parameters from highly noise-corrupted fluorescence signals efficiently. This paper proposes a smart wide-field FLIM system containing a 192×128 COMS SPAD sensor and a field-programmable gate array (FPGA) embedded deep learning (DL) FLIM processor. The processor adopts a hardware-friendly and light-weighted neural network for fluorescence lifetime analysis, showing the advantages of high accuracy against noise, fast speed, and low power consumption. Experimental results demonstrate the proposed system's superior and robust performances, promising for many FLIM applications such as FLIM-guided clinical surgeries, cancer diagnosis, and biomedical imaging

KW - array signal processing

KW - neural networks

KW - surgery

KW - fluorescence

KW - sensor systems

KW - field programmable gate arrays (FPGA)

KW - single-photon avalanche diodes

U2 - 10.1109/embc48229.2022.9870996

DO - 10.1109/embc48229.2022.9870996

M3 - Conference contribution book

SN - 9781728127835

VL - 2022

SP - 1887

EP - 1890

BT - 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)

PB - IEEE

CY - Piscataway, NJ

T2 - 44th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'22)

Y2 - 11 July 2022 through 15 July 2022

ER -

Xiao D , Zang Z , Wang Q , Jiao Z, Rocca FMD, Chen Y et al. Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). Vol. 2022. Piscataway, NJ: IEEE. 2022. p. 1887-1890 Epub 2022 Jul 11. doi: 10.1109/embc48229.2022.9870996

Smart wide-field fluorescence lifetime imaging system with CMOS single-photon avalanche diode arrays

Abstract

Conference

Keywords

Access to Document

Fingerprint

Projects

SPRINT: A SuPer-Resolution time-resolved ImagiNg and specTroscopy facility for rapid biomolecular analysis

A new approach for imaging RNA at the single cell level

Cite this