High-performance reconstruction method combining total variation with a video denoiser for compressed ultrafast imaging

Chengquan Pei, David Li, Qian Shen, Shian Zhang, Dalong Qi, Chengzhi Jin, Le Dong

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Compressed ultrafast photography (CUP) is a novel two-dimensional (2D) imaging technique to capture ultrafast dynamic scenes. Effective image reconstruction is essential inCUPsystems.However, existing reconstruction algorithms mostly rely on image priors and complex parameter spaces. Therefore, in general, they are time-consuming and result in poor imaging quality, which limits their practical applications. In this paper, we propose a novel reconstruction algorithm, to the best of our knowledge, named plug-in-plug-fast deep video denoising net-total variation (PnP-TV-FastDVDnet), which exploits an image’s spatial features and correlation features in the temporal dimension. Therefore, it offers higher-quality images than those in previously reported methods. First, we built a forward mathematical model of the CUP, and the closed-formsolution of the three suboptimization problems was derived according to plug-in and plug-out frames. Secondly, we used an advanced video denoising algorithm based on a neural network named FastDVDnet to solve the denoising problem. The peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) are improved on actual CUP data compared with traditional algorithms. On benchmark and real CUP datasets, the proposed method shows the comparable visual results while reducing the running time by96% over state-of-the-art algorithms.

Original languageEnglish
Pages (from-to)C32-C40
Number of pages17
JournalApplied Optics
Volume63
Issue number8
Early online date25 Jan 2024
DOIs
Publication statusPublished - 10 Mar 2024

Keywords

  • compressed ultrastast photography
  • compressed sensing
  • video denoise

Fingerprint

Dive into the research topics of 'High-performance reconstruction method combining total variation with a video denoiser for compressed ultrafast imaging'. Together they form a unique fingerprint.

Cite this