Deep background subtraction of thermal and visible imagery for redestrian detection in videos

Yijun Yan, Huimin Zhao, Fu-Jen Kao, Valentin Masero Vargas, Sophia Zhao, Jinchang Ren

Research output: Contribution to conferencePaper

92 Downloads (Pure)

Abstract

In this paper, we introduce an efficient framework to subtract the background from both visible and thermal imagery for pedestrians’ detection in the urban scene. We use a deep neural network (DNN) to train the background subtraction model. For the training of the DNN, we first generate an initial background map and then employ randomly 5% video frames, background map, and manually segmented ground truth. Then we apply a cognition-based post-processing to further smooth the foreground detection result. We evaluate our method against our previous work and 11 recently widely cited method on three challenge video series selected from a publicly available color-thermal benchmark dataset OCTBVS. Promising results have been shown that the proposed DNN-based approach can successfully detect the pedestrians with good shape in most scenes regardless of illuminate changes and occlusion problem.
Original languageEnglish
Number of pages10
Publication statusPublished - 7 Jul 2018
Event9th International Conference on Brain Inspired Cognitive Systems - Xi'an, China
Duration: 7 Jul 20188 Jul 2018

Conference

Conference9th International Conference on Brain Inspired Cognitive Systems
CountryChina
CityXi'an
Period7/07/188/07/18

Keywords

  • deep neural network (DNN)
  • video salient objects
  • pedestrian detection/tracking

Fingerprint Dive into the research topics of 'Deep background subtraction of thermal and visible imagery for redestrian detection in videos'. Together they form a unique fingerprint.

  • Research Output

  • Background prior-based salient object detection via deep reconstruction residual

    Han, J., Zhang, D., Hu, X., Guo, L., Ren, J. & Wu, F., Aug 2015, In : IEEE Transactions on Circuits and Systems for Video Technology. 25, 8, p. 1309-1321 13 p.

    Research output: Contribution to journalArticle

    Open Access
    File
  • 324 Citations (Scopus)
    352 Downloads (Pure)

    Activities

    • 1 Participation in conference

    BICS 2018 : The 9th International Conference on Brain Inspired Cognitive System

    Yijun Yan (Participant)

    7 Jul 20188 Jul 2018

    Activity: Participating in or organising an event typesParticipation in conference

    Cite this

    Yan, Y., Zhao, H., Kao, F-J., Vargas, V. M., Zhao, S., & Ren, J. (2018). Deep background subtraction of thermal and visible imagery for redestrian detection in videos. Paper presented at 9th International Conference on Brain Inspired Cognitive Systems, Xi'an, China.