AMCD: an accurate deep learning-based metallic corrosion detector for MAV-based real-time visual inspection

Leijian Yu, Erfu Yang, Cai Luo, Peng Ren

Research output: Contribution to journalArticlepeer-review

3 Downloads (Pure)

Abstract

Corrosion has been concerned as a serious safety issue for metallic facilities. Visual inspection carried out by an engineer is expensive, subjective and time-consuming. Micro Aerial Vehicles (MAVs) equipped with detection algorithms have the potential to perform safer and much more efficient visual inspection tasks than engineers. Towards corrosion detection algorithms, convolution neural networks (CNNs) have enabled the power for high accuracy metallic corrosion detection. However, these detectors are restricted by MAVs on-board capabilities. In this study, based on You Only Look Once v3-tiny (Yolov3-tiny), an accurate deep learning-based metallic corrosion detector (AMCD) is proposed for MAVs on-board metallic corrosion detection. Specifically, a backbone with depthwise separable convolution (DSConv) layers is designed to realise efficient corrosion detection. The convolutional block attention module (CBAM), three-scale object detection and focal loss are incorporated to improve the detection accuracy. Moreover, the spatial pyramid pooling (SPP) module is improved to fuse local features for further improvement of detection accuracy. A eld inspection image dataset labelled with four types of corrosions (the nubby corrosion, bar corrosion, exfoliation and fastener corrosion) is utilised for training and testing the AMCD. Test results show that the AMCD achieves 84.96% mean average precision (mAP), which outperforms other state-of-the-art detectors. Meanwhile, 20.18 frames per second (FPS) is achieved leveraging NVIDIA Jetson TX2, the most popular MAVs on-board computer, and the model size is only 6.1MB.
Original languageEnglish
Number of pages12
JournalJournal of Ambient Intelligence and Humanized Computing
Early online date7 Nov 2021
DOIs
Publication statusE-pub ahead of print - 7 Nov 2021

Keywords

  • corrosion detection
  • MAVs
  • high accuracy
  • deep learning

Fingerprint

Dive into the research topics of 'AMCD: an accurate deep learning-based metallic corrosion detector for MAV-based real-time visual inspection'. Together they form a unique fingerprint.

Cite this