Share Email Print

Proceedings Paper

Part defect recognition based on 2D and 3D feature combination
Author(s): Hui Mo; Hongzhi Jiang; Huijie Zhao; Xudong Li; Na Li
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Surface defect recognition is used to test product’s quality. The current way of recognition is traditional 2D imagebased method. But 2D image lacks 3D information which results in false inspection and missed inspection, which has become a bottleneck of current classification model. Because of the recent rapid development of 3D measurement technology, we can apply 3D data information in surface defect detection to improve the recognition ability of defects. We propose a new convolutional network model to identify surface defects, and realize the feature depth fusion of 3D point cloud and 2D image in the model. In this work, we introduce an attention network to extract features from a 3D point cloud to generate a 2D attention mask. The high quality feature map is produced by combining the 2D attention mask with a 2D image. We further merge the attention network and the classification network into a single network. The attention network is used to analyze which part of the image should be more concerned by the classification network. Therefore, mutual learning of 2D data and 3D data is realized in the training process, which reduces the dependence on the number of samples and enhances the generalization performance of the model. Experiments on the defect dataset verify that our method can improve the classification effect of the model.

Paper Details

Date Published: 16 October 2019
PDF: 6 pages
Proc. SPIE 11205, Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019), 112051F (16 October 2019); doi: 10.1117/12.2548258
Show Author Affiliations
Hui Mo, Beihang Univ. (China)
Hongzhi Jiang, Beihang Univ. (China)
Huijie Zhao, Beihang Univ. (China)
Xudong Li, Beihang Univ. (China)
Na Li, Beihang Univ. (China)

Published in SPIE Proceedings Vol. 11205:
Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019)
Anand Asundi; Motoharu Fujigaki; Huimin Xie; Qican Zhang; Song Zhang; Jianguo Zhu; Qian Kemao, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?