A Comparison of CNN-based Image Feature Extractors for Weld Defects Classification

Tito Wahyu Purnomo, Harun Al Rasyid Ramadhany, Hapsara Hadi Carita Jati, Djati Handoko

Abstract

Classification of the types of weld defects is one of the stages of evaluating radiographic images, which is an essential step in controlling the quality of welded joints in materials. By automating the weld defects classification based on deep learning and the CNN architecture, it is possible to overcome the limitations of visually or manually evaluating radiographic images. Good accuracy in classification models for weld defects requires the availability of sufficient datasets. In reality, however, the radiographic image dataset accessible to the public is limited and imbalanced between classes. Consequently, simple image cropping and augmentation techniques are implemented during the data preparation stage. To construct a weld defect classification model, we proposed to utilize the transfer learning method by employing a pre-trained CNN architecture as a feature extractor, including DenseNet201, InceptionV3, MobileNetV2, NASNetMobile, ResNet50V2, VGG16, VGG19, and Xception, which are linked to a simple classification model based on multilayer perceptron. The test results indicate that the three best classification models were obtained by using the DenseNet201 feature extractor with a test accuracy value of 100%, followed by ResNet50V2 and InceptionV3 with an accuracy of 99.17%. These outcomes are better compared to state-of-the-art classification models with a maximum of six classes of defects. The research findings may assist radiography experts in evaluating radiographic images more accurately and efficiently.

Keywords

CNN; Transfer Learning; Feature Extraction; Radiographic Image; Weld Defects

Full Text:

PDF

References

Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., Lobel, H., & Carrasco, M. 2015. GDXray: the database of x-ray images for nondestructive testing. J Nondestruct Eval, 34(42), 1-12.

Guo, W., Qu, H., & Liang, L. 2018. WDXI: The dataset of x-ray image for weld defects. 2018 14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), 2018, 1051-1055.

Perri, S., Spagnolo, F., Frustaci, F., & Corsonello, P. 2023. Welding defects classification through a Convolutional Neural Network. Manufacturing Letters, 35(2023), 29-32.

Oh, S-j., Jung, M-j., Lim, C., & Shin, S-c. 2020. Automatic detection of welding defects using Faster R-CNN. Applied Sciences, 10(23), 8629.

Liu, W., Shan, S., Chen, H., Wang, R., Sun, J., & Zhou, Z. 2022. X-ray weld defect detection based on AF-RCNN. Weld World, 66(2022), 1165–1177.

Golodov, V. A., & Maltseva, A. A. 2022. Approach to weld segmentation and defect classification in radiographic images of pipe welds. NDT & E International, 127(2022), 102597.

Thakkallapally, B. C. 2019. Defect classification from weld radiographic images using VGG-19 based convolutional neural network. NDE, 18, 2019.

Ajmi, C., Zapata, J., Elferchichi, S., Zaafouri, A., & Laabidi, K. 2020. Deep learning technology for weld defects classification based on transfer learning and activation features. Advances in Materials Science and Engineering, 2020.

Pan, H., Pang, Z., Wang, Y., Wang, Y., & Chen, L. 2020. A new image recognition and classification method combining transfer learning algorithm and MobileNet model for welding defects. IEEE Access, 8(2020), 119951-119960.

Nazarov, R. M., Gizatullin, Z. M., & Konstantinov, E. S. 2021. Classification of defects in welds using a convolution neural network. 2021 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (ElConRus), 2021, 1641-1644.

Kumaresan, S., Aultrin, K. S. J., Kumar, S. S., & Anand, M. D. 2021) Transfer learning with CNN for classification of weld defect. IEEE Access, 9(2021), 95097-95108.

Guo, R., Liu, H., Xie, G., & Zhang, Y. 2021. Weld defect detection from imbalanced radiographic images based on contrast enhancement conditional generative adversarial network and transfer learning. IEEE Sensors Journal, 21(9), 10844-10853.

Kongara, R. K. V., Somasila, V. S. C., Revanth, N., & Polagani, R. D. 2022. Classification and comparison study of rice plant diseases using pre-trained CNN models. 2022 International Conference on Inventive Computation Technologies (ICICT), 2022, 140-145.

Mascarenhas, S., & Agarwal, M. 2021. A comparison between VGG16, VGG19 and ResNet50 architecture frameworks for image classification. 2021 International Conference on Disruptive Technologies for Multi-Disciplinary Research and Applications (CENTCON), 2021, 96-99.

Rahouma, K., & Salama, A. 2021. Knee Images Classification using Transfer Learning. Procedia Computer Science, 194, 9-21.

Ikechukwu, A. V., Murali, S., Deepu, R., & Shivamurthy, R. C. 2021. ResNet-50 vs VGG-19 vs training from scratch: A comparative analysis of the segmentation and classification of pneumonia from chest x-ray images. Global Transitions Proceedings, 2(2), 375-381.

Santos-Bustos, D. F., Nguyen, B. M., & Espitia, H. E. 2022. Towards automated eye cancer classification via VGG and ResNet networks using transfer learning. Engineering Science and Technology, an International Journal, 35(2022), 101214.

Takahashi, R., Matsubara, T., and Uehara, K. 2020. Data augmentation using random image cropping and patching for deep CNNs. IEEE Transactions on Circuits and Systems for Video Technology, 30(9), 2917-2931.

Zhang, H., Chen, Z., Zhang, C., Xi, J., & Le, X. 2019. Weld defect detection based on deep learning method. 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), 2019, 1574-1579.

Yang, W., Xiao, Y., Shen, H., & Wang, Z. 2023. An effective data enhancement method of deep learning for small weld data defect identification. Measurement, 206, 112245.

Biradar, S., Virupakshappa, Bagewadi, S., Veerashetty, S., & Ambika. 2022. Improved Densenet model for automatic categorization of brain tumors. 2022 IEEE 3rd Global Conference for Advancement in Technology (GCAT), 2022, 1-6.

Thanomsingh, J., & Supratid, S. 2021. A comparison study of using linear and nonlinear classifiers on object recognition based on inception convolutional neural networks with different numbers of inception-block. 2021 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), 2021, 35-38.

Lee, S-W. 2021. Novel classification method of plastic wastes with optimal hyperparameter tuning of Inception_ResnetV2. 2021 4th International Conference on Information and Communications Technology (ICOIACT), 2021, 274-279.

Ran, X., Yan, T., & Cai, T. 2021. MobileNet for differential constellation trace figure. 2021 13th International Conference on Communication Software and Networks (ICCSN), 2021, 168-172.

Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L. 2019. MobileNetV2: Inverted Residuals and Linear Bottlenecks. arXiv preprint ArXiv, 1801.04381.

YILMAZ, F., & DEMİR, A. 2020. Cutting effect on classification using Nasnet architecture. 2020 Medical Technologies Congress (TIPTEKNO), 2020, 1-3.

Budhiman, A., Suyanto, S., & Arifianto, A. 2019. Melanoma cancer classification using resnet with data augmentation. 2019 International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), 2019, 17-20.

Liu, J. 2022. VGG, MobileNet and AlexNet on recognizing skin cancer symptoms. 2022 3rd International Conference on Electronic Communication and Artificial Intelligence (IWECAI), 2022, 525-528.

Wu, X., Liu, R., Yang, H., & Chen, Z. 2020. An Xception based convolutional neural network for scene image classification with transfer learning. 2020 2nd International Conference on Information Technology and Computer Application (ITCA), 2020, 262-267.

DOI: https://doi.org/10.13057/ijap.v14i1.72509

Refbacks

  • There are currently no refbacks.