Abstract:Purpose This paper aims to propose a new deep learning technique to detect the type of material to improve automated construction quality monitoring. Design/methodology/approach A new data augmentation approach that has improved the model robustness against different illumination conditions and overfitting is proposed. This study uses data augmentation at test time and adds outlier samples to training set to prevent over-fitted network training. For data augmentation at test time, five segments are extracted from each sample image and fed to the network. For these images, the network outputting average values is used as the final prediction. Then, the proposed approach is evaluated on multiple deep networks used as material classifiers. The fully connected layers are removed from the end of the networks, and only convolutional layers are retained. Findings The proposed method is evaluated on recognizing 11 types of building materials which include 1,231 images taken from several construction sites. Each image resolution is 4,000 × 3,000. The images are captured with different illumination and camera positions. Different illumination conditions lead to trained networks that are more robust against various environmental conditions. Using VGG16 model, an accuracy of 97.35% is achieved outperforming existing approaches. Practical implications It is believed that the proposed method presents a new and robust tool for detecting and classifying different material types. The automated detection of material will aid to monitor the quality and see whether the right type of material has been used in the project based on contract specifications. In addition, the proposed model can be used as a guideline for performing quality control (QC) in construction projects based on project quality plan. It can also be used as an input for automated progress monitoring because the material type detection will provide a critical input for object detection. Originality/value Several studies have been conducted to perform quality management, but there are some issues that need to be addressed. In most previous studies, a very limited number of material types were examined. In addition, although some studies have reported high accuracy to detect material types (Bunrit et al., 2020), their accuracy is dramatically reduced when they are used to detect materials with similar texture and color. In this research, the authors propose a new method to solve the mentioned shortcomings.

Deep Learning for Material recognition: most recent advances and open challenges

Deep Learning Approaches to Image Texture Analysis in Material Processing

A Deep Learning Method for Material Performance Recognition in Laser Additive Manufacturing

Integrating Deep Features for Material Recognition

Recent advances and applications of deep learning methods in materials science

Deep learning object detection in materials science: Current state and future directions

Material recognition in the wild with the Materials in Context Database

Gathering Effective Information for Real-Time Material Recognition

Multi-View Learning for Material Classification

Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns

Investigating the use of Deep Learning, in Materials Research for Predicting Material Properties, Identifying new Materials, and Optimizing Material Selection for Mechanical Components

Material recognition for construction quality monitoring using deep learning methods

Material Classification using Neural Networks

Deep Learning for Surface Material Classification Using Haptic And Visual Information

A Deep Learning Approach for Pixel-level Material Classification via Hyperspectral Imaging

Deep‐Learning‐Enabled Fast Optical Identification and Characterization of 2D Materials

Deep-Learning-Enabled Fast Optical Identification and Characterization of Two-Dimensional Materials

Material Recognition from Local Appearance in Global Context

One-shot recognition of any material anywhere using contrastive learning with physics-based rendering

Mining Sufficient Knowledge via Progressive Feature Fusion for Efficient Material Recognition

Learning Multi-Scale Representations for Material Classification