Abstract:Inkjet printing technology can make tiles with very rich and realistic patterns, so it is widely adopted in the ceramic industry. However, the frequent nozzle blockage and inconsistent inkjet volume by inkjet printing devices, usually leads to defects such as stayguy and color blocks in the tile surface. Especially, the stayguy in complex pattern is difficult to identify by naked eyes due to it is easily covered by complex patterns and becomes invisible, this brings great challenge to tile quality inspection. Nowadays, the machine learning is employed to address the issues. The existing machine learning methods based on hand‐crafted features are capable of stayguy detection of the tiles with a simple pattern, but not applicable for complex patterns due to the interference of pattern in feature extraction. The emerging deep‐learning‐based methods have the potential to be applied for stayguy detection with complex patterns, but cannot achieve real‐time detection due to high complexity. In this paper, a lightweight hand‐crafted feature enhanced convolutional neural network (named HFENet) is proposed for rapid defect detection of tile surface. First, we perform data enhancement on the original image by global histogram equalization and image addition. Second, for the special shape of stayguy which is usually vertical, we embed the extended vertical edge detection operator (Prewitt) as convolution kernel into HFENet to extract the hand‐crafted vertical edge features of the test image and eliminate the interference of complex pattern in the feature extraction. Third, the 5 × 1 asymmetric convolution kernel with a dilation rate of 2 is used to improve the utilization of convolution kernel and reduce the complexity of the model. Fourth, to reach the real‐time requirements, a memory access cost‐aware design is proposed, which can orchestrate the number of shallow convolution layers and deep convolution layers in feature extraction. The experiments were performed on the ceramic tile image data set captured by high‐resolution industrial cameras in ceramic tile production line. Experimental results show that the HFENet outperforms the state‐of‐the‐art semantic segmentation networks (i.e., UNet, FCN‐8s, SegNet, DeepLabV3+, etc.) and lightweight networks (i.e., ShuffleNet, MobileNet, and SqueezeNet). All the code and data are available at a GitHub repository (https://github.com/RobotvisionLab/HFENet).

Error-compensated one-dimensional convolutional neural network-based ultrasonic defect signal recognition method for flat ceramic membranes

The defect detection of 3D-printed ceramic curved surface parts with low contrast based on deep learning

Imbalance Modelling for Defect Detection in Ceramic Substrate by Using Convolutional Neural Network

Concrete Defect Localization Based on Multilevel Convolutional Neural Networks

Two-stream Convolutional Neural Network for Non-Destructive Subsurface Defect Detection Via Similarity Comparison of Lock-in Thermography Signals

Ultrasonic signal classification and imaging system for composite materials via deep convolutional neural networks

Nondestructive Detection of Surface Defects of Curved Mosaic Ceramics Based on Deep Learning

Spatio-Temporal 3-D Residual Networks for Simultaneous Detection and Depth Estimation of CFRP Subsurface Defects in Lock-In Thermography

Research on anti-interference detection of 3D-printed ceramics surface defects based on deep learning

Inspecting Decorative Ceramic Defects by Fusing Convolutional Neural Network and Image Recognition

Research on Defect Recognition of Ceramic Chips for High Temperature Fuel Cells Based on Improved Faster R-CNN

Defect intelligent recognition of membrane product based on deep learning

A new method to reduce the false detection rate of ceramic tile surface defects online inspection system

Automated Classification of Ultrasonic Signal via a Convolutional Neural Network

FFCNN: A Deep Neural Network for Surface Defect Detection of Magnetic Tile

A supervised approach for automated surface defect detection in ceramic tile quality control

Non-destructive Detection for Mosaic Ceramic Surface Defects Based on Convolutional Neural Networks

A novel approach for one-step defect detection and depth estimation using sequenced thermal signal encoding

Quantitative Detection of Pipeline Cracks Based on Ultrasonic Guided Waves and Convolutional Neural Network

Signal Process of Ultrasonic Guided Wave for Damage Detection of Localized Defects in Plates: From Shallow Learning to Deep Learning

HFENet: A lightweight hand‐crafted feature enhanced CNN for ceramic tile surface defect detection