Abstract:The digitization of engineering drawings is crucial for efficient reuse, distribution, and archiving. Existing computer vision approaches for digitizing engineering drawings typically assume the input drawings have high quality. However, in reality, engineering drawings are often blurred and distorted due to improper scanning, storage, and transmission, which may jeopardize the effectiveness of existing approaches. This paper focuses on restoring and recognizing low-quality engineering drawings, where an end-to-end framework is proposed to improve the quality of the drawings and identify the graphical symbols on them. The framework uses K-means clustering to classify different engineering drawing patches into simple and complex texture patches based on their gray level co-occurrence matrix statistics. Computer vision operations and a modified Enhanced Super-Resolution Generative Adversarial Network (ESRGAN) model are then used to improve the quality of the two types of patches, respectively. A modified Faster Region-based Convolutional Neural Network (Faster R-CNN) model is used to recognize the quality-enhanced graphical symbols. Additionally, a multi-stage task-driven collaborative learning strategy is proposed to train the modified ESRGAN and Faster R-CNN models to improve the resolution of engineering drawings in the direction that facilitates graphical symbol recognition, rather than human visual perception. A synthetic data generation method is also proposed to construct quality-degraded samples for training the framework. Experiments on real-world electrical diagrams show that the proposed framework achieves an accuracy of 98.98% and a recall of 99.33%, demonstrating its superiority over previous approaches. Moreover, the framework is integrated into a widely-used power system software application to showcase its practicality. The reference codes and data can be found at https://github.com/Lattle-y/AI-recognition-for-lq-ed.git Future work will focus on improving the generalizability of the proposed framework to different quality degradation scenarios and extrapolating the application to different engineering domains.

A Text Code Recognition and Positioning System for Engineering Drawings of Nuclear Power Equipment

A Framework for Handwritten Date Recognition in Quality Documents

An Integrated Point- Data Processing System in Reverse Engineering

Graphic Marking System Based on Autodesk DWF Viewer

Optical character recognition on engineering drawings to achieve automation in production quality control

Scene Text Detection and Recognition System for Visually Impaired People in Real World

Text Detection on Technical Drawings for the Digitization of Brown-field Processes

Engineering Drawing Vectorization and Processing System

An Effective Method and Its Implementation for Automatic Extraction of Part Information from Engineering Drawings

A Multilevel Approach For Recognizing Characters In Engineering Drawings

Automatic input and management system for engineering drawings

Tolerance Information Extraction for Mechanical Engineering Drawings – A Digital Image Processing and Deep Learning-based Model

The Computer Vision-based Tolerancing Callout Detection Model

The Recognition Based Segmentation Of Text From Line In Engineering Drawing

Development and Application of Quality Assurance and Rating Software Program for Power Equipment Defect Texts

Automated Recognition of Electrical Circuit Drawings

A Dynamic-Rule-Based Framework Of Engineering Drawing Recognition And Interpretation System

Component segmentation of engineering drawings using Graph Convolutional Networks

Text2CAD: Text to 3D CAD Generation via Technical Drawings

A Vectorization System for Architecture Engineering Drawings

A comprehensive end-to-end computer vision framework for restoration and recognition of low-quality engineering drawings