Recognition of Object’s Opening Features Using Machine Learning

Yang Yue,Yiwen Zhang

DOI: https://doi.org/10.1109/icocn59242.2023.10236154

2023-01-01

Abstract:Machine learning is utilized to identify for the objects’ opening number with 100% accuracy. For objects with up to 36 openings, 1° resolution is achieved in all wedge angles and directions with $\gt88.86$% accuracy.

What problem does this paper attempt to address?

Wedge Angle and Orientation Recognition of Multi-Opening Objects Using an Attention-Based CNN Model

Yiwen Zhang,Si-Ao Li,Xiaoyan Wang,Yongxiong Ren,Zihan Geng,Fei Yang,Zhongqi Pan,Yang Yue

DOI: https://doi.org/10.1364/oe.529655

IF: 3.8

2024-01-01

Optics Express

Abstract:In industries such as manufacturing and safety monitoring, accurately identifying the shape characteristics of multi-opening objects is essential for the assembly, maintenance, and fault diagnosis of machinery components. Compared to traditional contact sensing methods, imagebased feature recognition technology offers non-destructive assessment and greater efficiency, holding significant practical value in these fields. Although convolutional neural networks (CNNs) have achieved remarkable success in image classification and feature recognition tasks, they still face challenges in dealing with subtle features in complex backgrounds, especially for objects with similar openings, where minute angle differences are critical. To improve the identification accuracy and speed, this study introduces an efficient CNN model, ADSA-Net, which utilizes the additive self-attention mechanism. When coupled with an active light source system, ADSA-Net enables non-contact, high-precision recognition of shape features in 14 classes of rotationally symmetric objects with multiple openings. Experimental results demonstrate that ADSA-Net achieves accuracies of 100%, >= 98.04%, and >= 98.98% in identifying the number of openings, wedge angles, and opening orientations of all objects, respectively with a resolution of 1 degrees. By adopting linear layers to replace the traditional quadratic matrix multiplication operations for key-value interactions, ADSA-Net significantly enhances computational efficiency and identification accuracy.
Online Double-Sided Identification and Eliminating System of Unclosed-Glumes Rice Seed Based on Machine Vision

Jun Zhang,Maozhen Qu,Zhaoyong Gong,Fang Cheng

DOI: https://doi.org/10.1016/j.measurement.2021.110252

IF: 5.6

2022-01-01

Measurement

Abstract:An online double-sided identification and eliminating system based on machine vision was developed to identify the unclosed-glumes rice seed by analyzing its double-sided image simultaneously. The vibrating plate and linear vibration conveyor achieved the transfer of rice seed from disordering to spacing, and the identified unclosedglumes rice seed was eliminated by the blowing jet. Hough linear detection and extracted feature were used to identify the unclosed-glumes rice seeds. The algorithm achieved the accuracy of 88.1% for normal seeds and 87.7% for unclosed-glumes seeds when using double-sided image acquired online. Multi-thread processing was used for double-sided images to shorten the code execution time. The online double-sided identification and eliminating system achieved the average accuracy of 83.7% for normal seeds and 83.3% for unclosed-glumes seeds. Results show that the system has a good adaptation of different rice seed varieties and achieved desired accuracy for online identification and eliminating of unclosed-glumes rice seed.
Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

Huan Yin,Xiaqing Ding,Li Tang,Yue Wang,Rong Xiong

DOI: https://doi.org/10.1109/robio.2017.8324463

2017-01-01

Abstract:Loop closure detection in 3D LIDAR data is an essential but challenging problem in SLAM system. It is important to reduce global inconsistency or re-localize the robot that loses the localization, while is difficult for the lack of prior information. We present a semi-handcrafted representation learning method for LIDAR point cloud using siamese convolution neural network, which states the loop closure detection to a similarity modeling problem. With the learned representation, the similarity between two LIDAR scans is transformed as the Euclidean distance between the representations respectively. Based on it, we furthermore establish kd-tree to accelerate the searching of similar scans. To demonstrate the performance and effectiveness of the proposed method, the KITTI dataset is employed for comparison with other LIDAR loop closure detection methods. The result shows that our method can achieve both higher accuracy and efficiency.
Detecting Object Open Angle and Direction Using Machine Learning

Yiwen Zhang,Yongxiong Ren,Guodong Xie,Zhi Wang,Hao Zhang,Tianxu Xu,Haoyuan Xu,Hao Huang,Changjing Bao,Zhongqi Pan,Yang Yue

DOI: https://doi.org/10.1109/access.2020.2965537

IF: 3.9

2020-01-01

IEEE Access

Abstract:Nowadays, the object detection techniques have been developed rapidly for different applications, ranging from remote sensing to autonomous vehicles. We demonstrate identification of object open angle and direction using machine learning (ML) algorithms based on received light beam's intensity profiles. Compared with previous optical orbital-angular-momentum (OAM) spectrum system and other related works, our proposed technique only uses a single-shot image, and can efficiently reduce the complexity of hardware implementation. Specifically, we verify the reliability of the simulation results experimentally for 14 open angles and 32 directions. Experimental result shows that convolutional neural network (CNN) outperforms the other traditional ML algorithms, such as decision tree (DT), k-nearest neighbor algorithm (KNN), and support vector machine (SVM). As one of the variant of CNN, MobileNet (MN) has relatively simplified iteration algorithm than VGG-like net. It reduces the computational power, while still maintaining high accuracy for identification issues.
Object Wedge Angle and Direction Identification Using Machine Learning Algorithms

Yiwen Zhang,Yongxiong Ren,Guodong Xie,Zhi Wang,Hao Zhang,Tianxu Xu,Hao Huang,Changjing Bao,Zhongqi Pan,Yang Yue

DOI: https://doi.org/10.1109/icocn.2019.8934830

2019-01-01

Abstract:We demonstrate identification of object wedge angle and direction using machine learning algorithms based on received beam intensity profiles. CNN outperforms other algorithms with 100% accuracy. Proposed technique reduces the complexity of hardware implementation.
Annular Region Statistical Feature-based Recognition of Bearing Rings under Non-exact Positioning

Bo Jin,Lijun Zhao,Shiqiang Zhu

2014-01-01

Abstract:A monocular vision-based approach is proposed for inspecting the excircle filleting status of fixed-size bearing rings under non-exact positioning. Through cropping, grey-scaling, binary segmentation of the images grabbed from the top and bottom sides of bearing rings and extracting the black points sum in a specified annular region, the rings were classified as filleted or not based on the pre-established criterion. The methods of determining the critical parameters for binary segmentation as well as subsequent classification were discussed in details. Experimental results have showed that all the inspected bearing rings were recognized and classified correctly.
Vision-based Keyhole Detection and Parameter Extraction in Door Opening Task

Jiajun Li,Xu,Jianguo Tao,Liang Ding,Haibo Gao,Zongquan Deng

DOI: https://doi.org/10.1109/icma.2016.7558814

2016-01-01

Abstract:It is important for a robot to be able to open a door in indoor environment. There are occasions when the robot has to open a locked door with a key. Problem arises when the robot tries to insert the key into the keyhole; it has to know the location and direction of the keyhole. In this paper, a procedure is developed to deal with this problem. First we detect the keyhole with the HOG features and a SVM classifier. The detection process has an average precision of 89%. Then the detected target image is processed by the opening operator in order to filter out the disturbance caused by the error in assembling. The resulting image is a binary image which contains only the pixels corresponding to the keyhole. Finally, we calculate the location of the keyhole with the image moment. The direction of the keyhole is computed with two different methods. We compared and analyzed these two method and the result shows that the calculated dominant direct has a constant error about one degree.
Machining Feature Recognition In Polyhedrons

t l lau,q yang

1997-01-01

Abstract:A new algorithm for machining features recognition in polyhedrons--Complementary Components Decomposition Method(CCDM) has been developed. It involves using spatial decomposition to recover geometric & topological information of interacting features, graphic decomposition to create subgraph so that the basic solids in the subgraph can form a maximum convex hull and determinant calculation of matrix; representing the attribute face graph to match the maximum convex hull with machining feature templates. This algorithm can avoid computation explosion of basic solids combination in other decomposition methods for machining feautres recognition.
OpenSight: A Simple Open-Vocabulary Framework for LiDAR-Based Object Detection

Hu Zhang,Jianhua Xu,Tao Tang,Haiyang Sun,Xin Yu,Zi Huang,Kaicheng Yu

DOI: https://doi.org/10.48550/arXiv.2312.08876

2023-12-12

Abstract:Traditional LiDAR-based object detection research primarily focuses on closed-set scenarios, which falls short in complex real-world applications. Directly transferring existing 2D open-vocabulary models with some known LiDAR classes for open-vocabulary ability, however, tends to suffer from over-fitting problems: The obtained model will detect the known objects, even presented with a novel category. In this paper, we propose OpenSight, a more advanced 2D-3D modeling framework for LiDAR-based open-vocabulary detection. OpenSight utilizes 2D-3D geometric priors for the initial discernment and localization of generic objects, followed by a more specific semantic interpretation of the detected objects. The process begins by generating 2D boxes for generic objects from the accompanying camera images of LiDAR. These 2D boxes, together with LiDAR points, are then lifted back into the LiDAR space to estimate corresponding 3D boxes. For better generic object perception, our framework integrates both temporal and spatial-aware constraints. Temporal awareness correlates the predicted 3D boxes across consecutive timestamps, recalibrating the missed or inaccurate boxes. The spatial awareness randomly places some ``precisely'' estimated 3D boxes at varying distances, increasing the visibility of generic objects. To interpret the specific semantics of detected objects, we develop a cross-modal alignment and fusion module to first align 3D features with 2D image embeddings and then fuse the aligned 3D-2D features for semantic decoding. Our experiments indicate that our method establishes state-of-the-art open-vocabulary performance on widely used 3D detection benchmarks and effectively identifies objects for new categories of interest.

Computer Vision and Pattern Recognition
A System and Vision Localization Method for the Opening of Railway Oil Tank Wagon Based on Shape Matching

Xuezhi Xiang,Zike Yan,Lei Zhang,Hanwei Tang,Yulong Qiao

DOI: https://doi.org/10.1109/jsen.2016.2521329

IF: 4.3

2016-01-01

IEEE Sensors Journal

Abstract:The opening localization for railway oil tank wagon using machine vision technology is an effective way to load petroleum automatically. In this paper, we introduce a localization system for the opening of railway oil tank wagon, which consists of industrial camera, lens, LED lighter, industrial PC, and IO module. In addition, we also propose a shape matching localization method, which can overcome the adverse effects produced by illumination changes, various types of railway oil tank wagon, and various poses of camera. The shape template is extracted from a standard opening image using edge detection and shape fitting methods, which can help avoid the randomness of template selection. An optimized similarity measure is exploited to avoid the edge extraction, so that the threshold setting of edge extraction can be avoided. In addition, we also exploit scalable template to find various types opening and exploit image pyramid during shape matching procedure to gain a speedup. The indoor and outdoor experiments show that the localization system and the proposed method fully meet the requirements of practical industrial applications.
Open-Set Object Recognition Using Mechanical Properties During Interaction

Pakorn Uttayopas,Xiaoxiao Cheng,Etienne Burdet

2023-11-03

Abstract:while most of the tactile robots are operated in close-set conditions, it is challenging for them to operate in open-set conditions where test objects are beyond the robots' knowledge. We proposed an open-set recognition framework using mechanical properties to recongise known objects and incrementally label novel objects. The main contribution is a clustering algorithm that exploits knowledge of known objects to estimate cluster centre and sizes, unlike a typical algorithm that randomly selects them. The framework is validated with the mechanical properties estimated from a real object during interaction. The results show that the framework could recognise objects better than alternative methods contributed by the novelty detector. Importantly, our clustering algorithm yields better clustering performance than other methods. Furthermore, the hyperparameters studies show that cluster size is important to clustering results and needed to be tuned properly.

Robotics,Artificial Intelligence
Machining Feature Recognition Using Descriptors with Range Constraints for Mechanical 3D Models

Seungeun Lim,Changmo Yeo,Fazhi He,Jinwon Lee,Duhwan Mun

DOI: https://doi.org/10.1007/s12541-023-00836-1

IF: 2.0411

2023-06-16

International Journal of Precision Engineering and Manufacturing

Abstract:In machining feature recognition, geometric elements generated in a three-dimensional computer-aided design model are identified. This technique is used in manufacturability evaluation, process planning, and tool path generation. Here, we propose a method of recognizing 16 types of machining features using descriptors, often used in shape-based part retrieval studies. The base face is selected for each feature type, and descriptors express the base face's minimum, maximum , and equal conditions. Furthermore, the similarity in the three conditions between the descriptors extracted from the target face and those from the base face is calculated. If the similarity is greater than or equal to the threshold, the target face is determined as the base face of the feature. Machining feature recognition tests were conducted for two test cases using the proposed method, and all machining features included in the test cases were successfully recognized. Moreover, we have compared the proposed method with the latest artificial neural network for test cases 3 and 4. As a result, the proposed method demonstrated a significantly higher recognition performance, with F1 scores of 0.94 and 1.0 for test cases 3 and 4, respectively, compared to the latest artificial neural networks (each with F1 scores of 0.86 and 0.49).

engineering, mechanical, manufacturing
Recognition of Glaucomatous Fundus Images Using Machine Learning Methods Based on Optic Nerve Head Topographic Features

Chao-Wei Wu,Tzu-Yu Huang,Yeong-Cheng Liou,Shih-Hsin Chen,Kwou-Yeung Wu,Han-Yi Tseng

DOI: https://doi.org/10.1097/ijg.0000000000002379

2024-03-29

Journal of Glaucoma

Abstract:Purpose: The aim was to compare the effectiveness of clinical discriminant rules and machine learning classifiers in identifying glaucomatous fundus images based on optic disc topographic features. Design: Retrospective case-control study. Methods: The study used a total of 800 fundus images, half of which were glaucomatous cases and the other half non- glaucomatous cases obtained from an open database and clinical work. The images were randomly divided into training and testing sets with equal numbers of glaucomatous and non-glaucomatous images. An ophthalmologist framed the edge of the optic cup and disc, and the program calculated five features, including the vertical cup-to-disc ratio and the width of the optic rim in four quadrants in pixels, used to create machine learning classifiers. The discriminative ability of these classifiers was compared with clinical discriminant rules. Results: The machine learning classifiers outperformed clinical discriminant rules, with the extreme gradient boosting method showing the best performance in identifying glaucomatous fundus images. Decision tree analysis revealed that the cup-to-disc ratio was the most important feature for identifying glaucoma fundus images. At the same time, the temporal width of the optic rim was the least important feature. Conclusions: Machine learning classifiers are an effective approach to detecting glaucomatous fundus images based on optic disc topographic features and integration with an automated program for framing and calculating the required parameters would make it a straightforward and effective approach.

ophthalmology
A new algorithm for real-time detection of window opening area in residential buildings

Yiqiao Liu,Wen Tong Chong,Yat Huang Yau,Di Han,Mingyuan Qin,Fei Deng,Xiyao Wang,Song Pan

DOI: https://doi.org/10.1016/j.buildenv.2023.110817

IF: 7.093

2023-09-11

Building and Environment

Abstract:The variation in window opening areas by individuals can lead to significant differences in air change rates, indirectly affecting indoor air quality and building energy consumption. While existing research primarily focuses on whether windows are open or closed due to data limitations, this study proposes a novel detection method for window opening areas based on the one-stage object detector You Only Look Once version 5 (YOLOv5). Two sub-models, YOLOv5s and YOLOv5l, were evaluated using training datasets of various sizes, and their performance was validated with test datasets and a video. The YOLOv5l_927 model emerged as the most generalizable, achieving a recognition accuracy exceeding 91% in both the training and test sets, outperforming the Faster R–CNN model by 12%–15%. Moreover, the YOLOv5l_927 model demonstrated real-time detection capabilities in a video, with an inference speed of 89 frames per second. The application of this method to monitor nine bedrooms revealed that 50% of the window opening operations involved adjustments between different opening areas. Occupants were more inclined to open the window area to 75–100%. This innovative detection method enhances the accuracy of building energy simulations by refining window opening behavior based on opening area.

engineering, environmental,construction & building technology, civil
A Dual-threshold Based Evidential Openmax Approach for Open Set Recognition

Zhuo Yang,Deqiang Han,Yi Yang,Jean Dezert

DOI: https://doi.org/10.23919/fusion59988.2024.10706494

2024-01-01

Abstract:Traditional pattern recognition systems, tasked with categorizing inputs into known classes, often struggle when they encounter samples they haven’t been trained to recognize. This introduces the need for the open set recognition—enhancing models to reject unidentified samples effectively. The Openmax method represents a significant breakthrough in this field by leveraging deep learning to spot and handle these new, unseen classes, broadening the traditional Softmax layer to accommodate an “unknown” class and employing a single threshold to separate the known from the unknown. However, the reliance of the original Openmax method on a single threshold may result in incorrect classifications if the parameters are not selected appropriately. To address this, we introduce a dual-threshold fusion mechanism based on Dempster-Shafer evidence theory in this paper. This approach releases the difficulty of finding a precise threshold in the complex and dynamic real-world environments. By integrating deep networks with a novel evidence-based system, the refined approach can bolster the robustness of rejecting undefined classes.
A Framework for Book Cover Recognition Based on Automatic Location and Segmentation

Liu Yujie,Li Wei

DOI: https://doi.org/10.3969/j.issn.1003-9775.2012.11.011

2012-01-01

Journal of Computer-Aided Design & Computer Graphics

Abstract:This paper put forward a framework for book recognition based on automatic location and segmentation,which includes the stage of book automatic location,ROI segmentation,standard shape correction,effective feature extraction and similarity matching.Automatic location and segmentation stage based on the geometric shape characteristic of book,takes effective regional orientation and ROI segmentation through the hough transform algorithm,and then correct the real book cover areas to a standard shape according to the inverse affine transformation.The stage of feature extraction and similarity matching mainly used the improved SIFT algorithm to conduct feature points detection and generate feature description,and then conduct the similarity matching by the popular BOW method which generates codebook and quantizes the features.The results of our experiments show that the accurate location and segmentation of the book cover from a image which contain some appropriate background and taking standard shape correction have a significant impact on the precision of recognition.
New optoelectronic morphological scheme for multiple-object recognition

zhongbing yao,minxian wu,guofan jin,guoliang huang,yingbai yan

DOI: https://doi.org/10.1117/12.183390

IF: 1.3

1994-01-01

Optical Engineering

Abstract:Based on the binary image algebra algorithm for a hit-or-miss transform of mathematical morphology, a new optoelectronic system with two parallel channels is set up for real-time multiple-object recognition. Two Dammann gratings are used for convolutions in morphological operations. The relation of rotation-recognizing sensitivity to the threshold values is discussed.
Know Yourself Better: Diverse Discriminative Feature Learning Improves Open Set Recognition

Jiawen Xu

2024-04-16

Abstract:Open set recognition (OSR) is a critical aspect of machine learning, addressing the challenge of detecting novel classes during inference. Within the realm of deep learning, neural classifiers trained on a closed set of data typically struggle to identify novel classes, leading to erroneous predictions. To address this issue, various heuristic methods have been proposed, allowing models to express uncertainty by stating "I don't know." However, a gap in the literature remains, as there has been limited exploration of the underlying mechanisms of these methods. In this paper, we conduct an analysis of open set recognition methods, focusing on the aspect of feature diversity. Our research reveals a significant correlation between learning diverse discriminative features and enhancing OSR performance. Building on this insight, we propose a novel OSR approach that leverages the advantages of feature diversity. The efficacy of our method is substantiated through rigorous evaluation on a standard OSR testbench, demonstrating a substantial improvement over state-of-the-art methods.

Computer Vision and Pattern Recognition,Machine Learning
SDFS: A new strategy for the recognition of object using range data

Xueyin Lin,Wee, W.G.

DOI: https://doi.org/10.1109/ROBOT.1986.1087421

1986-01-01

Abstract:Our goal is to develop a vision system using range image for the industrial application. In the system, simple basic surface primitives are considered and are extracted from the range image. From the robust geometric features contained in the primitives, rotation-invariant characteristics are then extracted to form smallest distinctive feature sets (SDFS). The set of SDFSs and the relationships between elements in SDFS and the kernel are stored to form the object model. The recognition process involves first extracting a set of SDFSs from the image and matching the extracted SDFSs with the stored SDFSs. If the kernels determined for SDFSs matched are consistent, object can be detected and its location and orientation in the viewer-centered coordinate system (VCC) can be determined.
OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation

Zhening Huang,Xiaoyang Wu,Xi Chen,Hengshuang Zhao,Lei Zhu,Joan Lasenby

2024-08-13

Abstract:In this work, we introduce OpenIns3D, a new 3D-input-only framework for 3D open-vocabulary scene understanding. The OpenIns3D framework employs a "Mask-Snap-Lookup" scheme. The "Mask" module learns class-agnostic mask proposals in 3D point clouds, the "Snap" module generates synthetic scene-level images at multiple scales and leverages 2D vision-language models to extract interesting objects, and the "Lookup" module searches through the outcomes of "Snap" to assign category names to the proposed masks. This approach, yet simple, achieves state-of-the-art performance across a wide range of 3D open-vocabulary tasks, including recognition, object detection, and instance segmentation, on both indoor and outdoor datasets. Moreover, OpenIns3D facilitates effortless switching between different 2D detectors without requiring retraining. When integrated with powerful 2D open-world models, it achieves excellent results in scene understanding tasks. Furthermore, when combined with LLM-powered 2D models, OpenIns3D exhibits an impressive capability to comprehend and process highly complex text queries that demand intricate reasoning and real-world knowledge. Project page: <a class="link-external link-https" href="https://zheninghuang.github.io/OpenIns3D/" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition

Recognition of Object’s Opening Features Using Machine Learning

Wedge Angle and Orientation Recognition of Multi-Opening Objects Using an Attention-Based CNN Model

Online Double-Sided Identification and Eliminating System of Unclosed-Glumes Rice Seed Based on Machine Vision

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

Detecting Object Open Angle and Direction Using Machine Learning

Object Wedge Angle and Direction Identification Using Machine Learning Algorithms

Annular Region Statistical Feature-based Recognition of Bearing Rings under Non-exact Positioning

Vision-based Keyhole Detection and Parameter Extraction in Door Opening Task

Machining Feature Recognition In Polyhedrons

OpenSight: A Simple Open-Vocabulary Framework for LiDAR-Based Object Detection

A System and Vision Localization Method for the Opening of Railway Oil Tank Wagon Based on Shape Matching

Open-Set Object Recognition Using Mechanical Properties During Interaction

Machining Feature Recognition Using Descriptors with Range Constraints for Mechanical 3D Models

Recognition of Glaucomatous Fundus Images Using Machine Learning Methods Based on Optic Nerve Head Topographic Features

A new algorithm for real-time detection of window opening area in residential buildings

A Dual-threshold Based Evidential Openmax Approach for Open Set Recognition

A Framework for Book Cover Recognition Based on Automatic Location and Segmentation

New optoelectronic morphological scheme for multiple-object recognition

Know Yourself Better: Diverse Discriminative Feature Learning Improves Open Set Recognition

SDFS: A new strategy for the recognition of object using range data

OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation