A fast multi-scale convolutional neural network for object recognition

Shaohua Li,Huimin Huang,Yue Zhang,Ming Liu

2015-01-01

Abstract:A Fast Multi-scale Convolutional Neural Network for Object Recognition.

What problem does this paper attempt to address?

Fast Object Detection and Recognition Algorithm Based on Improved Multi-Scale Feature Maps

Shan Qianwen,Zheng Xinbo,He Xiaohai,Teng Qizhi,Wu Xiaohong

DOI: https://doi.org/10.3788/lop56.021002

2019-01-01

Laser & Optoelectronics Progress

Abstract:Aiming at the precision and real-time requirements of object detection and recognition, a fast object detection and recognition algorithm is proposed based on the improved multi-scale feature maps. In this algorithm, the convolutional neural network is adopted to automatically extract the multi-scale feature maps based on the original SSD model, and a fusion module of effective convolutional feature maps is constructed. Meanwhile, the lightweight compact bilinear fusion method is introduced to enrich the context information. Moreover, through the channel attention mechanism, the relationship among all channels of feature maps is adaptively learned. The useful information is emphasized, in contrast the redundant information is suppressed. Thus the discriminability of feature maps is boosted. The enhanced feature maps arc then used in the detection model. The experimental results show that the proposed algorithm is more efficient than the other similar algorithms and the recognition precision is obviously improved, meanwhile, the speed of proposed algorithm is up to 63 frame.s(-1). The recognition precision and speed arc well balanced.
A Deep Learning Framework Using Convolutional Neural Network for Multi-Class Object Recognition

Shaukat Hayat,She Kun,Zuo Tengtao,Yue Yu,Tianyi Tu,Yantong Du

DOI: https://doi.org/10.1109/ICIVC.2018.8492777

2018-01-01

Abstract:Object recognition is classic technique used to effectively recognize an object in the image. Technologies specifically in field of computer vision are expected to detect and recognize more complex tasks with help of local features detection methods. Over the last decade, there has been sustained increase in the number of researchers from various kind of disciplines i.e. academia, industry, security agencies and even from general public has caught an attention to explore the covered aspects of object detection and recognition concerned problems. It is further significantly amended by adopting deep learning model. In this paper, we applied deep learning to multi-class object recognition and explore convolutional neural network (CNN). The convolutional neural network is created with normalized standard initialization and trained with training set of sample images from 9 different object categories plus sample test images using widely varied dataset. All results are implemented in python tensorflow framework. We examine and compared CNN results with final feature vectors extracted from variant approaches of BOW based on linear L2-SVM classifier. Based on it, sufficient experiments verify our CNN model effectiveness and robustness with rate of 90.12% accuracy.
Multiple Instance Learning Convolutional Neural Networks for Object Recognition

Miao Sun,Tony X. Han,Ming-Chang Liu,Ahmad Khodayari-Rostamabad

DOI: https://doi.org/10.48550/arXiv.1610.03155

2016-10-11

Abstract:Convolutional Neural Networks (CNN) have demon- strated its successful applications in computer vision, speech recognition, and natural language processing. For object recog- nition, CNNs might be limited by its strict label requirement and an implicit assumption that images are supposed to be target- object-dominated for optimal solutions. However, the labeling procedure, necessitating laying out the locations of target ob- jects, is very tedious, making high-quality large-scale dataset prohibitively expensive. Data augmentation schemes are widely used when deep networks suffer the insufficient training data problem. All the images produced through data augmentation share the same label, which may be problematic since not all data augmentation methods are label-preserving. In this paper, we propose a weakly supervised CNN framework named Multiple Instance Learning Convolutional Neural Networks (MILCNN) to solve this problem. We apply MILCNN framework to object recognition and report state-of-the-art performance on three benchmark datasets: CIFAR10, CIFAR100 and ILSVRC2015 classification dataset.

Computer Vision and Pattern Recognition
Face Recognition Based on Improved Multiscale Convolutional Neural Network

Shuang Liu,Xuemei Lei,Zheng Li

DOI: https://doi.org/10.1145/3398329.3398350

2020-01-01

Abstract:Image feature extraction using convolution neural network has been widely used in face recognition and other image recognition problems.A face recognition algorithm based on improved multi-scale convolutional neural network is proposed in this paper. The algorithm first performs histogram equalization on the input image to increase the contrast of the face image. The neural network structure only contains three convolution layers. The features extracted by convolution of each layer are fused and then input into Softmax for classification. The algorithm has few network layers and simple structure, and can fully extract face features. The recognition rates are 99.4% and 98.9% respectively in ORL and Yale's small face data sets.
Facial expression recognition with multi-scale convolution neural network

Wang Jieru,Yuan C Hun

DOI: https://doi.org/10.1007/978-3-319-48890-5_37

2016-01-01

Abstract:We present a deep convolutional neural network (CNN) architecture for facial expression recognition. Inspired by the fact that regions located around certain facial parts (e.g. mouth, nose, eyes, and brows) contain the most representative information of expressions, an architecture extracts features at different scale from intermediate layers is designed to combine both local and global information. In addition, noticing that in specific to facial expression recognition, traditional face alignment would distort the images and lose expression information. To avoid this side effect, we apply batch normalization to the architecture instead of face alignment and feed the network with original images. Moreover, considering the tiny differences between classes caused by the same facial movements, a triplet-loss learning method is used to train the architecture, which improves the discrimination of deep features. Experiments show that the proposed architecture achieves superior performance to other state-of-the-art methods on the FER2013 dataset. © Springer International Publishing AG 2016.
Scalable Object Detection Using Deep But Lightweight Cnn With Features Fusion

Qiaosong Chen,Shangsheng Feng,Pei Xu,Lexin Li,Ling Zheng,Jin Wang,Xin Deng

DOI: https://doi.org/10.1007/978-3-319-71607-7_33

2017-01-01

Abstract:Recently, deep Convolutional Neural Network (CNN) is becoming more and more popular in pattern recognition, and have achieved impressive performance in multi-category datasets. Most object detection system include three main parts, CNN features extraction, region proposal and ROI classification, just like Fast R-CNN and Faster R-CNN. In this paper, a deep but lightweight CNN with features fusion is presented, and our work is focused on the improvement of the features extraction part in Faster R-CNN framework. Inspired by recent technical innovation structures, such as Inception, HyperNet and multi-scale construction, the proposed network is able to result in lower computation consumption with considerable deep layers. Besides, the network is trained with the help of data augmentation, fine-tune and batch normalization. In order to apply scalable with features fusion, there are different sampling methods for different layers, and various size kernel to extract both global and local features. Then fuse these features together, which can deal with diverse size object. The experimental results shows that our method have achieved better performance than Faster R-CNN with VGG16 on VOC2007, VOC2012 and KITTI datasets while maintaining the original speed.
Multi-scale Matching Networks for Semantic Correspondence

Dongyang Zhao,Ziyang Song,Zhenghao Ji,Gangming Zhao,Weifeng Ge,Yizhou Yu

DOI: https://doi.org/10.48550/arXiv.2108.00211

2021-08-27

Abstract:Deep features have been proven powerful in building accurate dense semantic correspondences in various previous works. However, the multi-scale and pyramidal hierarchy of convolutional neural networks has not been well studied to learn discriminative pixel-level features for semantic correspondence. In this paper, we propose a multi-scale matching network that is sensitive to tiny semantic differences between neighboring pixels. We follow the coarse-to-fine matching strategy and build a top-down feature and matching enhancement scheme that is coupled with the multi-scale hierarchy of deep convolutional neural networks. During feature enhancement, intra-scale enhancement fuses same-resolution feature maps from multiple layers together via local self-attention and cross-scale enhancement hallucinates higher-resolution feature maps along the top-down hierarchy. Besides, we learn complementary matching details at different scales thus the overall matching score is refined by features of different semantic levels gradually. Our multi-scale matching network can be trained end-to-end easily with few additional learnable parameters. Experimental results demonstrate that the proposed method achieves state-of-the-art performance on three popular benchmarks with high computational efficiency.

Computer Vision and Pattern Recognition
Deep Multi-scale Learning on Point Sets for 3D Object Recognition.

Yang Xiao,Yanxin Ma,Min Zhou,Jun Zhang

DOI: https://doi.org/10.1007/978-981-13-1702-6_34

2018-01-01

Abstract:In recent years, point cloud data based 3D deep learning has become a popular method for three-dimensional object recognition. In this work, we introduce a multi-scale convolution neural network which takes point cloud as input for 3D object recognition. Our network structure consists of two parts which are the feature extraction structure and the feature processing part. Experiments are conducted on the ModelNet40 dataset with several state-of-the-art methods. The proposed method achieves a higher accuracy on 3D object recognition with 87.1%. Experimental results have demonstrated the superior performance of the proposed multi-scale feature learning network.
Fully Convolutional Network with Densely Feature Fusion Models for Object Detection

Shouzhi Huang,Xiaoyu Li,Zhuqing Jiang,Xiaoqiang Guo,Aidong Men

DOI: https://doi.org/10.1109/icmew.2018.8551503

2018-01-01

Abstract:We present Fully Convolutional Networks with Densely Feature Fusion Models (DFF-FCN) which is an effective framework for multi-scale object detection. DFF-FCN reuses the inherent convolutional hierarchical features of regular convolutional neural networks from both forward and backward directions so that the highly semantic features incorporate with shallow high-resolution features complementarily. We propose a new fully convolutional network to build feature pyramids to construct semantic features at all levels using a single neural network so that the multi-scale features all have enough detail and semantic information for object detection tasks. We also add another branch to predict objectness in order to reduce the searching space of objects. Our network runs at the speed of 20 FPS (frame per second) which is faster than Faster R-CNN counterpart and our method gets better detection performance.
Multi-scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks

Zhipeng Deng,Hao Sun,Shilin Zhou,Juanping Zhao,Lin Lei,Huanxin Zou

DOI: https://doi.org/10.1016/j.isprsjprs.2018.04.003

IF: 12.7

2018-01-01

ISPRS Journal of Photogrammetry and Remote Sensing

Abstract:Automatic detection of multi-class objects in remote sensing images is a fundamental but challenging problem faced for remote sensing image analysis. Traditional methods are based on hand-crafted or shallow-learning-based features with limited representation power. Recently, deep learning algorithms, especially Faster region based convolutional neural networks (FRCN), has shown their much stronger detection power in computer vision field. However, several challenges limit the applications of FRCN in multi-class objects detection from remote sensing images: (1) Objects often appear at very different scales in remote sensing images, and FRCN with a fixed receptive field cannot match the scale variability of different objects; (2) Objects in large-scale remote sensing images are relatively small in size and densely peaked, and FRCN has poor localization performance with small objects; (3) Manual annotation is generally expensive and the available manual annotation of objects for training FRCN are not sufficient in number. To address these problems, this paper proposes a unified and effective method for simultaneously detecting multi-class objects in remote sensing images with large scales variability. Firstly, we redesign the feature extractor by adopting Concatenated ReLU and Inception module, which can increases the variety of receptive field size. Then, the detection is preformed by two sub-networks: a multi-scale object proposal network (MS-OPN) for object-like region generation from several intermediate layers, whose receptive fields match different object scales, and an accurate object detection network (AODN) for object detection based on fused feature maps, which combines several feature maps that enables small and densely packed objects to produce stronger response. For large-scale remote sensing images with limited manual annotations, we use cropped image blocks for training and augment them with re-scalings and rotations. The quantitative comparison results on the challenging NWPU VHR-10 data set, aircraft data set, Aerial-Vehicle data set and SAR-Ship data set show that our method is more accurate than existing algorithms and is effective for multi-modal remote sensing images.
Multi-task Cascade Deep Convolutional Neural Networks for Large-Scale Commodity Recognition

Xiaofeng Zou,Liqian Zhou,Kenli Li,Aijia Ouyang,Cen Chen

DOI: https://doi.org/10.1007/s00521-019-04311-9

2020-01-01

Neural Computing and Applications

Abstract:In recent years, deep convolutional neural network have achieved remarkable performance in object detection and image classification. However, there are still some practical challenges in large-scale image recognition tasks. To be specific, the visual separability between different object categories is extremely uneven, and some categories have strong inter-class similarities. Existing CNN networks are trained as flat n-way classifiers, which is usually not sufficient to meet the challenges. Hence, we propose a framework: multi-task cascade deep convolutional neural network (MTCD-CNN), which contains two phases: object detection and hierarchical image classification, for large-scale commodity recognition. First, the object detection framework is utilized to locate and crop the areas that may contain objects. Then, hierarchical spectrum clustering is adopted to construct a category and a tree-like image classification model. During the testing phase, the indistinguishable objects are classified from coarse to fine by searching the path of the category tree. The proposed hierarchical image classification method provides an insight into the data by identifying the group of classes that are hard to classify and require more attention when compared to others. Through extensive experiments and comparative analyses of commodity detection in supermarkets and stores of Jinzhou city, the performance of MTCD-CNN has proved to be superior to other advanced methods, indicating that our proposed method has effectively solved the problem of excessive similarity of confusingly similar categories.
Multi-scale Fusion with Context-aware Network for Object Detection

Hanyuan Wang,Jie Xu,Linke Li,Ye Tian,Du Xu,Shizhong Xu

DOI: https://doi.org/10.1109/icpr.2018.8545860

2018-01-01

Abstract:Almost all of the state-of-the-art object detectors employ convolutional neural network (CNN) to extract feature. However, how to fully utilize spatial information is a challenge. In this paper, we propose an effective framework for object detection. Our motivation is that multi-scale representation and context are extremely important for object detection. For multi-scale representation, our mothed combines hierarchical feature maps to a fusion map, which has abundant spatial information and high-level semantics. For context, we exploit spatial information by stacking multi-region feature maps. The network is learned end-to-end, by minimize an objective function. Our network achieves competitive results, 75.9% mAP on PASCAL VOC 2007, 72.0% mAP on PASCAL VOC 2012 and 23.2% mAP on MS COCO. The speed of the network is 10 fps. Our studies demonstrate that multi-scale representation and context can further improve performance of object detection.
SRC: transferring scale-independent features to support multi-scale object recognition with deep convolutional neural network.

Xiran Zhou

DOI: https://doi.org/10.1145/3307599.3307605

2019-01-01

Abstract:Object detection is an essential remote sensing data application that attempts to detect and recognize semantically meaningful instances from complicated context and background [1]. Recently, a great number of works have reported that the state-of-the-art convolutional neural networks (CNNs), significantly facilitates automatically detecting a predefined class of object from high resolution aerial or satellite imageries [2]. However, different from the object in a photo, the objects in remote sensing imageries are always represented by largely varied scale or spatial resolution. Scale has become a critical attribute for recognizing an object from aerial or satellite imagery [3]. Up to now, the state-of-the-art DCNNs for object detection requires predefined scale, which produces a big challenge to automatically adjust the representative scale for an object on the ground [3-4].
Multi-scale coupled attention for visual object detection

Fei Li,Hongping Yan,Linsu Shi

DOI: https://doi.org/10.1038/s41598-024-60897-8

2024-05-16

Abstract:The application of deep neural network has achieved remarkable success in object detection. However, the network structures should be still evolved consistently and tuned finely to acquire better performance. This gears to the continuous demands on high performance in those complex scenes, where multi-scale objects to be detected are located here and there. To this end, this paper proposes a network structure called Multi-Scale Coupled Attention (MSCA) under the framework of self-attention learning with methodologies of importance assessment. Architecturally, it consists of a Multi-Scale Coupled Channel Attention (MSCCA) module, and a Multi-Scale Coupled Spatial Attention (MSCSA) module. Specifically, the MSCCA module is developed to achieve the goal of self-attention learning linearly on the multi-scale channels. In parallel, the MSCSA module is constructed to achieve this goal nonlinearly on the multi-scale spatial grids. The MSCCA and MSSCA modules can be connected together into a sequence, which can be used as a plugin to develop end-to-end learning models for object detection. Finally, our proposed network is compared on two public datasets with 13 classical or state-of-the-art models, including the Faster R-CNN, Cascade R-CNN, RetinaNet, SSD, PP-YOLO, YOLO v3, YOLO v5, YOLO v7, YOLOX, DETR, conditional DETR, UP-DETR and FP-DETR. Comparative experimental results with numerical scores, the ablation study, and the performance behaviour all demonstrate the effectiveness of our proposed model.
Fast Object Recognition Using Local Scale-Invariant Features

周志强,汪渤,杨杰,吕冀

DOI: https://doi.org/10.3321/j.issn:1002-1582.2008.05.017

2008-01-01

Optical Technique

Abstract:Methods for generating local scale invariant features are introduced.These scale invariant features are used in object recognition.In order to improve the efficiency of object recognition,the feature points are detected and matched from large scale to small scale using hybrid multi-scale representation,which has integrated the advantages of pyramids and scale-space representation.This repeat process doesn't terminate until the recognition has completed.Experiment results show that this method has reduced the time of recognition effectively.
A Multi-Scale Fusion Convolutional Neural Network for Face Detection.

Qiaosong Chen,Xiaomin Meng,Wen Li,Xingyu Fu,Xin Deng,Jin Wang

DOI: https://doi.org/10.1109/smc.2017.8122743

2017-01-01

Abstract:Nowadays, more and more methods have been proposed to solve the problem of face detection based on computer implementation. Due to the variations in background, illumination, pose and facial expressions, the problem of machine face detection is complex. Recently, deep learning approaches achieve an impressive performance on face detection. In this paper, a model named Multi-Scale Fusion Convolutional Neural Network (MSF-CNN) is proposed to train the face detector. The model is trained by Convolutional Neural Network and detecting is based on the Viola & Jones detector's sliding windows structure. Particularly, in the process of feature extraction, we adopt the design of multi-scale feature fusion with different scale convolution kernels. The results are as follows: First, the fusion of multi-scale features are rich in the characteristics of learning, and the classification accuracy is higher than the single-scale. Second, we decrease the model of complexity compared with existed methods of the cascaded CNN. Third, we achieve end-to-end learning compared with cascaded separate training. Meanwhile, the proposed model has showed that the performance of results outperforms the previous methods in some well-known face detection benchmark datasets.
Transferring Scale-Independent Features to Support Multi-Scale Object Recognition with Deep Convolutional Neural Network

Xiran Zhou

DOI: https://doi.org/10.1145/3274895.3282797

2018-01-01

Abstract:Objects are always represented by different scales on remote sensing imageries, which poses challenges for the state-of-the-art convolutional neural networks for multi-scale object recognition. This paper proposes atrous region proposal to facilitating detect other objects within different scales in an ad-hoc manner.
Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Haobin Dou,Xihong Wu

DOI: https://doi.org/10.1109/ijcnn.2015.7280542

2015-01-01

Abstract:Convolutional Neural Networks (CNNs) have become forceful models in feature learning and image classification. They achieve translation invariance by spatial convolution and pooling mechanisms, while their ability in scale invariance is limited. To tackle the problem of scale variation in image classification, this work proposed a multi-scale CNN model with depth-decreasing multi-column structure. Input images were decomposed into multiple scales and at each scale image, a CNN column was instantiated with its depth decreasing from fine to coarse scale for model simplification. Scale-invariant features were learned by weights shared across all scales and pooled among adjacent scales. Particularly, a coarse-to-fine pre-training method imitating the human's development of spatial frequency perception was proposed to train this multi-scale CNN, which accelerated the training process and reduced the classification error. In addition, model averaging technique was used to combine models obtained during pre-training and further improve the performance. With these methods, our model achieved classification errors of 15.38% on CIFAR-10 dataset and 41.29% on CIFAR-100 dataset, i.e. 1.05% and 2.97% reduction compared with single-scale CNN model.
Multi-scale unsupervised feature learning for face recognition

Xiaoyan YIN,Zhiyong FENG,Chao XU

DOI: https://doi.org/10.3778/j.issn.1002-8331.1409-0076

2016-01-01

Abstract:In order to fully utilize latent information of human face, a method called Multi-Scale Convolutional Auto-Encoder(MSCAE)is proposed. MSCAE extracts image’s multi-scale features using different sizes of convolution kernels. Since the new features reflect natural facial contents, human face can be restored better. The MSCAE applies a hierarchy of alternating filtering and sub sampling, and it makes features invariant to deformations including rotation, translation, and scale. The form of encoder-decoder is introduced to train the MSCAE so as to obtain the feature extractor and vectors combining multi-scale features for further classification. Experiments are conducted with Neural Network(NN)on ORL and Yale face datasets, and the experimental results suggest that multi-scale features are superior to single-scale ones on recognition rate and efficiency. Furthermore, fusion features of MSCAE and Histograms of Oriented Gradients(HOG)can get higher recognition rate than either of them.
An Efficient Deep Convolutional Neural Network Approach for Object Detection and Recognition Using a Multi-Scale Anchor Box in Real-Time

Vijayakumar Varadarajan,Dweepna Garg,Ketan Kotecha

DOI: https://doi.org/10.3390/fi13120307

2021-11-29

Future Internet

Abstract:Deep learning is a relatively new branch of machine learning in which computers are taught to recognize patterns in massive volumes of data. It primarily describes learning at various levels of representation, which aids in understanding data that includes text, voice, and visuals. Convolutional neural networks have been used to solve challenges in computer vision, including object identification, image classification, semantic segmentation and a lot more. Object detection in videos involves confirming the presence of the object in the image or video and then locating it accurately for recognition. In the video, modelling techniques suffer from high computation and memory costs, which may decrease performance measures such as accuracy and efficiency to identify the object accurately in real-time. The current object detection technique based on a deep convolution neural network requires executing multilevel convolution and pooling operations on the entire image to extract deep semantic properties from it. For large objects, detection models can provide superior results; however, those models fail to detect the varying size of the objects that have low resolution and are greatly influenced by noise because the features after the repeated convolution operations of existing models do not fully represent the essential characteristics of the objects in real-time. With the help of a multi-scale anchor box, the proposed approach reported in this paper enhances the detection accuracy by extracting features at multiple convolution levels of the object. The major contribution of this paper is to design a model to understand better the parameters and the hyper-parameters which affect the detection and the recognition of objects of varying sizes and shapes, and to achieve real-time object detection and recognition speeds by improving accuracy. The proposed model has achieved 84.49 mAP on the test set of the Pascal VOC-2007 dataset at 11 FPS, which is comparatively better than other real-time object detection models.

A fast multi-scale convolutional neural network for object recognition

Fast Object Detection and Recognition Algorithm Based on Improved Multi-Scale Feature Maps

A Deep Learning Framework Using Convolutional Neural Network for Multi-Class Object Recognition

Multiple Instance Learning Convolutional Neural Networks for Object Recognition

Face Recognition Based on Improved Multiscale Convolutional Neural Network

Facial expression recognition with multi-scale convolution neural network

Scalable Object Detection Using Deep But Lightweight Cnn With Features Fusion

Multi-scale Matching Networks for Semantic Correspondence

Deep Multi-scale Learning on Point Sets for 3D Object Recognition.

Fully Convolutional Network with Densely Feature Fusion Models for Object Detection

Multi-scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks

Multi-task Cascade Deep Convolutional Neural Networks for Large-Scale Commodity Recognition

Multi-scale Fusion with Context-aware Network for Object Detection

SRC: transferring scale-independent features to support multi-scale object recognition with deep convolutional neural network.

Multi-scale coupled attention for visual object detection

Fast Object Recognition Using Local Scale-Invariant Features

A Multi-Scale Fusion Convolutional Neural Network for Face Detection.

Transferring Scale-Independent Features to Support Multi-Scale Object Recognition with Deep Convolutional Neural Network

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Multi-scale unsupervised feature learning for face recognition

An Efficient Deep Convolutional Neural Network Approach for Object Detection and Recognition Using a Multi-Scale Anchor Box in Real-Time