A Comparative Study of Mobile-Based Landmark Recognition Techniques

Kim-Hui Yap,Tao Chen,Zhen Li,Kui Wu

DOI: https://doi.org/10.1109/MIS.2010.12

IF: 6.744

2010-01-01

IEEE Intelligent Systems

Abstract:Mobile-based landmark recognition is becoming increasingly appealing due to the proliferation of mobile devices coupled with improving processing techniques, imaging capability, and networking infrastructure.

What problem does this paper attempt to address?

A Survey on Mobile Landmark Recognition for Information Retrieval

Tao Chen,Kui Wu,Kim-Hui Yap,Zhen Li,Flora S. Tsai

DOI: https://doi.org/10.1109/MDM.2009.107

2009-01-01

Abstract:The growing usage of mobile devices has led to proliferation of many mobile applications. A growing trend in mobile applications is centered on mobile landmark recognition. It is a new mobile application that recognizes a captured landmark using the mobile device and retrieves related information. This paper will present a survey on mobile landmark recognition for information retrieval. A general overview of existing mobile landmark recognition systems will be summarized. The techniques and algorithms used in the literatures, including content analysis of landmarks and classification methods for recognition, will be described.
Integrated Content and Context Analysis for Mobile Landmark Recognition

Tao Chen,Kim-Hui Yap,Lap-Pui Chau

DOI: https://doi.org/10.1109/tcsvt.2011.2161413

IF: 5.859

2011-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This paper proposes a new approach for mobile landmark recognition based on integrated content and context analysis. Conventional scene/landmark recognition methods focus mainly on nonmobile desktop/PC platform, where content analysis alone is used to perform landmark recognition. These nonmobile systems, however, do not take unique features of mobile devices into consideration, e.g., limited computational power and fast response time requirement of mobile users. On the contrary, most existing context-aware content mobile landmark recognition methods mainly rely on global positioning system location information for context analysis. In view of this, this paper proposes an effective method that employs an integration of content and context analysis to perform landmark recognition using mobile devices. A new bags-of-words (BoW) framework is developed to perform content analysis. It is then integrated with context analysis involving fusion of location and direction information to perform mobile landmark recognition. Experimental results based on the NTU50Landmark database show that the proposed method can achieve good recognition performance in mobile landmark recognition.
A Discriminative Learning Technique For Mobile Landmark Recognition

Tao Chen,Kim-Hui Yap,Lap-Pui Chau

DOI: https://doi.org/10.1109/ICIP.2011.6116033

2011-01-01

Abstract:This paper proposes a discriminative learning bags-of-words (BoW) approach for mobile landmark recognition at patch and image levels. Conventional methods often treat the local patches and images equally important for recognition and do not differentiate their different importance. Although there exist several works that consider the patches' discrimination information, they mainly focus on which patches are to be retained for training and do not incorporate this information when generating the BoW histograms. In view of this, this paper proposes to learn the discriminative information for each landmark category at two levels: local patches and images. At patch level, the patches' discrimination information for each landmark is first discovered using an iterative learning approach. This information is then incorporated into the quantization process to generate the BoW histogram. At image level, the different importance of training images is estimated through a non-parametric density estimator. Finally, fuzzy SVM is used to train the classifier for each category. Experimental results on a landmark database consisting of 3622 training images and 534 testing images show that the proposed method is effective in mobile landmark recognition.
A Lightweight Mobile-Anchor-Based Multi-Target Outdoor Localization Scheme Using LoRa Communication

Huimin Chen,Fangyuan Xing,Qianqian Yang,Yuanchao Shu,Zhiguo Shi,Jiming Chen,Zhen Tao

DOI: https://doi.org/10.1109/tgcn.2023.3236630

2023-01-01

IEEE Transactions on Green Communications and Networking

Abstract:In recent years, multi-target localization has been identified as an essential technology for delivering on the promise of the Internet of Things (IoT). Multi-target localization has been well-studied and widely deployed in conventional communications systems, but the techniques used in such systems are largely unable to meet the power, cost, and accuracy requirements needed for IoT. In this article, we propose a lightweight Mobile Anchor multi-tarGet IoT loCalization system (MAGIC), which is capable of localizing multiple targets in a low-power and cost efficient manner. MAGIC utilizes a single mobile anchor consisting of a LoRa gateway and a commercial smartphone in order to localize multiple IoT devices embedded with LoRa tags. The anchor moves and communicates with the LoRa tags from multiple locations, greatly reducing the deployment cost compared to a more traditional system with multiple stationary anchors. We formulate the path planning optimization problem of the mobile anchor to minimize the path length while fully accounting for environmental uncertainties. To efficiently solve the optimization problem, we design an online moving strategy that generates the path in real-time as the anchor moves. Through simulation and experimental studies we demonstrate the effectiveness of the proposed scheme both in an empty baseline environment and in a complicated setting around the buildings. Results indicate that our scheme can significantly enhance the localization accuracy and reduce the required path length for the anchor. Compared to the existing outdoor localization systems, the proposed approach shows advantages not only in the localization accuracy but also the overall cost including device cost, spectrum usage and energy consumption.
Context-Aware Discriminative Vocabulary Learning for Mobile Landmark Recognition.

Tao Chen,Kim-Hui Yap

DOI: https://doi.org/10.1016/j.dsp.2013.09.002

IF: 5.859

2013-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Recently, mobile landmark recognition has become one of the emerging applications in mobile media, offering landmark information and e-commerce opportunities to both mobile users and business owners. Existing mobile landmark recognition techniques mainly use GPS (Global Positioning System) location information to obtain a shortlist of database landmark images nearby the query image, followed by visual content analysis within the shortlist. This is insufficient since (i) GPS data often has large errors in dense build-up areas, and (ii) direction data that can be acquired from mobile devices is underutilized to further improve recognition. In this paper, we propose to integrate content and context in an effective and efficient vocabulary tree framework. Specifically, visual content and two types of mobile context: location and direction, can be integrated by the proposed Context-aware Discriminative Vocabulary Tree Learning (CDVTL) algorithm. The experimental results show that the proposed mobile landmark recognition method outperforms the state-of-the-art methods by about 6%, 21% and 13% on NTU Landmark-50, PKU Landmark-198 and the large-scale San Francisco landmark dataset, respectively.
Learning Compact Visual Descriptors For Low Bit Rate Mobile Landmark Search

Ling-Yu Duan,Jie Chen,Rongrong Ji,Tiejun Huang,Wen Gao

DOI: https://doi.org/10.1609/aimag.v34i2.2469

IF: 0.9

2013-01-01

AI Magazine

Abstract:Along with the ever-growing computational power of mobile devices, mobile visual search has undergone an evolution in techniques and applications. A significant trend is low bit rate visual search, where compact visual descriptors are extracted directly over a mobile and delivered as queries rather than raw images to reduce the query transmission latency. In this article, we introduce our work on low bit rate mobile landmark search, in which a compact yet discriminative landmark image descriptor is extracted by using a location context such as GPS, crowd-sourced hotspot WLAN, and cell tower locations. The compactness originates from the bag-of-words image representation, with off line learning from geotagged photos from online photo-sharing websites including Flickr and Panoramio. The learning process involves segmenting the landmark photo collection by discrete geographical regions using a Gaussian mixture model and then boosting a ranking-sensitive vocabulary within each region, with "entropy"-based feedback on the compactness of the descriptor to refine both phases iteratively. In online search, when entering a geographical region, the code book in a mobile device is downstream adapted to generate extremely compact descriptors with promising discriminative ability. We have deployed landmark search apps to both HTC and iPhone mobile phones, accessing a database of a million scale images in typical areas like Beijing, New York, and Barcelona, and others. Our descriptor outperforms alternative compact descriptors (Chen et al. 2009; Chen et al., 2010; Chandrasekhar et al. 2009a; Chandrasekhar et al. 2009b) by significant margins. Beyond landmark search, this article will summarize the MPEG standarization progress of compact descriptor for visual search (CDVS) (Yuri et al. 2010; Yuri et al. 2011) toward application interoperability.
A Review of Smartphones‐based Indoor Positioning: Challenges and Applications

Khuong An Nguyen,Zhiyuan Luo,Guang Li,Chris Watkins

DOI: https://doi.org/10.1049/csy2.12004

2021-01-01

IET Cyber-Systems and Robotics

Abstract:Abstract The continual proliferation of mobile devices has encouraged much effort in using the smartphones for indoor positioning. This article is dedicated to review the most recent and interesting smartphones‐based indoor navigation systems, ranging from electromagnetic to inertia to visible light ones, with an emphasis on their unique challenges and potential real‐world applications. A taxonomy of smartphone sensors will be introduced, which serves as the basis to categorise different positioning systems for reviewing. A set of criteria to be used for the evaluation purpose will be devised. For each sensor category, the most recent, interesting, and practical systems will be examined, with detailed discussion on the open research questions for the academics, and the practicality for the potential clients.
Last-Mile Navigation Using Smartphones

Yuanchao Shu,Kang G. Shin,Tian He,Jiming Chen

DOI: https://doi.org/10.1145/2789168.2790099

2015-01-01

Abstract:Although GPS has become a standard component of smartphones, providing accurate navigation during the last portion of a trip remains an important but unsolved problem. Despite extensive research on localization, the limited resolution of a map imposes restrictions on the navigation engine in both indoor and outdoor environments. To bridge the gap between the end position obtained from legacy navigation services and the real destination, we propose FollowMe, a "last-mile" navigation system to enable plug-and-play navigation in indoor and semi-outdoor environments. FollowMe exploits the ubiquitous, stable geomagnetic field and natural walking patterns to navigate the users to the same destination taken by an earlier traveler. Unlike existing localization and navigation systems, FollowMe is infrastructure-free, energy-efficient and cost-saving. We implemented FollowMe on smartphones, and evaluated it in a four-story campus building with a testing area of 2000m 2 . Our experimental results with 5 users show that 95% of spatial errors during navigation were 2m or less with at least 50% energy savings over a benchmark system.
Design of an Enhanced Visual Odometry by Building and Matching Compressive Panoramic Landmarks Online

Wei Lu,Zhi-yu Xiang,Ji-lin Liu

DOI: https://doi.org/10.1631/fitee.1400139

2015-01-01

Abstract:Efficient and precise localization is a prerequisite for the intelligent navigation of mobile robots. Traditional visual localization systems, such as visual odometry (VO) and simultaneous localization and mapping (SLAM), suffer from two shortcomings: a drift problem caused by accumulated localization error, and erroneous motion estimation due to illumination variation and moving objects. In this paper, we propose an enhanced VO by introducing a panoramic camera into the traditional stereo-only VO system. Benefiting from the 360° field of view, the panoramic camera is responsible for three tasks: (1) detecting road junctions and building a landmark library online; (2) correcting the robot’s position when the landmarks are revisited with any orientation; (3) working as a panoramic compass when the stereo VO cannot provide reliable positioning results. To use the large-sized panoramic images efficiently, the concept of compressed sensing is introduced into the solution and an adaptive compressive feature is presented. Combined with our previous two-stage local binocular bundle adjustment (TLBBA) stereo VO, the new system can obtain reliable positioning results in quasi-real time. Experimental results of challenging long-range tests show that our enhanced VO is much more accurate and robust than the traditional VO, thanks to the compressive panoramic landmarks built online.
Content and context information fusion for mobile landmark recognition

tao chen,kimhui yap,lappui chau

DOI: https://doi.org/10.1109/ICICS.2011.6174261

2011-01-01

Abstract:This paper proposes a new information fusion approach that employs two information components for mobile landmark recognition, which includes: content analysis and context analysis. Existing landmark recognition works are mainly based on PC platform, which uses content analysis alone for recognition, and thus has a large computation cost and cannot satisfy mobile users' fast response time requirements. Therefore in this paper, a mobile platform-based landmark recognition system is developed. The bag-of-words method is employed and further improved as content analysis according to the specific features of landmark images. Context analysis based on location (obtained by global positioning system) and direction (obtained by digital compass) information is then integrated with improved BoW as a new information fusion approach for mobile landmark recognition. Finally, the experiment results conducted on the NTU landmark database show that the proposed approach is effective for mobile landmark recognition.
Learning Compact Visual Descriptor for Low Bit Rate Mobile Landmark Search.

Rongrong Ji,Ling-Yu Duan,Jie Chen,Hongxun Yao,Tiejun Huang,Wen Gao

DOI: https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-409

2011-01-01

Abstract:In this paper, we propose to extract a compact yet discriminative visual descriptor directly on the mobile device, which tackles the wireless query transmission latency in mobile landmark search. This descriptor originates from offline learning the location contexts of geo-tagged Web photos from both Flickr and Panoramio with two phrases: First, we segment the landmark photo collections into discrete geographical regions using a Gaussian Mixture Model [Stauffer et al., 2000]. Second, a ranking sensitive vocabulary boosting is introduced to learn a compact codebook within each region. To tackle the locally optimal descriptor learning caused by imprecise geographical segmentation, we further iterate above phrases incorporating the feedback of an entropy based descriptor compactness into a prior distribution to constrain the Gaussian mixture modeling. Consequently, when entering a specific geographical region, the codebook in the mobile device is downstream adapted, which ensures efficient extraction of compact descriptors, its low bit rate transmission, as well as promising discrimination ability. We descriptors to both HTC and iPhone mobile phones, testing landmark search over one million images in typical areas like Beijing, New York, and Barcelona, etc. Our descriptor outperforms alternative compact descriptors [Chen et al., 2009][Chen et al., 2010][Chandrasekhar et al., 2009a][Chandrasekhar et al., 2009b] with a large margin.
Hybrid Visual Natural Landmark–based Localization for Indoor Mobile Robots

Xuequn Zhang,Shiqiang Zhu,Zhi Wang,Yuehua Li

DOI: https://doi.org/10.1177/1729881418810143

IF: 1.714

2018-01-01

International Journal of Advanced Robotic Systems

Abstract:Localization is a crucial part of autonomous moving for the indoor mobile robot. The natural features of the ceiling and surrounding environment can serve for position estimation. Based on these natural features, a hybrid visual natural landmarks–based localization method is proposed. We combine the landmarks-based positioning with ceiling-based visual odometry. During the visual odometry, the orientation is computed from the parallel features between the adjacent frames. The position is calculated from the corresponding point features in the two consecutive images using the perspective-n-point method. During the natural landmarks–based localization, the orientation filter is utilized to obtain the global orientation. Then, the feature points are determined by the Compute Unified Device Architecture–based scale-invariant feature transform algorithm. Finally, the position is estimated based on the computed orientation and point features. Various experiments have been conducted to evaluate the effectiveness of the proposed method. The experimental results show that the proposed localization method outperforms other methods in accuracy and efficiency.
Landmark Topology Descriptor-Based Place Recognition and Localization under Large View-Point Changes

Guanhong Gao,Zhi Xiong,Yao Zhao,Ling Zhang

DOI: https://doi.org/10.3390/s23249775

IF: 3.9

2023-12-13

Sensors

Abstract:Accurate localization between cameras is a prerequisite for a vision-based heterogeneous robot systems task. The core issue is how to accurately perform place recognition from different view-points. Traditional appearance-based methods have a high probability of failure in place recognition and localization under large view-point changes. In recent years, semantic graph matching-based place recognition methods have been proposed to solve the above problem. However, these methods rely on high-precision semantic segmentation results and have a high time complexity in node extraction or graph matching. In addition, methods only utilize the semantic labels of the landmarks themselves to construct graphs and descriptors, making such approaches fail in some challenging scenarios (e.g., scene repetition). In this paper, we propose a graph-matching method based on a novel landmark topology descriptor, which is robust to view-point changes. According to the experiment on real-world data, our algorithm can run in real-time and is approximately four times and three times faster than state-of-the-art algorithms in the graph extraction and matching phases, respectively. In terms of place recognition performance, our algorithm achieves the best place recognition precision at a recall of 0–70% compared with classic appearance-based algorithms and an advanced graph-based algorithm in the scene of significant view-point changes. In terms of positioning accuracy, compared to the traditional appearance-based DBoW2 and NetVLAD algorithms, our method outperforms by 95%, on average, in terms of the mean translation error and 95% in terms of the mean RMSE. Compared to the state-of-the-art SHM algorithm, our method outperforms by 30%, on average, in terms of the mean translation error and 29% in terms of the mean RMSE. In addition, our method outperforms the current state-of-the-art algorithm, even in challenging scenarios where the benchmark algorithms fail.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Mobile robot localization algorithm by combining visual odometry with natural landmarks

Wang Zhi,Zhu Shiqiang,Li Yuehua,Zhang Xuequn

DOI: https://doi.org/10.11975/j.issn.1002-6819.2017.10.009

2017-01-01

Abstract:Localization is crucial for the mobile robot system. Various localization methods have been proposed, such as light detection and ranging (LIDAR), ultrasonic method, WIFI, ultra wideband (UWB), vision odometry, and so on. The vision-based localization method has been intensively researched recently. Many researchers focus on the visual odometry, such as the monocular odometry and the stereo odometry. But the most obvious weakness of the visual odometry is the cumulative error, which will increase as the increasing of the displacement. To solve this problem, the artificial landmarks are adopted for absolute localization. But it needs previous setting and calibration. According to these observations, a mobile robot localization algorithm based on monocular vision and natural landmarks was proposed. The ordinary camera and omnidirectional camera are adopted in this method. The ordinary camera is used to extract the features from the ceiling for visual odometry, and the omnidirectional camera is used to extract the features from the environment and ceiling; then a natural landmark base is built using the Harris-SIFT (Scale-invariant feature transform) method. If there are not natural landmarks, the localization is implemented according to the change of the feature point between 2 neighboring images. If there exist natural landmarks, they will be used to localize the robot. During the visual odometry process, the feature point is extracted from the ceiling image and then tracked the feature point through the whole trajectory. The rotation angle and translation matrix can be determined by the coordinates of the feature point in the image and the world coordinate system. If the feature point is far away from the image center, it should be reselected so that it is close to the image center. The local search method for feature point is adopted to accelerate the localization. The search of feature point is only implemented near the feature point in the last frame. If there exist natural landmarks, the orientation filter is used to estimate the orientation angles. In this filter, the indirect Kalman filter is adopted, which uses the orientation error space as the state of the filter. Moreover, the orientation filter fuses the data of visual odometry and the inertial measurement unit to calculate the orientation angles. Then, the Harris-SIFT algorithm is used to determine the feature point for localization. To fully remove the outliers, the cluster analysis is implemented to cluster the matching points. And then the optimal matching is used to determine the feature point. The localization is implemented considering the orientation angles and the feature point obtained above. This algorithm has both of the advantages of the real-time performance of relative localization and the accuracy of absolute localization. The indoor experiment was implemented. The average errors of the proposed method in x axis and y axis were 38.66 and 31.54 mm, respectively. Compared with the visual odometry, the errors were decreased by 32.53% and 68.68%, respectively. As to the computational efficiency, the runtime of the localization based on only natural landmarks was almost 6 times higher than that of the proposed method. Thus, the proposed method can achieve real-time performance. The indoor experimental results demonstrate that compared with the visual odometry, the proposed method is much more accurate, and has a better extendibility.
Landmark recognition system for mini rotor aerial robot

Ren Qinyuan,Li Ping,Han Bo

DOI: https://doi.org/10.1109/WCICA.2006.1713972

2006-01-01

Abstract:Landmark recognition system is a very important part of mini rotor aerial robot. It recognizes landmarks, and supplies the navigation computer with location information of it. However, mini rotor aerial robots have low pay-load and are small in size. This means that the sensor like radar not fit in with this application, and the small size and low power cost cameras may be the only sensors can be used. In this paper we focus on a landmark recognition system which uses an onboard camera as the sensor. Meanwhile, this paper presents an approach that is applied to real-time recognizing of landmark in video stream. This problem poses several challenges. Landmark in images captured from video stream by moving mini rotor robot vary in shape, size, scale and orientation. Unlike other approaches, this approach is based on classification algorithms. An extended set of haar-like features is used, due to their simplicity. Landmarks are divided into several viewpoint categories according to their poses and each of these categories is processed by a cascade classifier which is trained by the Adaboosting algorithm. In the end, the experimental results verify the effectiveness of the system. © 2006 IEEE.
Contactless Palm Landmark Detection and Localization on Mobile Devices

Yaqi Wang,Liangrui Peng,Shengjin Wang,Xiaoqing Ding

DOI: https://doi.org/10.2352/issn.2470-1173.2016.7.mobmu-291

2016-01-01

Electronic Imaging

Abstract:Palmprint recognition as a novel biometric identification method for contactless mobile devices has been received substantial attentions in recent years. Palm landmark detection is one of the key technologies of palmprint identification and verification system. However, the differences of hand positions, complex backgrounds and various lighting conditions in unrestrained environment with low-resolution cameras make palm landmark detection in the wild difficult. In this paper, we proposed a new palm landmark detection approach based on Supervised Descent Method (SDM). SDM uses the relationship between the feature representation and the position of a landmark point to build an optimization problem for palm landmark detection. The optimization target function is the distance of feature representations between current position and the ideal position of a palm landmark point. After optimization, a linear function of the position displacement and the feature representation of current landmark is obtained. The linear function can be learned from palmprint image samples with labeled landmark positions. Given an input image in detection process, the initial position of a landmark is set by the mean position of the landmark in the training set, then the optimal landmark position can be calculated iteratively using the learned linear function. The effectiveness of the proposed method is proved on a mobile phone captured palm image dataset.
Diversifying Inference Path Selection: Moving-Mobile-Network for Landmark Recognition

Biao Qian,Yang Wang,Richang Hong,Meng Wang,Ling Shao

DOI: https://doi.org/10.1109/tip.2021.3076275

IF: 10.6

2021-01-01

IEEE Transactions on Image Processing

Abstract:Deep convolutional neural networks have largely benefited computer vision tasks. However, the high computational complexity limits their real-world applications. To this end, many methods have been proposed for efficient network learning, and applications in portable mobile devices. In this paper, we propose a novel Moving-Mobile-Network, named M2Net, for landmark recognition, equipped each landmark image with located geographic information. We intuitively find that M2Net can essentially promote the diversity of the inference path (selected blocks subset) selection, so as to enhance the recognition accuracy. The above intuition is achieved by our proposed reward function with the input of geo-location and landmarks. We also find that the performance of other portable networks can be improved via our architecture. We construct two landmark image datasets, with each landmark associated with geographic information, over which we conduct extensive experiments to demonstrate that M2Net achieves improved recognition accuracy with comparable complexity.

computer science, artificial intelligence,engineering, electrical & electronic
Landmark Recognition with Compact BoW Histogram and Ensemble ELM

Jiuwen Cao,Tao Chen,Jiayuan Fan

DOI: https://doi.org/10.1007/s11042-014-2424-1

IF: 2.577

2016-01-01

Multimedia Tools and Applications

Abstract:Along with the rapid development of mobile terminal devices, landmark recognition applications based on mobile devices have been widely researched in recent years. Due to the fast response time requirement of mobile users, an accurate and efficient landmark recognition system is thus urgent for mobile applications. In this paper, we propose a landmark recognition framework by employing a novel discriminative feature selection method and the improved extreme learning machine (ELM) algorithm. The scalable vocabulary tree (SVT) is first used to generate a set of preliminary codewords for landmark images. An efficient codebook learning algorithm derived from the word mutual information and Visual Rank technique is proposed to filter out those unimportant codewords. Then, the selected visual words, as the codebook for image encoding, are used to produce a compact Bag-of-Words (BoW) histogram. The fast ELM algorithm and the ensemble approach using the ELM classifier are utilized for landmark recognition. Experiments on the Nanyang Technological University campus's landmark database and the Fifteen Scene database are conducted to illustrate the advantages of the proposed framework.
Finding perfect rendezvous on the go: accurate mobile visual localization and its applications to routing.

Heng Liu,Tao Mei,Jiebo Luo,Houqiang Li,Shipeng Li

DOI: https://doi.org/10.1145/2393347.2393357

2012-01-01

Abstract:ABSTRACTWhile on the go, more and more people are using their phones to enjoy ubiquitous location-based services (LBS). One of the fundamental problems of LBS is localization. Researchers are now investigating ways to use a phone-captured image for localization as it contains more scene context information than the embedded sensors. In this paper, we present a novel approach to mobile visual localization that accurately senses geographic scene context according to the current image (typically associated with a rough GPS position). Unlike most existing visual localization methods, the proposed approach is capable of providing a complete set of more accurate parameters about the scene geo---including the actual locations of both the mobile user and perhaps more importantly the captured scene along with the viewing direction. Our approach takes advantage of advanced techniques for large-scale image retrieval and 3D model reconstruction from photos. Specifically, we first perform joint geo-visual clustering in the cloud to generate scene clusters, with each scene represented by a 3D model. The 3D scene models are then indexed using a visual vocabulary tree structure. The phone-captured image is used to retrieve the relevant scene models, then aligned with the models, and further registered to the real-world map. Our approach achieves an estimation accuracy of user location within 14 meters, viewing direction within 9 degrees, and scene location within 21 meters. Such a complete set of accurate geo-parameters can lead to various LBS applications for routing that cannot be achieved with most existing methods. In particular, we showcase three novel applications: 1) accurate self-localization, 2) collaborative localization for rendezvous routing, and 3) routing for photographing. The evaluations through user studies indicate these applications are effective for facilitating the perfect rendezvous for mobile users.
Three Landmark Optimization Strategies for Mobile Robot Visual Homing

Xun Ji,Qidan Zhu,Junda Ma,Peng Lu,Tianhao Yan

DOI: https://doi.org/10.3390/s18103180

IF: 3.9

2018-09-20

Sensors

Abstract:Visual homing is an attractive autonomous mobile robot navigation technique, which only uses vision sensors to guide the robot to the specified target location. Landmark is the only input form of the visual homing approaches, which is usually represented by scale-invariant features. However, the landmark distribution has a great impact on the homing performance of the robot, as irregularly distributed landmarks will significantly reduce the navigation precision. In this paper, we propose three strategies to solve this problem. We use scale-invariant feature transform (SIFT) features as natural landmarks, and the proposed strategies can optimize the landmark distribution without over-eliminating landmarks or increasing calculation amount. Experiments on both panoramic image databases and a real mobile robot have verified the effectiveness and feasibility of the proposed strategies.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

A Comparative Study of Mobile-Based Landmark Recognition Techniques

A Survey on Mobile Landmark Recognition for Information Retrieval

Integrated Content and Context Analysis for Mobile Landmark Recognition

A Discriminative Learning Technique For Mobile Landmark Recognition

A Lightweight Mobile-Anchor-Based Multi-Target Outdoor Localization Scheme Using LoRa Communication

Context-Aware Discriminative Vocabulary Learning for Mobile Landmark Recognition.

Learning Compact Visual Descriptors For Low Bit Rate Mobile Landmark Search

A Review of Smartphones‐based Indoor Positioning: Challenges and Applications

Last-Mile Navigation Using Smartphones

Design of an Enhanced Visual Odometry by Building and Matching Compressive Panoramic Landmarks Online

Content and context information fusion for mobile landmark recognition

Learning Compact Visual Descriptor for Low Bit Rate Mobile Landmark Search.

Hybrid Visual Natural Landmark–based Localization for Indoor Mobile Robots

Landmark Topology Descriptor-Based Place Recognition and Localization under Large View-Point Changes

Mobile robot localization algorithm by combining visual odometry with natural landmarks

Landmark recognition system for mini rotor aerial robot

Contactless Palm Landmark Detection and Localization on Mobile Devices

Diversifying Inference Path Selection: Moving-Mobile-Network for Landmark Recognition

Landmark Recognition with Compact BoW Histogram and Ensemble ELM

Finding perfect rendezvous on the go: accurate mobile visual localization and its applications to routing.

Three Landmark Optimization Strategies for Mobile Robot Visual Homing