Abstract:Smartphone localization is essential to a wide spectrum of applications in the era of mobile computing. The ubiquity of smartphone mobile cameras and surveillance ambient cameras holds promise for offering sub-meter accuracy localization services thanks to the maturity of computer vision techniques. In general, ambient-camera-based solutions are able to localize pedestrians in video frames at fine-grained, but the tracking performance under dynamic environments remains unreliable. On the contrary, mobile-camera-based solutions are capable of continuously tracking pedestrians; however, they usually involve constructing a large volume of image database, a labor-intensive overhead for practical deployment. We observe an opportunity of integrating these two most promising approaches to overcome above limitations and revisit the problem of smartphone localization with a fresh perspective. However, fusing mobile-camera-based and ambient-camera-based systems is non-trivial due to disparity of camera in terms of perspectives, parameters and incorrespondence of localization results. In this article, we propose iMAC, an integrated mobile cameras and ambient cameras based localization system that achieves sub-meter accuracy and enhanced robustness with zero-human start-up effort. The key innovation of iMAC is a well-designed fusing frame to eliminate disparity of cameras including a construction of projection map function to automatically calibrate ambient cameras, an instant crowd fingerprints model to describe user motion patterns, and a confidence-aware matching algorithm to associate results from two sub-systems. We fully implement iMAC on commodity smartphones and validate its performance in five different scenarios. The results show that iMAC achieves a remarkable localization accuracy of 0.68 m, outperforming the state-of-the-art systems by >75%.

CACam: Consecutive Angular Measurements with Camera on Smartphone for Distance Estimation

CamDist: Camera Based Distance Estimation with a Smartphone

A New Method for Increasing Accuracy of Distance Measurement Based on Single Visual Camera

Calibration of a Single-Point Laser Range Finder and a Camera

LiDAR-Camera Calibration under Arbitrary Configurations: Observability and Methods

Extrinsic Calibration of a Single-Point Laser Rangefinder and Single Camera

Gyro-aided Camera-Odometer Online Calibration and Localization

Towards Accurate Object Localization with Smartphones.

Enabling Surveillance Cameras to Navigate

Human Localization in a Cluttered Space Using Multiple Cameras

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

Contactless Measurement of Pose in the Earth Frame Using A Mobile Phone

Efficient relative camera orientation detection for mobile applications

Indoor Visible Light Positioning with Centimeter Accuracy Based on a Commercial Smartphone Camera.

Design of a Smartphone Indoor Positioning Dynamic Ground Truth Reference System Using Robust Visual Encoded Targets

An Accurate Visual-Inertial Integrated Geo-Tagging Method for Crowdsourcing-Based Indoor Localization

MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing

A GNSS/Barometric Altimeter Tightly Coupled Integration for Three-Dimensional Semi-Indoor Mapping With Android Smartphones

A Continuous Positioning Algorithm Based on Differential GNSS Techniques, MARG Sensors, and Barometers with Smartphones

Simulator of Camera Accelerometer for Mobile Phone

3D-CALI: Automatic calibration for camera and LiDAR using 3D checkerboard