Abstract:Recognizing surfaces based on their vibration signatures is useful as it can enable tagging of different locations without requiring any additional hardware, such as near field communication (NFC) tags. However, previous vibration based surface recognition schemes either use custom hardware for creating and sensing vibration, which makes them difficult to adopt, or use intertial (IMU) sensors in commercial off-the-shelf (COTS) smartphones to sense movements produced due to vibrations, which makes them coarse-grained because of the low sampling rates of IMU sensors. The mainstream COTS smartphones based schemes are also susceptible to inherent hardware based irregularities in vibration mechanism of the smartphones. Moreover, the existing schemes that use microphones to sense vibration are prone to short-term and constant background noises (e.g., intermittent talking, exhaust fan, etc.) because microphones not only capture the sounds created by vibration but also other interfering sounds present in the environment. In this paper, we propose VibroTag, a robust and practical vibration based sensing scheme that works with smartphones with different hardware, can extract fine-grained vibration signatures of different surfaces, and is robust to environmental noise and hardware based irregularities. We implemented VibroTag on two different Android phones and evaluated in multiple different environments where we collected data from four individuals for 5 to 20 consecutive days. Our results show that VibroTag achieves an average accuracy of 86.55 percent while recognizing 24 different locations/surfaces, even when some of those surfaces were made of similar material. VibroTag's accuracy is 37 percent higher than the average accuracy of 49.25 percent achieved by one of the state-of-the-art IMUs based schemes, which we implemented for comparison with VibroTag.

MM-Tap: Adaptive and Scalable Tap Localization on Ubiquitous Surfaces with mm-level Accuracy

UbiTap

Building Virtual Entertainment Environment with Tiled Display Wall and Motion Tracking.

Depth Aware Finger Tapping On Virtual Displays

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

TapWristband: A Wearable Keypad System Based on Wrist Vibration Sensing

A touchable virtual screen interaction system with handheld Kinect camera

Millimeter-Wave Bat for Mapping and Quantifying Micromotions in Full Field of View

TUM: Towards Ubiquitous Multi-Device Localization for Cross-Device Interaction

Multi-sensor Fusion for Interactive Visual Computing in Mixed Environment.

Model-Based 3D Contact Geometry Perception for Visual Tactile Sensor

ALTo: Ad Hoc High-Accuracy Touch Interaction Using Acoustic Localization

Multi-scale and Full-Field Vibration Measurement Via Millimetre-Wave Sensing

Design, Optimization and Application of Tactile Sensor Based on Virtual Binocular Vision

Continuous Marker Patterns for Representing Contact Information in Vision-Based Tactile Sensor: Principle, Algorithm, and Verification

Accurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor

MidasTouch: Monte-Carlo inference over distributions across sliding touch

M-Gesture : Person-Independent Real-Time In-Air Gesture Recognition Using Commodity Millimeter Wave Radar

Sub-Resolution mmWave FMCW Radar-based Touch Localization using Deep Learning

Fine-grained Vibration Based Sensing Using a Smartphone

Touch Sensors with Overlapping Signals: Concept Investigation on Planar Sensors with Resistive or Optical Transduction