Abstract:IMU based inertial tracking plays an indispensable role in many mobility centric tasks, such as robotic control, indoor navigation and virtual reality gaming. Despite its mature application in rigid machine mobility (e.g., robot and aircraft), tracking human users via mobile devices remains a fundamental challenge due to the intractable gait/posture patterns. Recent data-driven models have tackled sensor drifting, one key issue that plagues inertial tracking. However, these systems still assume the devices are held or attached to the user body with a relatively fixed posture. In practice, natural body activities may rotate/translate the device which may be mistaken as whole body movement. Such motion artifacts remain as the dominating factor that fails existing inertial tracing systems in practical uncontrolled settings. Inspired by the observation that human heads induces far less intensive movement relative to the body during walking, compared to other parts, we propose a novel multi-stage sensor fusion pipeline called DeepIT, which realizes inertial tracking by synthesizing the IMU measurements from a smartphone and an associated earbud. DeepIT introduces a data-driven reliability aware attention model, which assesses the reliability of each IMU and opportunistically synthesizes their data to mitigate the impacts of motion noise. Furthermore, DeepIT uses a reliability aware magnetometer compensation scheme to combat the angular drifting problem caused by unrestricted motion artifacts. We validate DeepIT on the first large-scale inertial navigation dataset involving both smartphone and earbud IMUs. The evaluation results show that DeepIT achieves multiple folds of accuracy improvement on the challenging uncontrolled natural walking scenarios, compared with state-of-the-art closed-form and data-driven models.

Mobile Communication among COTS IoT Devices Via a Resonant Gyroscope with Ultrasound.

Deaf-Aid: Mobile IoT Communication Exploiting Stealthy Speaker-to-Gyroscope Channel

Deaf-aid

MagneComm+: Near-Field Electromagnetic Induction Communication with Magnetometer

Poster: Inaudible High-throughput Communication Through Acoustic Signals

Ultracomm: High-Speed And Inaudible Acoustic Communication

WordWhisper: Exploiting Real-time, Hardware-dependent IoT Communication Against Eavesdropping

Device-Independent Smartphone Eavesdropping Jointly Using Accelerometer and Gyroscope

Ultrasound Communication Using the Nonlinearity Effect of Microphone Circuits in Smart Devices

Skin-Integrated Wireless Odor Message Delivery Electronics for the Deaf-blind

URadio: Wideband Ultrasound Communication for Smart Home Applications

Wi-Ear: A Contact-free Vibration Sensing and Identification System Based on COTS WiFi

InertiEAR: Automatic and Device-independent IMU-based Eavesdropping on Smartphones

Cross-Technology Communications for Heterogeneous IoT Devices Through Artificial Doppler Shifts

A Contactless Morse Code Text Input System Using COTS Wifi Devices

Underwater Messaging Using Mobile Devices

Acoustic Localization and Communication Using a MEMS Microphone for Low-cost and Low-power Bio-inspired Underwater Robots

Robust Inertial Motion Tracking Through Deep Sensor Fusion Across Smart Earbuds and Smartphone.

Development of Internet-of-Things-Based Controlled-Source Ultra-Audio Frequency Electromagnetic Receiver

MagSound

WiMorse: A Contactless Morse Code Text Input System Using Ambient WiFi Signals