CPA: Cyber-Physical Augmentation for Vibration Sensing in Autonomous Retails.

Yue Zhang,Carlos Ruiz,Shubham Rohal,Shijia Pan
DOI: https://doi.org/10.1145/3572864.3580328
2023-01-01
Abstract:Customer-product interaction (pickup or put down) detection is essential for autonomous retail. Previous studies have explored many sensing technologies, including vision, load, RFID, and piezo. These approaches often require strict deployment conditions, such as Line-of-Sight (LoS), dense deployment, and/or high cost. In this paper, we present a vibration-based customer-product interaction detection system for autonomous retail. We propose to use one vibration sensor placed on the back panel of the gondola to achieve single-point sensing to monitor all the shelves on the gondola. The key challenge is to detect pickup of small items (e.g., candy bar), which induces extremely low SNR vibration signals. We introduce CPA , a cyber-physical augmentation scheme to enhance the vibration sensing signal via a physical arc structure and achieves high accuracy labeling-free event detection. We evaluate CPA in a real-world scenario by deploying a vibration sensor on a retail gondola to monitor interactions across multiple shelves. Our approach demonstrates up to 2.9X improvement for light-weight product pickup event detection.
What problem does this paper attempt to address?