Publication
Title
Gesture recognition with mmWave Wi-Fi access points : lessons learned
Author
Abstract
In recent years, channel state information (CSI) at sub-6 GHz has been widely exploited for Wi-Fi sensing, particularly for activity and gesture recognition. In this work, we instead explore mmWave (60 GHz) Wi-Fi signals for gesture recognition/pose estimation. Our focus is on the mmWave Wi-Fi signals so that they can be used not only for high data rate communication but also for improved sensing e.g., for extended reality (XR) applications. For this reason, we extract spatial beam signal-to-noise ratios (SNRs) from the periodic beam training employed by IEEE 802.11ad devices. We consider a set of 10 gestures/poses motivated by XR applications. We conduct experiments in two environments and with three people. As a comparison, we also collect CSI from IEEE 802.11ac devices. To extract features from the CSI and the beam SNR, we leverage a deep neural network (DNN). The DNN classifier achieves promising results on the beam SNR task with state-of-the-art 96.7% accuracy in a single environment, even with a limited dataset. We also investigate the robustness of the beam SNR against CSI across different environments. Our experiments reveal that features from the CSI generalize without additional re-training, while those from beam SNRs do not. Therefore, retraining is required in the latter case.
Language
English
Source (book)
24th IEEE International Symposium on a World of Wireless, Mobile and, Multimedia Networks (WoWMoM), JUN 12-15, 2023, NE Univ, NE Univ, Boston, MA
Publication
Los alamitos : Ieee computer soc , 2023
ISBN
979-83-503-3165-3
DOI
10.1109/WOWMOM57956.2023.00027
Volume/pages
(2023) , p. 127-136
ISI
001046685900014
Full text (Publisher's DOI)
Full text (publisher's version - intranet only)
UAntwerpen
Faculty/Department
Research group
Project info
WaveVR: Context-Aware Millimeter Wave Network for Interactive Virtual and Augmented Reality.
Publication type
Subject
Affiliation
Publications with a UAntwerp address
External links
Web of Science
Record
Identifier
Creation 02.10.2023
Last edited 03.11.2024
To cite this reference