Detecting Mid-Air Gestures for Digit Writing With Radio Sensors and a CNN
- Authors
- Leem, Seong Kyu; Khan, Faheem; Cho, Sung Ho
- Issue Date
- Apr-2020
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Sensors; Clutter; Training; Radar imaging; Trajectory; Gesture recognition; Convolutional neural network (CNN); gesture recognition; human-computer interaction; image; impulse radio ultrawideband (IR-UWB) radar; localization; mid-air handwriting; sensor
- Citation
- IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, v.69, no.4, pp.1066 - 1081
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
- Volume
- 69
- Number
- 4
- Start Page
- 1066
- End Page
- 1081
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/9897
- DOI
- 10.1109/TIM.2019.2909249
- ISSN
- 0018-9456
- Abstract
- In this paper, we classify digits written in mid-air using hand gestures. Impulse radio ultrawideband (IR-UWB) radar sensors are used for data acquisition, with three radar sensors placed in a triangular geometry. Conventional radar-based gesture recognition methods use whole raw data matrices or a group of features for gesture classification using convolutional neural networks (CNNs) or other machine learning algorithms. However, if the training and testing data differ in distance, orientation, hand shape, hand size, or even gesture speed or the radar setup environment, these methods become less accurate. To develop a more robust gesture recognition method, we propose not using raw data for the CNN classifier, but instead employing the hand & x2019;s mid-air trajectory for classification. The hand trajectory has a stereotypical shape for a given digit, regardless of the hand & x2019;s orientation or speed, making its classification easy and robust. Our proposed method consists of three stages: signal preprocessing, hand motion localization, and tracking and transforming the trajectory data into an image to classify it using a CNN. Our proposed method outperforms conventional approaches because it is robust to changes in orientation, distance, and hand shape and size. Moreover, this method does not require building a huge training database of digits drawn by different users in different orientations; rather, we can use training databases already available in the image processing field. Overall, the proposed mid-air handwritten digit recognition system provides a user-friendly and accurate mid-air handwriting modality that does not place restrictions on users.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 융합전자공학부 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/9897)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.