基于空间属性特征的毫米波雷达身体干扰识别

doi:10.12305/j.issn.1001-506X.2024.10.14

Abstract

Abstract:

In gesture recognition, the movement of the body is easily misjudged as a gesture action, which interferes the gesture recognition. Therefore, in view of the existing body interference problem, a body interference recognition algorithm based on spatial attribute features is proposed. After preprocessing the received signal of millimeter-wave radar, firstly, the one-dimensional potential targets and the two-dimensional potential targets are extracted from the one-dimensional range image and the two-dimensional range angle spectrum, and the connected domains are labeled for the two-dimensional potential targets. Then, based on the potential targets and the connected domains, the spatial attribute features used to distinguish between body interference and gesture targets are extracted. Finally, the support vector machine (SVM) classifier is used for body interference recognition. Experimental results show that the proposed method can effectively distinguish body interference from gesture targets, and the accuracy rate reaches 97.3% under single-frame prediction and 98.94% under multi-frame prediction.

Key words: millimeter-wave radar, gesture recognition, body interference, spatial attribute features, feature extraction

CLC Number:

TN959

Jiayi CAI, Ping CHU, Luntao ZHUANG, Zhaocheng YANG. Millimeter-wave radar body interference recognition based on spatial attribute features[J]. Systems Engineering and Electronics, 2024, 46(10): 3365-3374.

Figures/Tables 13

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

Table 1

Table 2

Table 3

References 31

1	GURBUZ S Z, GURBUZ A C, MALAIA E A, et al. ASL recognition based on kinematics derived from a multi-frequency RF sensor network[C]//Proc. of the IEEE Sensors, 2020.
2	CHEN F Y , LYU H H , PANG Z B , et al. Wristcam: a wearable sensor for hand trajectory gesture recognition and intelligent human-robot interaction[J]. IEEE Sensors Journal, 2019, 19 (19): 8441- 8451. doi: 10.1109/JSEN.2018.2877978
3	PLESHKOVA S G, BEKVARSKI A B, ZAHARIEV Z T. Based on artificial intelligence and deep learning hand gesture recognition for interaction with mobile robots[C]//Proc. of the 10th National Conference with International Participation, 2019.
4	OHN-BAR E , TRIVEDI M M . Hand gesture recognition in real time for automotive interfaces: a multimodal vision-based approach and evaluations[J]. IEEE Trans.on Intelligent Transportation Systems, 2014, 15 (6): 2368- 2377. doi: 10.1109/TITS.2014.2337331
5	LEITE D A T Q, DUARTE J C, OLIVEIRA J C, et al. A system to interact with CAVE applications using hand gesture recognition from depth data[C]//Proc. of the 16th Symposium on Virtual and Augmented Reality, 2014: 246-253.
6	HE W F, WU K S, ZOU Y P, et al. WiG: wifi-based gesture recognition system[C]//Proc. of the 24th International Confe-rence on Computer Communication and Networks, 2015.
7	VENKATNARAYAN R H , MAHMOOD S , SHAHZAD M . Wifi based multi-user gesture recognition[J]. IEEE Trans.on Mobile Computing, 2019, 20 (3): 1242- 1256.
8	PITTMAN C, WISNIEWSKI P, BROOKS C, et al. Multiwave: Doppler effect based gesture recognition in multiple dimensions[C]//Proc. of the Conference on Human Factors in Computing Systems Conference Extended Abstracts on Human Factors in Computing Systems, 2016: 1729-1736.
9	ZHOU F F, LI X Y, WANG Z H. Efficiently user-independent ultrasonic-based gesture recognition algorithm[C]//Proc. of the IEEE Sensors, 2019.
10	江浩. 基于智能腕表的手写识别研究[D]. 上海: 上海交通大学, 2020.
	JIANG H. Research on handwriting recognition based on smart watches[D]. Shanghai: Shanghai Jiao Tong University, 2020.
11	CHOI E S, BANG W C, CHO S J, et al. Beatbox music phone: gesture-based interactive mobile phone using a tri-axis accelerometer[C]//Proc. of the IEEE International Conference on Industrial Technology, 2005: 97-102.
12	PAUDYAL P, LEE J, BANERJEE A, et al. Dyfav: dynamic feature selection and voting for real-time recognition of fingerspelled alphabet using wearables[C]//Proc. of the 22nd International Conference on Intelligent User Interfaces, 2017: 457-467.
13	RODRIGUEZ D, PIRYATINSKA A, ZHANG X. A neural decision forest scheme with application to EMG gesture classification[C]//Proc. of the Science and Information Computing Conference, 2016: 243-252.
14	LI Y , WANG X G , LIU W Y , et al. Deep attention network for joint hand gesture localization and recognition using static RGB-D images[J]. Information Sciences, 2018, 441, 66- 78. doi: 10.1016/j.ins.2018.02.024
15	施向军, 王星尧. 基于红外传感器和隐马尔可夫模型的动态手势识别[J]. 电子器件, 2018, 41 (5): 1286- 1290. doi: 10.3969/j.issn.1005-9490.2018.05.040
	SHI X J , WANG X R . Dynamic gesture recognition based on infrared sensor and hidden Markov model[J]. Chinese Journal of Electron Devices, 2018, 41 (5): 1286- 1290. doi: 10.3969/j.issn.1005-9490.2018.05.040
16	FANG B Y, CO J, ZHANG M. DeepASL: enabling ubiquitous and non-intrusive word and sentence-level sign language translation[C]//Proc. of the 15th ACM Conference on Embedded Network Sensor Systems, 2017.
17	赵爱芳, 裴东, 王全州, 等. 复杂环境中多信息融合的手势识别[J]. 计算机工程与应用, 2014, 50 (5): 180- 184. doi: 10.3778/j.issn.1002-8331.1304-0011
	ZHAO A F , PEI D , WANG Q Z , et al. Gesture recognition with multi-information fusion in complex environments[J]. Computer Engineering and Applications, 2014, 50 (5): 180- 184. doi: 10.3778/j.issn.1002-8331.1304-0011
18	LIU K, CHEN C, JAFARI R, et al. Multi-HMM classification for hand gesture recognition using two differing modality sensors[C]//Proc. of the IEEE Dallas Circuits and Systems Conference, 2014.
19	YANG Z C , ZHENG X B . Hand gesture recognition based on trajectories features and computation-efficient reused LSTM network[J]. IEEE Sensors Journal, 2021, 21 (15): 16945- 16960. doi: 10.1109/JSEN.2021.3079564
20	DAIM T J, LEE R M A. The effect of body position on IR-UWB radar sensor-based hand gesture speed recognition and classification system[C]//Proc. of the IEEE International Conference on Automatic Control and Intelligent Systems, 2022: 158-162.
21	STADELMAVER T , SANTRA A , WEIGEL R , et al. Radar-based gesture recognition using a variational autoencoder with deep statistical metric learning[J]. IEEE Trans.on Microwave Theory and Techniques, 2022, 70 (11): 5051- 5062. doi: 10.1109/TMTT.2022.3201265
22	CHOI J , PARK C , KIM J . FMCW radar-based real-time hand gesture recognition system capable of out-of-distribution detection[J]. IEEE Access, 2022, 10, 87425- 87434. doi: 10.1109/ACCESS.2022.3200757
23	AHMED S , KIM W , PARK J , et al. Radar-based air-writing gesture recognition using a novel multistream CNN approach[J]. IEEE Internet of Things Journal, 2022, 9 (23): 23869- 23880. doi: 10.1109/JIOT.2022.3189395
24	CHEN Q, LI Y W, CUI Z Y, et al. A hand gesture recognition method for mmwave radar based on angle-range joint temporal feature[C]//Proc. of the IEEE International Geoscience and Remote Sensing Symposium, 2022: 2650-2653.
25	WANG X R , LI W L , CHEN V C . Hand gesture recognition using radial and transversal dual micromotion features[J]. IEEE Trans.on Aerospace and Electronic Systems, 2022, 58 (6): 5963- 5973. doi: 10.1109/TAES.2022.3179679
26	DONG L F , MA Z X , ZHU X C . Dynamic gesture recognition network based on vehicular millimeter wave radar[J]. Transactions of Beijing Institute of Technology, 2023, 43 (5): 493- 498.
27	TONG P P, WENG C E, BI X, et al. Micro gesture recognition of the millimeter-wave radar based on multi-branch residual neural network[C]//Proc. of the SAE Intelligent and Connected Vehicles Symposium, 2022.
28	WANG Y, ZHANG J, ZHAO X C, Research on hand gesture recognition based on millimeter wave radar[C]//Proc. of the 3rd International Conference on Consumer Electronics and Computer Engineering, 2023: 205-209.
29	SHARMA R R , KUMAR K A , CHO S H . Novel time-distance parameters based hand gesture recognition system using multi-UWB radars[J]. IEEE Sensors Letters, 2023, 7 (5): 6002204.
30	YANG Z C , HUANG X Z . Cascaded regional people counting approach based on two-dimensional spatial attribute features using MIMO radar[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19, 3508005.
31	杜鹏飞, 张祥军. 单元平均恒虚警率检测中的一个新结论[J]. 现代雷达, 2007, 29 (2): 60- 62.
	DU P F , ZHANG X J . A new conclusion in CA-CFAR detection[J]. Modern Radar, 2007, 29 (2): 60- 62.

分类器	混合干扰下的准确率/%	模型大小/kB	预测时间/ms
线性判别	95.5	21	3
KNN	96.8	4 863	21
朴素贝叶斯	92.7	7	3
决策树	96.4	8	2.3
SVM	97.3	122	3

参数	手势目标+正前方身体干扰			手势目标+侧向身体干扰			手势目标+混合干扰
参数	静止状态	微动状态	运动状态	静止状态	微动状态	运动状态	手势目标+混合干扰
样本帧数	33 000	33 000	33 000	33 000	33 000	33 000	83 000
准确率/%	96.8	97.5	97.9	96.3	96.7	96.9	97.3

参数	单帧预测	多帧预测/帧
参数	单帧预测	5	10	15	20
延时/ms	0	125	250	375	500
准确率/%	97.3	98.22	98.42	98.94	99.07

[1]	Qianglong WANG, Xiaoguang GAO, Bicong WU, Zijian HU, Kaifang WAN. Review of research on restricted Boltzmann machine and its variants [J]. Systems Engineering and Electronics, 2024, 46(7): 2323-2345.
[2]	Pengfei YANG, Ling HE, Qian WANG, Ruidi WANG, Mingzhi ZHANG. Interference identification based on mixed signal multidomain feature and Transformer framework [J]. Systems Engineering and Electronics, 2024, 46(6): 2138-2145.
[3]	Degui YANG, Daofeng XU. Human behavior recognition method of IR-UWB through wall radar based on time-frequency domain feature fusion [J]. Systems Engineering and Electronics, 2024, 46(3): 849-858.
[4]	Chunjie ZHANG, Guanbo WANG, Qi CHEN, Zhi'an DENG. Gesture recognition based on millimeter-wave radar with pure self-attention mechanism [J]. Systems Engineering and Electronics, 2024, 46(3): 859-867.
[5]	Jingyue ZHENG, Peilun WU, Jiahui CHEN, Shisheng GUO, Guolong CUI. Multipath false target analysis and elimination method for automotive millimeter wave radar [J]. Systems Engineering and Electronics, 2024, 46(1): 88-96.
[6]	Xiaofeng ZHAO, Jiahui NIU, Chuntong LIU, Yuting XIA. Hyperspectral image classification based on hybrid convolution with three-dimensional attention mechanism [J]. Systems Engineering and Electronics, 2023, 45(9): 2673-2680.
[7]	Wei FANG, Jingwen LIANG, Hengyang LU. Genetic programming algorithm based on cluster tournament and parent matching [J]. Systems Engineering and Electronics, 2023, 45(8): 2405-2414.
[8]	Husheng WANG, Baixiao CHEN, Qingzhi YE. Research on anti-chaff jamming method based on measured data [J]. Systems Engineering and Electronics, 2023, 45(7): 2010-2021.
[9]	Fan YANG, Ping MA, Wei LI, Ming YANG. Intelligent ranking evaluation method of simulation models based on siamese network [J]. Systems Engineering and Electronics, 2023, 45(7): 2060-2068.
[10]	Danyang LIU, Kun WU, Yongfeng ZHU, Yongjie ZHANG, Jianxiong ZHOU. Robust feature selection method for ground target HRRP recognition [J]. Systems Engineering and Electronics, 2023, 45(12): 3726-3733.
[11]	Bo LI, Gexi HU, Jianjun SHI, Hengchang LIU, Tao HONG. Fault feature extraction method of rolling bearing based on multiple penalty factors optimization VMD [J]. Systems Engineering and Electronics, 2023, 45(11): 3690-3698.
[12]	Jia LIU, Qunyu XU, Weishi CHEN. Motion feature extraction and ensembled classification method based on radar tracks for drones [J]. Systems Engineering and Electronics, 2023, 45(10): 3122-3131.
[13]	Zexuan MA, Jin LI, Yanli LU, Chen CHEN. Network intrusion detection method based on WaveNet and BiGRU [J]. Systems Engineering and Electronics, 2022, 44(8): 2652-2660.
[14]	Haoliang LI, Siwei CHEN, Xuesong WANG. Study on characterization of sea corner reflectors in polarimetric rotation domain [J]. Systems Engineering and Electronics, 2022, 44(7): 2065-2073.
[15]	Yangliang WAN, Xingdong LIANG, Yanlei LI. Interference suppression method based on azimuth frequency domain filtering for airport millimeter-wave radar [J]. Systems Engineering and Electronics, 2022, 44(11): 3357-3363.

Millimeter-wave radar body interference recognition based on spatial attribute features

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 13

References 31

Related Articles 15

Recommended Articles

Metrics

Comments