对多功能雷达的DQN认知干扰决策方法

doi:10.3969/j.issn.1001-506X.2020.04.12

Abstract

Abstract:

With the increasing number of tasks that can be performed by multifunctional radar (MFR), the decision-making efficiency of Q-Learning based decision-making methods of cognitive jamming is significantly reduced. Aiming at this, a deep Q neural network (DQN) based jamming decision-making method against MFR is proposed. Firstly, the characteristics of MFR signals are analyzed and the jamming library is constructed. Based on this, the jamming decision-making method is studied. Secondly, through the brief explanation of the DQN principle, the jamming decision-making method and its process are proposed. Finally, the simulation test of the decision-making method is carried out and the necessity of the method is verified by comparing the decision-making performance of DQN and Q-Learning. In order to improve the real-time and accuracy of decision-making, the DQN algorithm has been improved. On this basis, combined with prior knowledge, the decision-making efficiency is further improved. The simulation test shows that the decision-making method can learn the jamming effect in the actual battlefield autonomously, and complete the decision-making of cognitive jamming against the MFR that can perform multiple radar tasks.

Key words: multifunctional radar (MFR), jamming decision-making, deep Q neural network (DQN), cognitive electronic warfare, priori knowledge

CLC Number:

TN974

Bokai ZHANG, Weigang ZHU. DQN based decision-making method of cognitive jamming against multifunctional radar[J]. Systems Engineering and Electronics, 2020, 42(4): 819-825.

Figures/Tables 12

Table 1

Fig.1

Table 2

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

References 16

1	DARPA. Behavior learning for adaptive electronic warfare[EB/OL].[2018-03-23]. http://www.fbo.gov.
2	DARPA. Communications under extreme RF spectrum conditions[EB/OL].[2018-05-09]. http://www.fbo.gov.
3	Air Force. Cognitive jammer[EB/OL].[2018-05-09]. http://www.fbo.gov.
4	DARPA. Adaptive radar countermeasures[EB/OL].[2018-06-26]. https://www.fbo.gov.
5	孙宏伟, 童宁宁, 孙富君. 基于D-S证据理论的电子干扰模式选择[J]. 弹箭与制导学报, 2003, 23 (2): 218- 220.
	SUN H W , TONG N N , SUN F J . Jamming design selection based on D-S theory[J]. Journal of Projectiles, Rockets, Missiles and Guidance, 2003, 23 (2): 218- 220.
6	张永顺.复杂电磁环境下基于博弈论的机载雷达对抗仿真研究[D].西安:西安电子科技大学, 2011.
	ZHANG Y S. The research on simulation of airborne radar countermeasures based on game theory in complex electromagnetic environment[D]. Xi'an: Xidian University, 2011.
7	李云杰, 朱云鹏, 高梅国. 基于Q-学习算法的认知雷达对抗过程设计[J]. 北京理工大学学报, 2015, 35 (11): 1194- 1199.
	LI Y J , ZHU Y P , GAO M G . Design of cognitive radar jamming based on Q-Learning algorithm[J]. Transactions of Beijing Institute of Technology, 2015, 35 (11): 1194- 1199.
8	邢强, 贾鑫. 基于Q-学习的智能雷达对抗[J]. 系统工程与电子技术, 2018, 40 (5): 1031- 1035.
	XING Q , JIA X . Intelligent radar countermeasure based on Q-learning[J]. Systems Engineering and Electronics, 2018, 40 (5): 1031- 1035.
9	FARINA A, TIMMONERI L. Live data test of electronic counter-countermeasures (ECCM) on a multifunctional prototype radar[C]//Proc.of the IEEE Metrology for Aerospace, 2016.
10	马爽.多功能雷达电子情报信号处理关键技术研究[D].长沙:国防科技大学, 2013.
	MA S. Research on ELINT signal processing key technologies for multifunction radar[D]. Changsha: National University of Defense Technology, 2013.
11	MNIH V , KAVUKCUOGLU K , SILVER D . Human-level control through deep reinforcement learning[J]. Nature, 2015, 518 (7540): 529- 533. doi: 10.1038/nature14236
12	DUGGAN M , DUGGAN J , BARRETT E . A reinforcement learning approach for the scheduling of live migration from under utilised hosts[J]. Memetic Computing, 2017, 9 (4): 283- 293. doi: 10.1007/s12293-016-0218-x
13	EPPINGER E , WALTER M , SHU C L . Electrophysiological correlates reflect the integration of model-based and model-free decision information[J]. Cognitive, Affective, & Behavioral Neuroscience, 2017, 17 (2): 406- 421.
14	彭伟. 揭秘深度强化学习[M]. 北京: 北京水利水电出版社, 2018: 39- 61.
	PENG W . Reveal secrets of deep reinforcement learning[M]. Beijing: Beijing Water Resources and Hydropower Press, 2018: 39- 61.
15	SAJAD H K , SAEED B S , SOROUSH S K . Path planning of modular robots on various terrains using Q-learning versus optimization algorithms[J]. Intelligent Service Robotics, 2017, 10 (2): 121- 136. doi: 10.1007/s11370-017-0217-x
16	MATTEO H , JOSEPH M , HAD V H , et al. Rainbow: combining improvements in deep reinforcement learning[J]. Nature, 2017, 1- 9.

功能层	任务层	波形单元	波形单元表示						JM
功能层	任务层	波形单元	PRI	CF	PW	MT	Cr	BoxD	JM
1	T₁^A	w₁^A				1			1、2、3、4、5
2	T₂^A	w₂^A				2			6、7、8
2	T₂^B	w₂^B				2			3、9、10
									
10	T₁₀^A	w₁₀^A				5			3、6、9
10	T₁₀^B	w₁₀^B				6			3、6、10
11	T₁₁^A	w₁₁^A				6			6、8、10

任务层	JM
任务层	1	2	3	4	5	6	7	8	9	10	11	12
T₁^A		T₂^B		T₂^A		T₁^A				T₁^A
T₂^A	T₁^A				T₂^A	T₃^A		T₃^B
T₂^B	T₁^A				T₂^B		T₃^C		T₃^A
T₃^A~T₉^C	…	…	…	…	…	…	…	…	…	…	…	…
T₁₀^A		T₁₁^A			T₉^B			T₁₀^A
T₁₀^B				T₉^C		T₁₀^B			T₉^B			T₁₁^A
T₁₁^A

DQN based decision-making method of cognitive jamming against multifunctional radar

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 12

References 16

Related Articles 1

Recommended Articles

Metrics

Comments