意图态势双驱动的数据链抗干扰通信机制

doi:10.12305/j.issn.1001-506X.2025.06.33

摘要/Abstract

摘要：

针对高动态、强对抗场景下数据链整体抗干扰效应差和自主适变能力弱的问题, 提出意图态势双驱动的数据链抗干扰通信机制。从架构、协议和技术3个角度出发, 提出分域、分级、分布式的抗干扰网络架构, 构建意图态势双驱动的跨层自适应抗干扰协议模型, 设计意图态势双驱动的智能抗干扰决策算法。将动态干扰环境下的多域联合抗干扰问题建模为马尔可夫决策过程, 并采用深度强化学习算法求解时、空、频多维联合抗干扰传输策略。仿真结果表明, 所提机制的网络吞吐量和传输成功率相较于其他方法分别提高了26.7%和54.5%, 显著提升了抗干扰传输性能。

关键词: 数据链网络, 意图态势双驱动, 抗干扰通信, 深度强化学习

Abstract:

In response to the challenges of poor anti-jamming effect, weak self-adaptive ability of data link in high dynamic and strong confrontation scenarios, an intent and situation-dual driven anti-jamming communication mechanism for data link networks is proposed. Covering architecture, protocol, and technology, a domain-based hierarchical distributed anti-jamming network architecture is presented, which constructs a cross-layer adaptive anti-jamming protocol model driven by intent and situation and designs an intelligent anti-jamming decision algorithm driven by intent and situation. The multi-domain joint anti-jamming problem in a dynamic jamming environment is modeled as a Markov decision process, and the deep reinforcement learning algorithm is used to solve the time, space, frequency multi-dimensional joint anti-jamming transmission policy. The simulation results show that the network throughput and transmission success rate of the proposed mechanism are improved by 26.7% and 54.5% respectively compared with other methods, and the proposed mechanism significantly improve the anti-jamming transmission performance.

Key words: data link network, intent and situation-dual driven, anti-jamming communication, deep reinforcement learning

中图分类号:

TN919

刘书含, 李彤, 李富强, 杨春刚. 意图态势双驱动的数据链抗干扰通信机制[J]. 系统工程与电子技术, 2025, 47(6): 2055-2064.

Shuhan LIU, Tong LI, Fuqiang LI, Chungang YANG. Intent and situation-dual driven anti-jamming communication mechanism for data link[J]. Systems Engineering and Electronics, 2025, 47(6): 2055-2064.

图/表 10

表1

表2

图1

图2

图3

图4

表3

表4

图5

图6

参考文献 32

1	赵志勇, 毛忠阳, 潘耀宗, 等. 智能化战争条件下数据链关键技术发展述评[J/OL]. 电讯技术, 2024, 64(12): 2075-2080.
	ZHAO Z Y, MAO Z Y, PAN Y Z, et al. Research on the development of key technologies of data link under intelligentwar conditions[J/OL]. Telecommunication Engineering, 2024, 64(12): 2075-2080.
2	YUAN Y Q, HU J F, ZHANG L. An analysis on mission-driven networking technologies in data link[C]//Proc. of the IEEE 4th International Conference on Electronic Information and Communication Technology, 2021: 59-63.
3	LIU X , XU Y H , JIA L L , et al. Anti-jamming communications using spectrum waterfall: a deep reinforcement learning approach[J]. IEEE Communications Letters, 2018, 22 (5): 998- 1001. doi: 10.1109/LCOMM.2018.2815018
4	PIRAYESH H , ZENG H . Jamming attacks and anti-jamming strategies in wireless networks: a comprehensive survey[J]. IEEE Communications Surveys & Tutorials, 2022, 24 (2): 767- 809.
5	NIU Y T , WAN B Y , CHEN C X . A centralized multi-user anti-composite intelligent interference algorithm based on improved Q-learning[J]. Electronics, 2023, 12 (8): 1803. doi: 10.3390/electronics12081803
6	ZHOU Q , SHAHIDEHPOUR M , PAASO A , et al. Distributed control and communication strategies in networked micro grids[J]. IEEE Communications Surveys & Tutorials, 2020, 22 (4): 2586- 2633.
7	韩晨, 刘爱军, 安康, 等. 干扰环境下基于博弈论的无人机群部署与组网方法[J]. 电子与信息学报, 2022, 44 (3): 860- 870.
	HAN C , LIU A J , AN K , et al. Methods of UAV swarm deployment and networking based on game theory in jamming environment[J]. Journal of Electronics and Information Technology, 2022, 44 (3): 860- 870.
8	NOBRE J , ROSARIO D , BOTH C , et al. Toward software-defined battlefield networking[J]. IEEE Communications Magazine, 2016, 54 (10): 152- 157. doi: 10.1109/MCOM.2016.7588285
9	WANG X M , WANG J L , XU Y H , et al. Dynamic spectrum anti-jamming communications: challenges and opportunities[J]. IEEE Communications Magazine, 2020, 58 (2): 79- 85. doi: 10.1109/MCOM.001.1900530
10	LIU X , XU Y H , JIA L L , et al. Anti-jamming communications using spectrum waterfall: a deep reinforcement learning approach[J]. IEEE Communications Letters, 2018, 22 (5): 998- 1001. doi: 10.1109/LCOMM.2018.2815018
11	REZAZADEH N , SHAFAI L . A compact antenna for GPS anti-jamming in airborne applications[J]. IEEE Access, 2019, 7, 154253- 154259. doi: 10.1109/ACCESS.2019.2948823
12	D'ORO S , EKICI E , PALAZZO S . Optimal power allocation and scheduling under jamming attacks[J]. IEEE/ACM Trans. on Networking, 2016, 25 (3): 1310- 1323.
13	JIA L L , XU Y H , SUN Y M , et al. A multi-domain anti-jamming defense scheme in heterogeneous wireless networks[J]. IEEE Access, 2018, 6, 40177- 40188. doi: 10.1109/ACCESS.2018.2850879
14	LI Y C , WANG J C , GAO Z Z . Learning-based multi-domain anti-jamming communication with unknown information[J]. Electronics, 2023, 12 (18): 3901. doi: 10.3390/electronics12183901
15	HANAWAL M K , ABDEL-RAHMAN M J , KRUNZ M . Joint adaptation of frequency hopping and transmission rate for anti-jamming wireless systems[J]. IEEE Trans. on Mobile Computing, 2015, 15 (9): 2247- 2259.
16	LI Y C , BAI S Z , GAO Z Z . A multi-domain anti-jamming strategy using Stackelberg game in wireless relay networks[J]. IEEE Access, 2020, 8, 173609- 173617.
17	DING H H , NIU Y T , ZHOU Q , et al. A novel intelligent anti-jamming communication algorithm based on proximal policy optimization[J]. Physical Communication, 2024, 102366.
18	LI T , LI C , YANG C G , et al. A mean field game-theoretic cross-layer optimization for multi-hop swarm UAV communications[J]. Journal of Communications and Networks, 2021, 24 (1): 68- 82.
19	SRIVASTAVA V , MOTANI M . Cross-layer design: a survey and the road ahead[J]. IEEE Communications Magazine, 2005, 43 (12): 112- 119.
20	范祥瑞. 协同制导数据链认知抗干扰组网技术研究[D]. 北京: 中国运载火箭技术研究院, 2019.
	FAN X R. Research on cognitive anti-jamming networking technology of cooperative guidance data link[D]. Beijing: China Academy of Launch Vehicle Technology, 2019.
21	CUI J J , LIU Y W , NALLANATHAN A . Multi-agent rein forcement learning-based resource allocation for UAV networks[J]. IEEE Trans. on Wireless Communications, 2019, 19 (2): 729- 743.
22	NASIR Y S , GUO D . Multi-agent deep reinforcement learning for dynamic power allocation in wireless networks[J]. IEEE Journal on Selected Areas in Communications, 2019, 37 (10): 2239- 2250.
23	PU Z M, NIU Y T, ZHANG G L. A Multi-parameter intelligent communication anti-jamming method based on three-dimensional Q-learning[C]//Proc. of the IEEE 2nd International Conference on Computer Communication and Artificial Intelligence, 2022: 205-210.
24	ALI A S, NASER S, MUHAIDAT S. Defeating proactive jammers using deep reinforcement learning for resource-constrained IoT networks[C]//Proc. of the IEEE 34th Annual International Symposium on Personal, Indoor and Mobile Radio Communications, 2023.
25	ZHOU Q , NIU Y T , XIANG P , et al. Intra-domain knowledge reuse assisted reinforcement learning for fast anti-jamming communication[J]. IEEE Trans. on Information Forensics and Security, 2023, 18, 4707- 4720.
26	张梦钰, 豆亚杰, 陈子夷, 等. 深度强化学习及其在军事领域中的应用综述[J]. 系统工程与电子技术, 2024, 46 (4): 1297- 1308. doi: 10.12305/j.issn.1001-506X.2024.04.18
	ZHANG M Y , DOU Y J , CHEN Z Y , et al. Review of deep reinforcement learning and its application in military field[J]. Systems Engineering and Electronics, 2024, 46 (4): 1297- 1308. doi: 10.12305/j.issn.1001-506X.2024.04.18
27	YANG C G , MI X R , OUYANG Y , et al. Smart intent-driven network management[J]. IEEE Communications Magazine, 2023, 61 (1): 106- 112.
28	LI T , YANG C G , SONG Y B , et al. Architecting autonomous network management and control via intent-driven decoupled network[J]. IEEE Network, 2024, 38 (6): 361- 369.
29	HU J W , WANG L H , HU T M , et al. Autonomous maneuver decision making of dual-UAV cooperative air combat based on deep reinforcement learning[J]. Electronics, 2022, 11 (3): 467.
30	WANG X M, CHEN X Q, WANG M, et al. Decentralized reinforcement learning based anti-jamming communication for self-organizing networks[C]//Proc. of the IEEE Wireless Communications and Networking Conference, 2021.
31	姚昌华, 巫刚, 李家强, 等. 面向异构传输需求的多无人机通信协同抗干扰决策方法[J]. 电讯技术, 2024, 64 (7): 1015- 1024.
	YAO C H , WU G , LI J Q , et al. Cooperative anti-jamming decision-making method for multi-UAV communication for heterogeneous transmission requirements[J]. Telecommunication Engineering, 2024, 64 (7): 1015- 1024.
32	ZHANG X B, WANG H, RUAN L, et al. Joint channel, power and bandwidth optimization for anti-jamming communications: a multi-agent Q-learning approach[C]//Proc. of the 13th International Conference on Wireless Communications and Signal Processing, 2021.

网络架构	特点	局限性
集中式	适用于小规模网络、决策能力强	易出现单点故障, 不适用于大规模网络
分布式	去中心化, 适用于高动态网络	对同步性能要求高, 设计复杂、资源需求量大
半分布式	更具灵活性和自主性	适用于中等规模网络

技术	抗干扰措施	局限性
频域	直扩、跳频	预先生成扩频参数、共址干扰问题、缺乏灵活性、吞吐量损失等
时域	猝发通信技术	在高频/较高频/超高频频段的实现存在技术难题
空域	自适应天线技术	抗干扰能力有限
速率域	自适应速率控制	当干扰功率足够大, 通信无法进行或仅能以极低的平均吞吐量进行
功率域	自适应功率调整	对硬件要求高

参数	取值	参数	取值
通信节点/个	6	噪声功率谱密度/dBm	-80
干扰模式	扫频/定频/随机/混合干扰	干扰功率集合/mW	[3, 6, 9]
通信频点/个	51	时隙数/个	400
跳频图样库	10	跳频图样切换代价	0.5
发射功率档位	5	发射功率切换代价	0.5
传输速率档位	3	传输速率切换代价	0.5

参数	取值	参数	取值
训练次数	10 000	学习率	0.5
经验池容量	5 000	折扣因子	0.8
批量样本大小	128	探索率初始值	1.0
优化器	Adam	探索率下降速率	0.001

[1]	孟麟芝, 孙小涓, 胡玉新, 高斌, 孙国庆, 牟文浩. 面向卫星在轨处理的强化学习任务调度算法[J]. 系统工程与电子技术, 2025, 47(6): 1917-1929.
[2]	郑康洁, 张新宇, 王伟菘, 刘震生. DQN与规则结合的智能船舶动态自主避障决策[J]. 系统工程与电子技术, 2025, 47(6): 1994-2001.
[3]	熊威, 张栋, 任智, 杨书恒. 面向有人/无人机协同打击的智能决策方法研究[J]. 系统工程与电子技术, 2025, 47(4): 1285-1299.
[4]	马鹏, 蒋睿, 王斌, 徐盟飞, 侯长波. 基于隐式对手建模的策略重构抗智能干扰方法[J]. 系统工程与电子技术, 2025, 47(4): 1355-1363.
[5]	唐开强, 傅汇乔, 刘佳生, 邓归洲, 陈春林. 基于深度强化学习的带约束车辆路径分层优化研究[J]. 系统工程与电子技术, 2025, 47(3): 827-841.
[6]	陈夏瑢, 李际超, 陈刚, 刘鹏, 姜江. 基于异质网络的装备体系组合发展规划问题[J]. 系统工程与电子技术, 2025, 47(3): 855-861.
[7]	张庭瑜, 曾颖, 李楠, 黄洪钟. 基于深度强化学习的航天器功率-信号复合网络优化算法[J]. 系统工程与电子技术, 2024, 46(9): 3060-3069.
[8]	夏雨奇, 黄炎焱, 陈恰. 基于深度Q网络的无人车侦察路径规划[J]. 系统工程与电子技术, 2024, 46(9): 3070-3081.
[9]	杨志鹏, 陈子浩, 曾长, 林松, 毛金娣, 张凯. 复杂环境下的飞行器在线航路规划决策方法[J]. 系统工程与电子技术, 2024, 46(9): 3166-3175.
[10]	郭宏达, 娄静涛, 徐友春, 叶鹏, 李永乐, 陈晋生. 基于MADDPG的多无人车协同事件触发通信[J]. 系统工程与电子技术, 2024, 46(7): 2525-2533.
[11]	刘祥林, 杨春刚, 李富强, 欧阳颖, 宋延博. 意图驱动数据链网络策略协商模型与算法[J]. 系统工程与电子技术, 2024, 46(6): 2128-2137.
[12]	张梦钰, 豆亚杰, 陈子夷, 姜江, 杨克巍, 葛冰峰. 深度强化学习及其在军事领域中的应用综述[J]. 系统工程与电子技术, 2024, 46(4): 1297-1308.
[13]	李彦铃, 罗飞舟, 葛致磊. 基于鲁棒观测器的深度强化学习垂直起降运载器姿态稳定研究[J]. 系统工程与电子技术, 2024, 46(3): 1038-1047.
[14]	吴冯国, 陶伟, 李辉, 张建伟, 郑成辰. 基于深度强化学习算法的无人机智能规避决策[J]. 系统工程与电子技术, 2023, 45(6): 1702-1711.
[15]	唐进, 梁彦刚, 白志会, 黎克波. 基于DQN的旋翼无人机着陆控制算法[J]. 系统工程与电子技术, 2023, 45(5): 1451-1460.