面向认知增强的MUM-T态势图视觉调控方法

doi:10.12305/j.issn.1001-506X.2026.04.18

系统工程与电子技术 ›› 2026, Vol. 48 ›› Issue (4): 1292-1302.doi: 10.12305/j.issn.1001-506X.2026.04.18

• 系统工程 • 上一篇

面向认知增强的MUM-T态势图视觉调控方法

武愈涵¹^,²(), 吴晓莉¹^,²^,*, 张欣悦¹^,², 晏彪¹^,², 王名珺¹^,²

1. 南京理工大学人机融合与智能交互研究中心，江苏南京 210094
2. 语言信息智能处理及应用工信部重点实验室，江苏南京 210094

收稿日期:2024-12-05 修回日期:2025-04-07 出版日期:2025-07-08 发布日期:2025-07-08
通讯作者: 吴晓莉 E-mail:15951975551@163.com
作者简介:武愈涵（2001—），女，硕士研究生，主要研究方向为人机交互
张欣悦（2001—），女，硕士研究生，主要研究方向为多模态交互
晏　彪（1996—），男，博士研究生，主要研究方向为人机交互
王名珺（2000—），女，硕士研究生，主要研究方向为人因与人机交互
基金资助:
国家自然科学基金（52175469）；江苏省自然科学基金（BK20221490）资助课题

Visual adjustment method of MUM-T situation map for cognitive enhancement

Yuhan WU¹^,²(), Xiaoli WU¹^,²^,*, Xinyue ZHANG¹^,², Biao YAN¹^,², Mingjun WANG¹^,²

1. Research Centre of Human Cyber Physical Integration and Intelligent Interaction，Nanjing University of Science and Technology，Nanjing 210094，China
2. Key Laboratory of Ministry Industry and Information Technology for Language Information Processing and Application，Nanjing 210094，China

Received:2024-12-05 Revised:2025-04-07 Online:2025-07-08 Published:2025-07-08
Contact: Xiaoli WU E-mail:15951975551@163.com

摘要/Abstract

摘要：

有人-无人机协同(manned-unmanned teaming, MUM-T)模式中，增加多无人机协同容易引起飞行员认知过载。针对此问题，提出调节态势图背景模糊度和明度对比度的视觉调控方法帮助指挥员认知增强，通过诱导认知过载模拟实验，采用多元回归方法建立融合多维指标的负荷评估模型检验其调控有效性，并探索其调控原理。结果表明，较低负荷下低度、中度模糊与中对比度的组合调控能够较好程度缓解认知过载，较高负荷下中度、高度模糊与中对比度的组合认知增强效果最佳，为未来MUM-T座舱显控态势界面设计及测评提供方法参考，帮助指挥员在认知过载状态下减轻认知负荷。

关键词: 有人-无人机协同, 认知增强, 认知过载, 态势图, 回归模型

Abstract:

In the manned-unmanned teaming （MUM-T） mode, adding multi-unmanned aerial vehicle collaboration can easily cause cognitive overload for pilots. Based on this, a visual control method is proposed to enhance the cognitive enhancement of commanders by adjusting the background blur and brightness contrast of situational maps. Through induced cognitive overload simulation experiments, a load assessment model integrating multidimensional indicators is established using multiple regression methods to test its effectiveness and explore its control principles. The results show that the combination of low and moderate blur and medium contrast regulation under lower loads can alleviate cognitive overload, while the combination of medium and high blur and medium contrast regulation under higher loads has the best cognitive enhancement effect. This study provides a methodological reference for the design and evaluation of the MUM-T cockpit display and control situation interface in the future, helping to reduce cognitive load under cognitive overload conditions.

Key words: manned-unmanned teaming, cognitive enhancement, cognitive overload, situation map, regression model

中图分类号:

武愈涵, 吴晓莉, 张欣悦, 晏彪, 王名珺. 面向认知增强的MUM-T态势图视觉调控方法[J]. 系统工程与电子技术, 2026, 48(4): 1292-1302.

Yuhan WU, Xiaoli WU, Xinyue ZHANG, Biao YAN, Mingjun WANG. Visual adjustment method of MUM-T situation map for cognitive enhancement[J]. Systems Engineering and Electronics, 2026, 48(4): 1292-1302.

图/表 21

表1

图1

图2

图3

图4

图5

图6

图7

图8

表2

图9

图10

表3

图11

图12

图13

表4

图14

图15

图16

表5

参考文献 32

1	ZHU Y C, LIANG Y G, XIE Z Y, et al. Multi-type task assignment algorithm for heterogeneous UAV cluster based on improved NSGA-Ⅱ[J]. Drones, 2024, 8 (8): 384. doi: 10.3390/drones8080384
2	姜鹏, 王瑞, 郑力会, 等. 国外有人/无人机协同作战研究现状与发展趋势[J]. 兵工自动化, 2023, 42 (3): 84- 89. doi: 10.7690/bgzdh.2023.03.016
	JIANG P, WANG R, ZHENG L H, et al. Research status and development trends of human/UAV collaborative operations abroad[J]. Ordnance Industry Automation, 2023, 42 (3): 84- 89. doi: 10.7690/bgzdh.2023.03.016
3	熊威, 张栋, 任智, 等. 面向有人/无人机协同打击的智能决策方法研究[J]. 系统工程与电子技术, 2025, 47 (4): 1285- 1299. doi: 10.12305/j.issn.1001-506X.2025.04.25
	XIONG W, ZHANG D, REN Z, et al. Research on intelligent decision making methods for coordinated strike by humans/drones[J]. Systems Engineering and Electronics, 2025, 47 (4): 1285- 1299. doi: 10.12305/j.issn.1001-506X.2025.04.25
4	SCHMITT F, SCHULTE A. Mixed-initiative mission planning using planning strategy models in military manned-unmanned teaming missions[C]//Proc. of the IEEE International Conference on Systems, Man, and Cybernetics, 2015: 1391−1396.
5	RUF C, STUTZ P. Model-driven payload sensor opperation assistance for a transport helicopter crew in manned-unmanned teaming missions: assistance realization, modelling experimental evaluation of mental workload[C]//Proc. of the Engineering Psychology and Cognitive Ergonomics: Performance, Emotion and Situation Awareness, 2017: 51−63.
6	WEILANDT J, JONSON C O, PRYTZ E. Information overload in Swedish emergency response command and control functions[M]. Linkoping: Linkoping University Electronic Press, 2021.
7	CHOI H H, VAN MERRIENBOER J J G, PAAS F. Effects of the physical environment on cognitive load and learning: towards a new model of cognitive load[J]. Educational Psychology Review, 2014, 26 (2): 225- 244. doi: 10.1007/s10648-014-9262-6
8	MUGABE J, WISNIEWSKI M, PERRUSQUÍA A, et al. Enhancing situational awareness of helicopter pilots in unmanned aerial vehicle-congested environments using an airborne visual artificial intelligence approach[J]. Sensors, 2024, 24 (23): 7762. doi: 10.3390/s24237762
9	BRAND Y, SCHULTE A. Workload-adaptive and task-specific support for cockpit crews: design and evaluation of an adaptive associate system[J]. Human-Intelligent Systems Integration, 2021, 3 (2): 187- 199. doi: 10.1007/s42454-020-00018-8
10	ONKEN R, SCHULTE A. System-ergonomic design of cognitive automation: dual-mode cognitive design of vehicle guidance and control work systems[M]. Berlin: Springer, 2010, .
11	BRIOSCHI GUEVARA A, BIELER M, ALTOMARE D, et al. Protocols for cognitive enhancement. A user manual for brain health services—part 5 of 6[J]. Alzheimer’s Research & Therapy, 2021, 13: 172.
12	DRESLER M, SANDBERG A, BUBLITZ C, et al. Hacking the brain: dimensions of cognitive enhancement[J]. American Chemical Society Chemical Neuroscience, 2019, 10 (3): 1137- 1148.
13	BOYCE M W, THOMSON R H, CARTWRIGHT J K, et al. Enhancing military training using extended reality: a study of military tactics comprehension[J]. Frontiers in Virtual Reality, 2022, 3, 754627. doi: 10.3389/frvir.2022.754627
14	KIM S H, LEE J H, PARK D, et al. Effects of visual complexity levels and information decluttering methods for cockpit displays on human search performance[C]//Proc. of the Human Factors and Ergonomics Society Annual Meeting, 2019.
15	LI X, WANG H Y, SHAO J K. Research on the influence of icon shape complexity and composition on visual search based on military geographic intelligence system[C]//Proc. of the IEEE 5th International Conference on Image, Vision and Computing, 2020: 247−250.
16	WARDEN A C, WICKENS C D, CLEGG B A, et al. Quantitative effects of overlay clutter and information access effort: examining the scan-clutter trade-off in displays with geospatial maps[J]. Journal of Experimental Psychology: Applied, 2024, 30 (4): 607- 630. doi: 10.1037/xap0000512
17	LIANG C R, SHUANG L I U, WANYAN X R, et al. Effects of input method and display mode of situation map on early warning aircraft reconnaissance task performance with different information complexities[J]. Chinese Journal of Aeronautics, 2023, 36 (1): 105- 114. doi: 10.1016/j.cja.2022.06.011
18	WU X L, LI J, ZHOU F. An experimental study of features search under visual interference in radar situation-interface[J]. Chinese Journal of Mechanical Engineering, 2018, 31, 45. doi: 10.1186/s10033-018-0245-2
19	SCHULTE A, DONATH D, HONECKER F. Human-system interaction analysis for military pilot activity and mental workload determination[C]//Proc. of the IEEE International Conference on Systems, Man, and Cybernetics, 2015: 1375−1380.
20	王勋, 姚佩阳, 税冬东. 关于有人机/无人机编队协同作战决策[J]. 计算机仿真, 2015, 32 (9): 128- 132. doi: 10.3969/j.issn.1006-9348.2015.09.028
	WANG X, YAO P Y, SHUI D D. Regarding the decision-making of coordinated combat between manned and unmanned aerial vehicle formations[J]. Computer Simulation, 2015, 32 (9): 128- 132. doi: 10.3969/j.issn.1006-9348.2015.09.028
21	王童豪, 彭星光, 胡浩, 等. 海上有人/无人协同系统及其关键技术综述[J]. 兵工学报, 2024, 45 (10): 3317- 3340. doi: 10.12382/bgxb.2024.0327
	WANG T H, PENG X G, HU H, et al. Overview of manned/unmanned collaborative systems and their key technologies at sea[J]. Journal of Ordnance Engineering, 2024, 45 (10): 3317- 3340. doi: 10.12382/bgxb.2024.0327
22	SCHMITT M, STUETZ P. Perception-oriented cooperation for multiple UAVs in a perception management framework: system concept and first results[C]//Proc. of the IEEE/AIAA 35th Digital Avionics Systems Conference, 2016.
23	RUF C, STUTZ P. Establishing a variable automation paradigm for UAV-Based reconnaissance in manned-unmanned teaming missions[C]//Proc. of the International Conference on Human Factors in Robots and Unmanned Systems, 2019: 24−35.
24	MINIUKOVICH A, DE ANGELI A. Quantification of interface visual complexity[C]//Proc. of the International Working Conference on Advanced Visual Interfaces, 2014: 153−160.
25	DU D D, YU K D, YU D Y, et al. The impact of task difficulty, environmental color complexity, and teaching models on AR-assisted subway maintenance training[J]. International Journal of Human-Computer Interaction, 2025, 41(18): 11459−11472.
26	WANG C D, ZHANG Y Y, ZHANG X M, et al. How does colour predict multiple object tracking performance? The role of surface feature in attentive tracking[J]. Visual Cognition, 2024, 32 (1): 67- 81. doi: 10.1080/13506285.2024.2389454
27	LAZARO M J, KANG Y, YUN M H, et al. The effects of visual complexity and decluttering methods on visual search and target detection in cockpit displays[J]. International Journal of Human-Computer Interaction, 2021, 37 (7): 588- 600. doi: 10.1080/10447318.2021.1890491
28	PALMER S E, BROOKS J L, NELSON R. When does grouping happen?[J]. Acta Psychologica, 2003, 114 (3): 311- 330. doi: 10.1016/j.actpsy.2003.06.003
29	RASHAL E, WAGEMANS J. Depth from blur and grouping under inattention[J]. Attention, Perception, & Psychophysics, 2022, 84(3): 878–898.
30	BIONDI F N, CACANINDIN A, DOUGLAS C, et al. Overloaded and at work: investigating the effect of cognitive workload on assembly task performance[J]. Human Factors, 2021, 63 (5): 813- 820. doi: 10.1177/0018720820929928
31	MORTON J, ZHELEVA A, VAN ACKER B B, et al. Danger, high voltage! using EEG and EOG measurements for cognitive overload detection in a simulated industrial context[J]. Applied Ergonomics, 2022, 102, 103763. doi: 10.1016/j.apergo.2022.103763
32	LEWIS J R, SAURO J. Measuring the perceived clutter of websites[J]. International Journal of Human-Computer Interaction, 2025, 41(9): 5260−5273.

指标类型	指标名称
主观负荷	NASA任务负荷指数
行为绩效	任务完成时间
行为绩效	正确率
眼动数据	注视计数
	平均注视时间
	平均瞳孔直径

特征	回归系数$ {\beta }_{i} $	标准误差	p值
$ {\beta }_{0} $截距	−0.8842	0.0500	<0.0001
X₁注视计数	0.0423	0.015	0.005
X₂瞳孔直径	0.3487	0.120	0.004
X₃反应时	0.7130	0.212	<0.001
X₄正确率	−0.0410	0.043	0.341
X₅主观负荷指数	1.2595	0.150	<0.0001

变量	低任务难度		高任务难度
变量	F值	p值	F值	p值
任务完成时间	3.369	0.020	6.722	<0.001
正确率	4.454	0.005	248	<0.001
主观负荷	36.594	<0.001	44.532	<0.001
注视计数	3.763	0.012	2.427	0.066
瞳孔直径	3.981	0.009	6.490	<0.001

变量	低任务难度		高任务难度
变量	F值	p值	F值	p值
任务完成时间	1.277	0.283	0.327	0.722
正确率	1.734	0.114	0.001	0.999
主观负荷	5.867	0.004	5.256	0.006
注视计数	35.392	<0.001	25.749	<0.001
瞳孔直径	122.087	<0.001	100.268	<0.001

变量	低任务难度		高任务难度
变量	F值	p值	F值	p值
任务完成时间	0.480	0.823	1.999	0.166
正确率	6.079	<0.001	0.084	0.772
主观负荷	122.087	<0.001	100.268	<0.001
注视计数	1.297	0.259	2.566	0.019
瞳孔直径	5.474	<0.001	11.208	<0.001

面向认知增强的MUM-T态势图视觉调控方法

Visual adjustment method of MUM-T situation map for cognitive enhancement

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

图/表 21

参考文献 32

相关文章 13

编辑推荐

Metrics

本文评价

[1]	禄晓飞, 靳硕静, 洪灵, 戴奉周. 基于聚类求解TVAR模型的目标微多普勒分析[J]. 系统工程与电子技术, 2023, 45(3): 660-668.
[2]	徐平亮, 崔亚奇, 熊伟, 熊振宇, 顾祥岐. 生成式中断航迹接续关联方法[J]. 系统工程与电子技术, 2022, 44(5): 1543-1552.
[3]	张先超, 马亚辉. 体系能力模型与装备体系贡献率测度方法[J]. 系统工程与电子技术, 2019, 41(4): 843-849.
[4]	徐丹, 符吉祥, 孙光才, 邢孟道, 苏涛. 宽带弹道高速群目标运动精补偿方法[J]. 系统工程与电子技术, 2019, 41(10): 2205-2213.
[5]	韩春耀, 熊家军, 张凯, 兰旭辉. 高超声速飞行器分解集成轨迹预测算法[J]. 系统工程与电子技术, 2018, 40(1): 151-158.
[6]	赵兴刚, 王首勇. 基于AR模型的飞机尾流距离检测方法[J]. 系统工程与电子技术, 2017, 39(4): 726-732.
[7]	刘洁瑜, 沈强, 李灿, 秦伟伟. 基于优化KF的MEMS陀螺阵列信号融合方法[J]. 系统工程与电子技术, 2016, 38(12): 2705-2710.
[8]	郑作虎，王首勇. 基于ARSαS模型参数估计的雷达目标检测方法[J]. 系统工程与电子技术, 2015, 37(4): 782-788.
[9]	滕炯华, 徐婧林, 卢隆, 周三平, 韩军伟. 基于自适应参数回归的非局部图像滤波算法[J]. 系统工程与电子技术, 2015, 37(2): 449-454.
[10]	盛佳恋，张磊，邢孟道，徐刚，贺丽. 联合运动补偿的逆合成孔径雷达成像方位定标方法[J]. 系统工程与电子技术, 2014, 36(5): 859-865.
[11]	李星秀，韦志辉，肖亮，费选. 非局部正则化的压缩感知图像重建算法[J]. Journal of Systems Engineering and Electronics, 2013, 35(1): 196-202.
[12]	廖瑛, 潘旺华, 文援兰, 刘翔春. 基于补偿最小二乘估计法的卫星精密定轨方法[J]. Journal of Systems Engineering and Electronics, 2012, 34(7): 1430-1434.
[13]	王汝夯，黄建国，张群飞. 基于分数阶傅里叶变换的LFM混响空时预白化方法[J]. Journal of Systems Engineering and Electronics, 2011, 33(7): 1523-1526.