基于人机协同作战多通道交互系统的隐性知识挖掘

doi:10.12305/j.issn.1001-506X.2025.10.18

摘要/Abstract

摘要：

在人机协同作战场景下，针对如何通过多通道交互关联隐性知识以优化交互设计问题，提出隐性知识挖掘方法。首先，分析典型人机协同作战任务中的作战流程，结合视觉、语音、手势等多种交互通道，设计协同作战的多通道人机交互系统。其次，以该系统为载体，构建行为认知图模型，对协同作战流程中的关键节点进行关联度分析，并结合眼动追踪数据对操作者的交互行为进行定量分析。最后，引入图论中的物理量对隐性知识进行显性化描述，表明所提方法可有效融合感知信息。所提方法可为多通道交互系统中人机交互模式的优化设计提供有价值的参考。

关键词: 人机协同, 多通道交互, 隐性知识, 眼动追踪

Abstract:

In the context of human-machine cooperative combat, a method for tacit knowledge mining is proposed aiming at optimizing interaction design problem through multi-channel interactive association tacit knowledge. Firstly, the operational process of typical human-machine cooperative combat tasks is analyzed, and a multi-channel interactive system of human-machine is designed by integrating multiple interaction channels such as vision, speech, and gestures. Secondly, based on the proposed system, a behavioral-cognitive graph model is constructed to analyze the association between key nodes in the cooperative task process. And eye-tracking data is employed to quantitatively assess the operator interactive behavior. Finally, physical quantities from graph theory are introduced to explicitly describe the tacit knowledge, demonstrating that the proposed method effectively integrates perceptual information. The proposed method provides a valuable reference for optimizing human-machine interactive patterns in multi-channel systems.

Key words: human-machine cooperative, multi-channel interaction, tacit knowledge, eye-tracking

中图分类号:

王名珺, 吴晓莉, 晏彪, 张欣悦, 武愈涵. 基于人机协同作战多通道交互系统的隐性知识挖掘[J]. 系统工程与电子技术, 2025, 47(10): 3313-3324.

Mingjun WANG, Xiaoli WU, Biao YAN, Xinyue ZHANG, Yuhan WU. Tacit knowledge mining based on multi-channel interactive system of human-machine cooperative combat[J]. Systems Engineering and Electronics, 2025, 47(10): 3313-3324.

图/表 22

图1

图2

图3

图4

表1

表2

表3

图5

图6

图7

图8

图9

表4

图10

图11

图12

图13

图14

图15

图16

图17

图18

参考文献 30

1	李隆, 许瑛, 岳源, 等. 有人/无人机协同作战指挥界面设计[J]. 火力与指挥控制, 2016, 41 (5): 130- 133.
	LI L, XU Y, YUE Y, et al. Design of human-UAV cooperative combat command interface[J]. Fire Control & Command Control, 2016, 41 (5): 130- 133.
2	史文卿, 王海峰, 陈海昕. 战斗机无人机编组协同系统需求捕获与验证[J]. 系统工程与电子技术, 2023, 45 (1): 108- 118.
	SHI W Q, WANG H F, CHEN H X. Demand capture and verification of fighter-UAV formation cooperative system[J]. Systems Engineering and Electronics, 2023, 45 (1): 108- 118.
3	樊皓, 陈东, 姜家财, 等. 机载传感器管理中信息引导雷达搜索空域研究[J]. 电光与控制, 2021, 28 (2): 65- 68.
	FAN H, CHEN D, JIANG J C, et al. Research on information-guided radar search airspace in airborne sensor management[J]. Electronics Optics & Control, 2021, 28 (2): 65- 68.
4	HECHT D, REINER M, HALEVY G. Multimodal virtual environments: response times, attention, and presence[J]. Presence: Teleoperators and Virtual Environments, 2006, 15 (5): 515- 523. doi: 10.1162/pres.15.5.515
5	CHEN Y, LI X L, LOU Z Y, et al. Research on the UAV multi-channel human-machine interaction system[C]//Proc. of the 2nd Asia-Pacific Conference on Intelligent Robot Systems, 2017: 190−195.
6	SOO J K T, TAN A L S, HO A S Y. Naturalistic human-robot interaction design for control of unmanned ground vehicles[J]. Communications in Computer and Information Science, 2016, 618, 535- 540.
7	WANG L, GAO R, VÁNCZA J, et al. Symbiotic human-robot collaborative assembly[J]. CIRP Annals, 2019, 68 (2): 701- 726. doi: 10.1016/j.cirp.2019.05.002
8	REN J, CUI Y Y, CHEN J, et al. Multi-modal human-computer interaction system in cockpit[J]. Journal of Physics: Conference Series, 2020, 1693 (1): 012212. doi: 10.1088/1742-6596/1693/1/012212
9	郑哲, 崔颢, 田潮军. 基于空空导弹虚拟样机的虚拟靶试仿真系统设计[J]. 火力与指挥控制, 2014, 39 (6): 139- 142.
	ZHENG Z, CUI H, TIAN C J. Design of virtual test simulation system based on air-to-air missile virtual prototype[J]. Fire Control & Command Control, 2014, 39 (6): 139- 142.
10	杨茜. 基于DODAF作战视图的空地协同作战模型设计[J]. 火力与指挥控制, 2023, 48 (7): 120- 126.
	YANG X. Design of air-ground cooperative combat model based on DODAF operational view[J]. Fire Control & Command Control, 2023, 48 (7): 120- 126.
11	闫飞, 甘斌, 陈招迪, 等. 离散事件仿真中实体被动式空间感知交互机制设计[J]. 系统仿真学报, 2021, 33 (9): 2234- 2242.
	YAN F, GAN B, CHEN Z D, et al. Design of passive spatial perception interaction mechanism for entities in discrete event simulation[J]. Journal of System Simulation, 2021, 33 (9): 2234- 2242.
12	WANG X Y, XUE Y B, YIN R, et al. Meta-battlefield: concept design of multi-domain man-machine cooperative operation[C]//Proc. of the China Conference on Command and Control, 2023: 638−649.
13	蒋光毅, 陈桦, 王长元, 等. EEG、视觉注视融合的MHA-LSTM神经网络飞行员注意力分析研究[J]. 西安工业大学学报, 2023, 43 (1): 48- 55.
	JIANG G Y, CHEN H, WANG C Y, et al. Research on pilot attention analysis using EEG and visual gaze fusion based on MHA-LSTM neural network[J]. Journal of Xi’an Technological University, 2023, 43 (1): 48- 55.
14	王思瑞, 王长元, 蒋光毅. 基于视觉注视信息的飞行员态势感知状态评估[J]. 国外电子测量技术, 2023, 42 (12): 160- 168.
	WANG S R, WANG C Y, JIANG G Y. Situation awareness state assessment of pilots based on visual gaze information[J]. Foreign Electronic Measurement Technology, 2023, 42 (12): 160- 168.
15	LOUNIS C, PEYSAKHOVICH V, CAUSSE M. Visual scanning strategies in the cockpit are modulated by pilots’ expertise: a flight simulator study[J]. PLoS One, 2021, 16 (2): e0247061. doi: 10.1371/journal.pone.0247061
16	LIU B, MA G, JIANG H, et al. The construction and practice of tacit knowledge externalization in aerospace enterprises[C]//Proc. of the 5th International Conference on Electromechanical Control Technology and Transportation, 2020: 172−174.
17	唐传林, 黄长强, 丁达理, 等. 一种UCAV自主空战智能战术决策方法[J]. 指挥控制与仿真, 2015, 37 (5): 5- 11.
	TANG C L, HUANG C Q, DING D L, et al. An intelligent tactical decision-making method for UCAV autonomous air combat[J]. Command Control & Simulation, 2015, 37 (5): 5- 11.
18	CRUESS R L, CRUESS S R, BOUDREAU J D, et al. Reframing medical education to support professional identity formation[J]. Academic Medicine, 2014, 89 (11): 1446- 1451. doi: 10.1097/ACM.0000000000000427
19	THEOBALD S, BRANDES N, GYAPONG M, et al. Implementation research: new imperatives and opportunities in global health[J]. The Lancet, 2018, 392 (10160): 2214- 2228. doi: 10.1016/S0140-6736(18)32205-0
20	王旋, 苟莉, 温贤秀. 护士隐性知识共享的研究进展[J]. 护理学杂志, 2023, 38 (7): 125- 128.
	WANG X, GOU L, WEN X X. Research progress on nurses’ tacit knowledge sharing[J]. Journal of Nursing Science, 2023, 38 (7): 125- 128.
21	KUCHARSKA W, ERICKSON G S. Tacit knowledge acquisition & sharing, and its influence on innovations: a Polish/US cross-country study[J]. International Journal of Information Management, 2023, 71, 102647. doi: 10.1016/j.ijinfomgt.2023.102647
22	TIINA S, KOIVUNEN T. Tacit knowledge in blue-collar work: how workers use it to fulfil their side of the psychological contract[J]. International Journal of Organizational Analysis, 2022, 30 (7): 173- 183. doi: 10.1108/IJOA-09-2021-2972
23	张建华, 温丹丹, 贺龙飞, 等. 面向隐性知识服务的组织元宇宙空间构建研究[J]. 情报杂志, 2023, 42 (11): 153- 160.
	ZHANG J H, WEN D D, HE L F, et al. Research on the construction of organizational metaverse space for tacit knowledge services[J]. Journal of Intelligence, 2023, 42 (11): 153- 160.
24	YU W W, JIN D, CAI W F, et al. Towards tacit knowledge mining within context: visual cognitive graph model and eye movement image interpretation[J]. Computer Methods and Programs in Biomedicine, 2022, 226, 107107. doi: 10.1016/j.cmpb.2022.107107
25	汪磊, 王朔, 高杉, 等. 面向特情的航线飞行员视觉注意分配研究[J]. 中国安全科学学报, 2023, 33 (1): 214- 220.
	WANG L, WANG S, GAO S, et al. Research on visual attention allocation of airline pilots for special situations[J]. China Safety Science Journal, 2023, 33 (1): 214- 220.
26	王晓芳, 郑艺裕, 林海. 导弹协同作战四维制导与控制一体化设计方法[J]. 系统工程与电子技术, 2015, 37 (4): 874- 881.
	WANG X F, ZHENG Y Y, LIN H. Integrated design method for four-dimensional guidance and control of missile cooperative combat[J]. Systems Engineering and Electronics, 2015, 37 (4): 874- 881.
27	杨楠. 座舱多功能显示器显示分配管理设计[J]. 航空电子技术, 2016, 47 (3): 13- 19.
	YANG N. Design of display allocation management for cockpit multifunction display[J]. Avionics Technology, 2016, 47 (3): 13- 19.
28	ZHAO R, WANG K, DIVEKAR R, et al. An immersive system with multi-modal human-computer interaction[C]//Proc. of the IEEE 13th International Conference on Automatic Face & Gesture Recognition, 2018: 517−524.
29	李昌岭, 李伟华. 面向战场的多通道人机交互模型[J]. 火力与指挥控制, 2014, 39 (11): 110- 114.
	LI C L, LI W H. Multi-channel human-computer interaction model for battlefield[J]. Fire Control & Command Control, 2014, 39 (11): 110- 114.
30	王少将, 刘佳, 郑锋, 等. 机器学习层谱聚类综述[J]. 计算机科学, 2023, 50 (1): 9- 17.
	WANG S J, LIU J, ZHENG F, et al. A survey of spectral clustering in machine learning[J]. Computer Science, 2023, 50 (1): 9- 17.

功能	界面	内容
应答器设置		应答器按钮处于on状态时，可以打开定位
雷达设置		定位开启状态，可以探测到红蓝情况
姿态感知地图		态势感知地图，查看战场态势情况
红蓝识别系统		红蓝识别系统，查看红蓝战斗情况
飞行计划设置		在态势感知地图打开时，可以查看蓝方详细飞行计划
作战计划设置		红蓝识别系统打开时，可以查看蓝方详细作战计划
警告		阶段战斗结束后，失去蓝方无人机联系，出现警告
蓝方情况查看		查看蓝方丢失无人机信号，判断战场信息

交互系统	名称	控制图标
触摸控制	点击
语音控制	语音
触控手势	左、右滑动

功能名称	任务	控制图标	操作方式
应答器设置	打开雷达		“打开应答器”，随后选择手势打开屏幕
雷达设置定位	打开雷达		“打开定位”，随后选择手势打开屏幕
态势感知地图	打开态势感知地图		触控点击
红蓝识别系统	打开红蓝识别系统		触控点击
飞行计划	查看蓝方有人无人机飞行计划	+	“某号无人机飞行计划”或者触控点击
作战计划	查看蓝方有人无人机作战计划	+	“某号无人机作战计划”或者触控点击
警告	阶段作战任务结束查看蓝方情况		“查看蓝方情况”
查看蓝方情况	阶段作战任务结束查看蓝方情况		“查看蓝方情况”

AOI名称	标识
功能栏	CS
雷达图	RM
前景	FV
态势感知地图	SA
红蓝识别系统	IFF
仪表状态	IS
飞行计划	FP
作战计划	OP
无人机状态	US
警告	WR

[1]	胡崇爽, 王纪凯, 李明浩, 豆亚杰, 姜江. 基于IVSFS的作战威胁人机协同评估框架[J]. 系统工程与电子技术, 2025, 47(6): 1855-1866.
[2]	熊威, 张栋, 任智, 杨书恒. 面向有人/无人机协同打击的智能决策方法研究[J]. 系统工程与电子技术, 2025, 47(4): 1285-1299.
[3]	尹中杰, 侯博, 靳啸龙, 范志良, 王海洋. 面向阵列天线抗干扰无人机的隐蔽诱骗方法[J]. 系统工程与电子技术, 2025, 47(2): 633-640.
[4]	刘瑶, 夏阳升, 石建迈, 陈超, 黄金才. 车载多无人机协同多区域覆盖路径规划方法[J]. 系统工程与电子技术, 2023, 45(5): 1380-1390.
[5]	李洪瑶, 李小强, 韩心中, 谢学立, 席建祥. 基于决策融合的多无人机协同目标检测识别算法[J]. 系统工程与电子技术, 2022, 44(3): 746-754.