基于人机协同作战多通道交互系统的隐性知识挖掘

doi:10.12305/j.issn.1001-506X.2025.10.18

Abstract

Abstract:

In the context of human-machine cooperative combat, a method for tacit knowledge mining is proposed aiming at optimizing interaction design problem through multi-channel interactive association tacit knowledge. Firstly, the operational process of typical human-machine cooperative combat tasks is analyzed, and a multi-channel interactive system of human-machine is designed by integrating multiple interaction channels such as vision, speech, and gestures. Secondly, based on the proposed system, a behavioral-cognitive graph model is constructed to analyze the association between key nodes in the cooperative task process. And eye-tracking data is employed to quantitatively assess the operator interactive behavior. Finally, physical quantities from graph theory are introduced to explicitly describe the tacit knowledge, demonstrating that the proposed method effectively integrates perceptual information. The proposed method provides a valuable reference for optimizing human-machine interactive patterns in multi-channel systems.

Key words: human-machine cooperative, multi-channel interaction, tacit knowledge, eye-tracking

CLC Number:

Mingjun WANG, Xiaoli WU, Biao YAN, Xinyue ZHANG, Yuhan WU. Tacit knowledge mining based on multi-channel interactive system of human-machine cooperative combat[J]. Systems Engineering and Electronics, 2025, 47(10): 3313-3324.

Figures/Tables 22

Fig.1

Fig.2

Fig.3

Fig.4

Table 1

Table 2

Table 3

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Table 4

Fig.10

Fig.11

Fig.12

Fig.13

Fig.14

Fig.15

Fig.16

Fig.17

Fig.18

References 30

1	李隆, 许瑛, 岳源, 等. 有人/无人机协同作战指挥界面设计[J]. 火力与指挥控制, 2016, 41 (5): 130- 133.
	LI L, XU Y, YUE Y, et al. Design of human-UAV cooperative combat command interface[J]. Fire Control & Command Control, 2016, 41 (5): 130- 133.
2	史文卿, 王海峰, 陈海昕. 战斗机无人机编组协同系统需求捕获与验证[J]. 系统工程与电子技术, 2023, 45 (1): 108- 118.
	SHI W Q, WANG H F, CHEN H X. Demand capture and verification of fighter-UAV formation cooperative system[J]. Systems Engineering and Electronics, 2023, 45 (1): 108- 118.
3	樊皓, 陈东, 姜家财, 等. 机载传感器管理中信息引导雷达搜索空域研究[J]. 电光与控制, 2021, 28 (2): 65- 68.
	FAN H, CHEN D, JIANG J C, et al. Research on information-guided radar search airspace in airborne sensor management[J]. Electronics Optics & Control, 2021, 28 (2): 65- 68.
4	HECHT D, REINER M, HALEVY G. Multimodal virtual environments: response times, attention, and presence[J]. Presence: Teleoperators and Virtual Environments, 2006, 15 (5): 515- 523. doi: 10.1162/pres.15.5.515
5	CHEN Y, LI X L, LOU Z Y, et al. Research on the UAV multi-channel human-machine interaction system[C]//Proc. of the 2nd Asia-Pacific Conference on Intelligent Robot Systems, 2017: 190−195.
6	SOO J K T, TAN A L S, HO A S Y. Naturalistic human-robot interaction design for control of unmanned ground vehicles[J]. Communications in Computer and Information Science, 2016, 618, 535- 540.
7	WANG L, GAO R, VÁNCZA J, et al. Symbiotic human-robot collaborative assembly[J]. CIRP Annals, 2019, 68 (2): 701- 726. doi: 10.1016/j.cirp.2019.05.002
8	REN J, CUI Y Y, CHEN J, et al. Multi-modal human-computer interaction system in cockpit[J]. Journal of Physics: Conference Series, 2020, 1693 (1): 012212. doi: 10.1088/1742-6596/1693/1/012212
9	郑哲, 崔颢, 田潮军. 基于空空导弹虚拟样机的虚拟靶试仿真系统设计[J]. 火力与指挥控制, 2014, 39 (6): 139- 142.
	ZHENG Z, CUI H, TIAN C J. Design of virtual test simulation system based on air-to-air missile virtual prototype[J]. Fire Control & Command Control, 2014, 39 (6): 139- 142.
10	杨茜. 基于DODAF作战视图的空地协同作战模型设计[J]. 火力与指挥控制, 2023, 48 (7): 120- 126.
	YANG X. Design of air-ground cooperative combat model based on DODAF operational view[J]. Fire Control & Command Control, 2023, 48 (7): 120- 126.
11	闫飞, 甘斌, 陈招迪, 等. 离散事件仿真中实体被动式空间感知交互机制设计[J]. 系统仿真学报, 2021, 33 (9): 2234- 2242.
	YAN F, GAN B, CHEN Z D, et al. Design of passive spatial perception interaction mechanism for entities in discrete event simulation[J]. Journal of System Simulation, 2021, 33 (9): 2234- 2242.
12	WANG X Y, XUE Y B, YIN R, et al. Meta-battlefield: concept design of multi-domain man-machine cooperative operation[C]//Proc. of the China Conference on Command and Control, 2023: 638−649.
13	蒋光毅, 陈桦, 王长元, 等. EEG、视觉注视融合的MHA-LSTM神经网络飞行员注意力分析研究[J]. 西安工业大学学报, 2023, 43 (1): 48- 55.
	JIANG G Y, CHEN H, WANG C Y, et al. Research on pilot attention analysis using EEG and visual gaze fusion based on MHA-LSTM neural network[J]. Journal of Xi’an Technological University, 2023, 43 (1): 48- 55.
14	王思瑞, 王长元, 蒋光毅. 基于视觉注视信息的飞行员态势感知状态评估[J]. 国外电子测量技术, 2023, 42 (12): 160- 168.
	WANG S R, WANG C Y, JIANG G Y. Situation awareness state assessment of pilots based on visual gaze information[J]. Foreign Electronic Measurement Technology, 2023, 42 (12): 160- 168.
15	LOUNIS C, PEYSAKHOVICH V, CAUSSE M. Visual scanning strategies in the cockpit are modulated by pilots’ expertise: a flight simulator study[J]. PLoS One, 2021, 16 (2): e0247061. doi: 10.1371/journal.pone.0247061
16	LIU B, MA G, JIANG H, et al. The construction and practice of tacit knowledge externalization in aerospace enterprises[C]//Proc. of the 5th International Conference on Electromechanical Control Technology and Transportation, 2020: 172−174.
17	唐传林, 黄长强, 丁达理, 等. 一种UCAV自主空战智能战术决策方法[J]. 指挥控制与仿真, 2015, 37 (5): 5- 11.
	TANG C L, HUANG C Q, DING D L, et al. An intelligent tactical decision-making method for UCAV autonomous air combat[J]. Command Control & Simulation, 2015, 37 (5): 5- 11.
18	CRUESS R L, CRUESS S R, BOUDREAU J D, et al. Reframing medical education to support professional identity formation[J]. Academic Medicine, 2014, 89 (11): 1446- 1451. doi: 10.1097/ACM.0000000000000427
19	THEOBALD S, BRANDES N, GYAPONG M, et al. Implementation research: new imperatives and opportunities in global health[J]. The Lancet, 2018, 392 (10160): 2214- 2228. doi: 10.1016/S0140-6736(18)32205-0
20	王旋, 苟莉, 温贤秀. 护士隐性知识共享的研究进展[J]. 护理学杂志, 2023, 38 (7): 125- 128.
	WANG X, GOU L, WEN X X. Research progress on nurses’ tacit knowledge sharing[J]. Journal of Nursing Science, 2023, 38 (7): 125- 128.
21	KUCHARSKA W, ERICKSON G S. Tacit knowledge acquisition & sharing, and its influence on innovations: a Polish/US cross-country study[J]. International Journal of Information Management, 2023, 71, 102647. doi: 10.1016/j.ijinfomgt.2023.102647
22	TIINA S, KOIVUNEN T. Tacit knowledge in blue-collar work: how workers use it to fulfil their side of the psychological contract[J]. International Journal of Organizational Analysis, 2022, 30 (7): 173- 183. doi: 10.1108/IJOA-09-2021-2972
23	张建华, 温丹丹, 贺龙飞, 等. 面向隐性知识服务的组织元宇宙空间构建研究[J]. 情报杂志, 2023, 42 (11): 153- 160.
	ZHANG J H, WEN D D, HE L F, et al. Research on the construction of organizational metaverse space for tacit knowledge services[J]. Journal of Intelligence, 2023, 42 (11): 153- 160.
24	YU W W, JIN D, CAI W F, et al. Towards tacit knowledge mining within context: visual cognitive graph model and eye movement image interpretation[J]. Computer Methods and Programs in Biomedicine, 2022, 226, 107107. doi: 10.1016/j.cmpb.2022.107107
25	汪磊, 王朔, 高杉, 等. 面向特情的航线飞行员视觉注意分配研究[J]. 中国安全科学学报, 2023, 33 (1): 214- 220.
	WANG L, WANG S, GAO S, et al. Research on visual attention allocation of airline pilots for special situations[J]. China Safety Science Journal, 2023, 33 (1): 214- 220.
26	王晓芳, 郑艺裕, 林海. 导弹协同作战四维制导与控制一体化设计方法[J]. 系统工程与电子技术, 2015, 37 (4): 874- 881.
	WANG X F, ZHENG Y Y, LIN H. Integrated design method for four-dimensional guidance and control of missile cooperative combat[J]. Systems Engineering and Electronics, 2015, 37 (4): 874- 881.
27	杨楠. 座舱多功能显示器显示分配管理设计[J]. 航空电子技术, 2016, 47 (3): 13- 19.
	YANG N. Design of display allocation management for cockpit multifunction display[J]. Avionics Technology, 2016, 47 (3): 13- 19.
28	ZHAO R, WANG K, DIVEKAR R, et al. An immersive system with multi-modal human-computer interaction[C]//Proc. of the IEEE 13th International Conference on Automatic Face & Gesture Recognition, 2018: 517−524.
29	李昌岭, 李伟华. 面向战场的多通道人机交互模型[J]. 火力与指挥控制, 2014, 39 (11): 110- 114.
	LI C L, LI W H. Multi-channel human-computer interaction model for battlefield[J]. Fire Control & Command Control, 2014, 39 (11): 110- 114.
30	王少将, 刘佳, 郑锋, 等. 机器学习层谱聚类综述[J]. 计算机科学, 2023, 50 (1): 9- 17.
	WANG S J, LIU J, ZHENG F, et al. A survey of spectral clustering in machine learning[J]. Computer Science, 2023, 50 (1): 9- 17.

功能	界面	内容
应答器设置		应答器按钮处于on状态时，可以打开定位
雷达设置		定位开启状态，可以探测到红蓝情况
姿态感知地图		态势感知地图，查看战场态势情况
红蓝识别系统		红蓝识别系统，查看红蓝战斗情况
飞行计划设置		在态势感知地图打开时，可以查看蓝方详细飞行计划
作战计划设置		红蓝识别系统打开时，可以查看蓝方详细作战计划
警告		阶段战斗结束后，失去蓝方无人机联系，出现警告
蓝方情况查看		查看蓝方丢失无人机信号，判断战场信息

交互系统	名称	控制图标
触摸控制	点击
语音控制	语音
触控手势	左、右滑动

功能名称	任务	控制图标	操作方式
应答器设置	打开雷达		“打开应答器”，随后选择手势打开屏幕
雷达设置定位	打开雷达		“打开定位”，随后选择手势打开屏幕
态势感知地图	打开态势感知地图		触控点击
红蓝识别系统	打开红蓝识别系统		触控点击
飞行计划	查看蓝方有人无人机飞行计划	+	“某号无人机飞行计划”或者触控点击
作战计划	查看蓝方有人无人机作战计划	+	“某号无人机作战计划”或者触控点击
警告	阶段作战任务结束查看蓝方情况		“查看蓝方情况”
查看蓝方情况	阶段作战任务结束查看蓝方情况		“查看蓝方情况”

AOI名称	标识
功能栏	CS
雷达图	RM
前景	FV
态势感知地图	SA
红蓝识别系统	IFF
仪表状态	IS
飞行计划	FP
作战计划	OP
无人机状态	US
警告	WR

[1]	Yaozhong ZHANG, Zhuoran WU, Jiandong ZHANG, Qiming YANG, Guoqing SHI, Zixiang XU. UAV many-to-one pursuit-evasion game based on ME-DDPG algorithm [J]. Systems Engineering and Electronics, 2025, 47(10): 3288-3299.
[2]	Gaozhi ZHONG, Hongyi XU, Changbo HOU, Pengqi ZHAO, Haonan GUO. Enhanced hierarchical fusion algorithm based on adaptive maneuvering frequency [J]. Systems Engineering and Electronics, 2025, 47(10): 3155-3167.
[3]	An ZHANG, Xianchao MA, Qian TANG, Yuwen YAN, Wenhao BI. Method for solving release conditions of firefighting aircraft based on improved tabu search algorithm [J]. Systems Engineering and Electronics, 2025, 47(9): 2951-2959.
[4]	Xiaolong WEI, Yarong WU, Dengkai YAO, Guhao ZHAO. Hierarchical decision-making algorithm for UAV air combat maneuvering based on deep reinforcement learning [J]. Systems Engineering and Electronics, 2025, 47(9): 2993-3003.
[5]	Xinyue ZHANG, Xiaoli WU, Mingjun WANG, Biao YAN, Yuhan WU. Assessing optimal interaction for a cooperative operation interface of manned/unmanned aerial vehicle [J]. Systems Engineering and Electronics, 2025, 47(8): 2600-2611.
[6]	Zhao YANG, Jinbiao HU, Yan WANG, Hongbiao QI. UAV coverage path planning for mountain patrol considering different takeoff and landing nests [J]. Systems Engineering and Electronics, 2025, 47(8): 2622-2631.
[7]	Jikai WANG, Yajie DOU, Jing LI, Yijun DONG, Jiang JIANG, Yuejin TAN. Review on intelligent decision in the military system of systems engineering research [J]. Systems Engineering and Electronics, 2025, 47(8): 2581-2599.
[8]	Ju CHANG, Xiaodong LIU, Ying HE. Sensitivity analysis of missile equipment cost based on global sensitivity [J]. Systems Engineering and Electronics, 2025, 47(8): 2632-2638.
[9]	ZHANG Ruiwen, SONG Bifeng, PEI Yang, SHI Shuai. Evaluation method for operational effectiveness of aircraft interception based on ABMS#br# [J]. Systems Engineering and Electronics, 2018, 40(2): 322-329.
[10]	CHEN Nanyu, HUANG Jun, ZHOU Yaoming, ZHAO Wenlong. Trajectory robust tracking control of unmanned helicopter based on extended state observer [J]. Systems Engineering and Electronics, 2018, 40(2): 368-374.
[11]	WANG Chao, ZHANG Shengxiu, SONG Zibiao, YANG Jianye, WU Xiaolu. Aircraft anti-windup of robust adaptive nonlinear predictive control [J]. Systems Engineering and Electronics, 2018, 40(2): 393-400.
[12]	LIU Yi-nan,ZHANG Sheng-xiu,CAO Li-jia,ZHANG Chao. Nonlinear robust adaptive flight controller design based on LS-SVM [J]. Journal of Systems Engineering and Electronics, 2012, 34(12): 2541-2547.
[13]	CHENG Jian-feng,DONG Xin-min,CHEN Ai-hua,DONG Zhi. T-S model-based constraint guaranteed cost robust flight control law design [J]. Journal of Systems Engineering and Electronics, 2012, 34(12): 2548-2553.
[14]	CA Hong-ming, ANG Hai-song, DENG Shuang-hou. Adaptive inverse control for ducted fan micro air vehicle [J]. Journal of Systems Engineering and Electronics, 2012, 34(3): 568-571.
[15]	GAO Wei, ZHANG Xin, YU Fei, FENG Jin. Fast alignment method of SINS using measurement augmentation [J]. Journal of Systems Engineering and Electronics, 2011, 33(11): 2492-2495.

Tacit knowledge mining based on multi-channel interactive system of human-machine cooperative combat

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 22

References 30

Related Articles 15

Recommended Articles

Metrics

Comments