导弹武器模拟训练考评系统设计

doi:10.3969/j.issn.1001-506X.2020.04.15

Abstract

Abstract:

To improve the objectivity and accuracy of the evaluation in a missile simulation training system, an evaluation index system is established, which is mainly based on the accuracy, proficiency and operator states. An appropriate mathematical model is built to calculate the sub-index scores, and the sub-indexes are quantified, so as to solve the shortcomings of strong subjectivity and inconsistent standards in the evaluation by examiners. By using the expert system, the professional knowledge and evaluation rules needed in the evaluation process are stored, and the scoring process is automated. As for the shortcomings of the analytic hierarchy process (AHP) algorithm that requires multiple assignments to ensure consistency and group eigenvalue method (GEM) algorithm's fuzzy structure, a weight setting scheme based on the AHP and GEM fusion algorithm is proposed, and the APH-GEM algorithm is used to carry out weighted evaluation of sub-index scores, then forming a reasonable and effective simulation training evaluation system. Finally, by comparing with the examiners'manual grading method, the rationality and accuracy of the designed grading system are shown.

Key words: evaluation system, evaluation index system, analytic hierarchy process-group eigenvalue method (APH-GEM) algorithm, expert system

CLC Number:

TP273.5

Liangliang HAO, Jinsheng ZHANG, Ting LI, Xiaoyu MA. Design of evaluation system for missile simulation training[J]. Systems Engineering and Electronics, 2020, 42(4): 843-850.

Figures/Tables 10

Table 1

Fig.1

Table 2

Fig.2

Fig.3

Table 3

Table 4

Fig.4

Table 5

Table 6

References 31

1	薛昭, 杜晓明, 裴国旭. 军事训练评估研究综述[J]. 飞航导弹, 2017, 2, 55- 59.
	XUE Z , DU X M , PEI G X . Review of military training evaluation research[J]. Air missile, 2017, 2, 55- 59.
2	COSMAD , STANIC M P . Implementing a software modeling-simulation in military training[J]. Land Forces Academy Review, 2011, 16 (2): 204- 210.
3	NIE W, WU Y.Study of automatic scoring system for simulation training[C]//Proc.of the 3rd International Conference on Advanced Computer Theory and Engineering, 2010: 403-407.
4	FANG S Y . Application and development of substation training simulation system[J]. High Voltage Engineering, 2005, 4, 78- 81.
5	CLAUSER B E , CLYMAN H S G . The generalizability of scores for a performance assessment scored with a computer-automated scoring system[J]. Journal of Educational Measurement, 2000, 37 (3): 245- 262.
6	LI K, LI Y, JIANG H X.Design on interface circuit of simulation training evaluation subsystem for an antiaircraft missile hardware-in-loop simulator[C]//Proc.of the 2nd Information Technology and Mechatronics Engineering Conference, 2016: 439-442.
7	陆超.船舶电站训练评估系统的设计与实现[D].大连:大连海事大学, 2005.
	LU C.Design and implementation of training and evaluation system for ship power station[D]. Dalian: Dalian Maritime University, 2005.
8	潘建峰.船舶动力电力训练系统操作水平综合评估算法研究[D].大连:大连海事大学, 2015.
	PAN J F.Research on comprehensive evaluation algorithm of operation level of ship power electric training system[D]. Dalian: Dalian Maritime University, 2015.
9	卢皓, 刘全胜, 绍思杰, 等. 某新型坦克武器系统训练模拟器使用成绩评定方法[J]. 四川兵工学报, 2011, 32 (10): 122- 124, 136.
	LYU H , LIU Q S , SHAO S J , et al. Evaluation method of using performance of a new tank weapon system training simulator[J]. Journal of Sichuan Military Engineering, 2011, 32 (10): 122- 124, 136.
10	王钦钊, 郭傲兵, 李小龙, 等. 基于AHP的装甲模拟训练成绩评估方法[J]. 计算机仿真, 2015, 32 (10): 458- 461.
	WANG Q Z , GUO A B , LI X L , et al. Evaluation method of armor simulation training performance based on AHP[J]. Computer Simulation, 2015, 32 (10): 458- 461.
11	侯玉, 夏立, 张朝亮. 船舶电力系统模拟训练评估算法[J]. 海军工程大学学报, 2015, 39 (1): 103- 107.
	HOU Y , XIA L , ZHANG C L . Simulation training evaluation algorithm of ship power system[J]. Journal of Naval Engineering University, 2015, 39 (1): 103- 107.
12	陈玲, 王晓晖, 康隽睿, 等. 导弹射手训练综合评估方法设计与研究[J]. 弹箭与制导学报, 2014, 34 (5): 55- 58.
	CHEN L , WANG X H , KANG J R , et al. Design and research on comprehensive evaluation method of missile shooter training[J]. Journal of Missile and Guidance, 2014, 34 (5): 55- 58.
13	靳树昌, 胡俊. 某型武器通信系统故障诊断模拟训练考核评估系统设计[J]. 舰船电子工程, 2015, 35 (5): 80- 83.
	JIN S C , HU J . Design of simulation training assessment system for fault diagnosis of a weapon communication system[J]. Naval Electronic Engineering, 2015, 35 (5): 80- 83.
14	张锦, 任长合, 聂伟. 船艇机电模拟训练考核评估系统[J]. 军事交通学院学报, 2016, 18 (12): 85- 88.
	ZHANG J , REN C H , NIE W . Ship electrome-chanical simulation training assessment system[J]. Journal of Military Transportation College, 2016, 18 (12): 85- 88.
15	CLAUSER B E , HARIK P , CLYMAN S G . The generaliz-ability of scores for a performance assessment scored with a computer-automated scoring system[J]. Journal of Educational Measurement, 2000, 37 (3): 245- 261.
16	曹汉卿, 聂伟. 基于专家系统的轮机模拟器自动评分系统研究[J]. 船电技术, 2013, 33 (2): 37- 39.
	CAO H Q , NIE W . Research on automatic scoring system of marine simulator based on expert system[J]. Ship Electric Technology, 2013, 33 (2): 37- 39.
17	陈萱华, 杨玲. 面向仿真系统的自动测评关键技术研究[J]. 计算机与现代化, 2012, 11, 59- 61, 65.
	CHEN X H , YANG L . Research on key technologies of automatic evaluation for simulation system[J]. Computer and Modernization, 2012, 11, 59- 61, 65.
18	乔程程, 楚纪正. 基于模糊专家系统的操作评价方法[J]. 计算机与现代化, 2013, 10, 164- 167.
	QIAO C C , CHU J Z . Operation evaluation method based on fuzzy expert system[J]. Computer and modernization, 2013, 10, 164- 167.
19	郭培, 高俊雄, 王耘波. 基于序列匹配的自动评分算法设计[J]. 计算机应用, 2011, 31 (z2): 78- 80.
	GUO P , GAO J X , WANG Y B . Design of automatic scoring algorithm based on sequence matching[J]. Computer Application, 2011, 31 (z2): 78- 80.
20	肖剑波, 胡大斌, 胡锦晖, 等. 考核评估系统研究综述[J]. 舰船电子工程, 2016, 36 (1): 15- 19.
	XIAO J B , HU D B , HU J H , et al. Review of assessment system research[J]. Naval Electronic Engineering, 2016, 36 (1): 15- 19.
21	李登凤, 董雷, 高峰, 等. 一种新型的电力仿真培训智能评价指导系统[J]. 电网技术, 2006, 10 (30): 261- 263.
	LI D F , DONG L , GAO F , et al. A new intelligent evaluation guidance system for power simulation training[J]. Power Grid Technology, 2006, 10 (30): 261- 263.
22	董秀臣, 俎金花. 模拟器操作评分系统[J]. 核动力工程, 2005, 26 (6): 645- 647.
	DONG X C , ZU J H . Simulator operation scoring system[J]. Nuclear Power Engineering, 2005, 26 (6): 645- 647.
23	谭麒瑞, 魏思东, 刘承相. 空中机械师模拟训练评估系统研究[J]. 装备制造技术, 2010, 5, 36- 37.
	TAN Q R , WEI S D , LIU C X . Research on simulation training and evaluation system of air mechanic[J]. Equipment Manufacturing Technology, 2010, 5, 36- 37.
24	KUMAR A , CHOI S K , GOKSEL L . Tolerance allocation of assemblies using fuzzy comprehensive evaluation and decision support process[J]. The International Journal of Advanced Manufacturing Technology, 2011, 55 (1/4): 379- 391.
25	ZHANG H , HE X Q , MITRI H . Fuzzy comprehensive evaluation of virtual reality mine safety training system[J]. Safety Science, 2019, 120, 341- 351.
26	LAININEN P , HÄMÄLÄINEN R P . Analyzing AHP-matrices by regression[J]. European Journal of Operational Research, 2003, 148 (3): 514- 524.
27	SHAHROKH N , ZSEF J M . Evaluation of mobile services and substantial adoption factors with analytic hierarchy process[J]. Telecommunications Policy, 2013, 37 (10): 915- 929.
28	TAKEDA M . A practical research on training system development and skill evaluation by AHP for training student facilitators[J]. Educational Information Research, 2017, 33 (2): 3- 16.
29	王淼, 余隋怀, 杨延璞. 基于AHP-GEM模糊分析的飞机驾驶舱人机界面评价[J]. 机械设计, 2017, 34 (2): 105- 109.
	WANG M , YU S H , YANG Y P . Human machine interface evaluation of aircraft cockpit based on AHP-GEM fuzzy analysis[J]. Mechanical Design, 2017, 34 (2): 105- 109.
30	LI R Z, SHI Y, DING F.Assessment on fishery eco-environment in Chaohu lake using GEM-AHP method[C]//Proc.of the 2nd International Conference on Asian-European Environmental Technology and Knowledge Transfer, 2008: 103-108.
31	唐业喜, 卓琦, 朱深海. 张家界大鲵产业集群竞争力测度的AHP-GEMS模型[J]. 吉首大学学报(自然科学版), 2019, 40 (3): 73- 78.
	TANG Y X , ZHUO Q , ZHU S H . AHP-GEMS model for measuring the competitiveness of Zhangjiajie giant salamander industrial cluster[J]. Journal of Jishou University (Natural Science Edition), 2019, 40 (3): 73- 78.

总指标	子层次	底层指标
成绩A	准确性A₁	流程选择A₁₁
		流程执行顺序A₁₂
		操作步骤A₁₃
		故障处置A₁₄
	熟练度A₂	操作步骤A₂₁
		故障处置A₂₂
		团队合作A₂₃
	操作人员状态A₃	临时科目处置能力A₃₁
	操作人员状态A₃	训练精神状态A₃₂

时间差值(T_r-T_s)/s	t₁	t₂	t₃	t₄	t₅
得分S_p	100	90	70	30	0

目标	专家1	专家2	…	专家n
因素1	x₁₁	x₁₂	…	x_1n
因素2	x₂₁	x₂₂	…	x_2n
			$ \ddots $
因素n	x_n1	x_n2	…	x_nn

项目名称	准确性				熟练度			操作人员状态
项目名称	流程选择A₁₁	流程执行顺序A₁₂	操作步骤A₁₃	故障处置A₁₄	操作步骤A₂₁	故障处置A₂₂	团队合作A₂₃	临时科目处置A₃₁	训练精神状态A₃₂
相对权重	0.097	0.075	0.177	0.177	0.164	0.163	0.055	0.064	0.028

操作人员序号	第1组				第2组
操作人员序号	1	2	3	4	1	2	3	4
自动评判系统	97.326	96.614	97.954	96.422	91.035	94.926	95.146	95.038
人工评判	96	95	97	94	83	89	88	89

Design of evaluation system for missile simulation training

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 31

Related Articles 5

Recommended Articles

Metrics

Comments

操作人员		第1组				第2组
操作人员		1	2	3	4	4	1	2	3
准确性A₁	流程选择A₁₁	100	100	100	100	100	100	100	100
	流程执行顺序A₁₂	100	100	100	100	100	100	100	100
	操作步骤A₁₃	100	100	100	100	89	100	100	100
	故障处置A₁₄	100	100	100	100	100	100	100	100
熟练度A₂	操作步骤A₂₁	94	90	98	89	78	89	90	89
	故障处置A₂₂	92	92	92	92	83	83	83	83
	团队合作A₂₃	94	94	94	94	95	95	95	95
操作人员状态A₃	临时科目处置能力A₃₁	100	100	100	100	100	100	100	100
操作人员状态A₃	训练精神状态A₃₂	98	96	97	95	87	92	94	96

[1]	Mulai TAN, Dali DING, Lei XIE, Wei DING, Chenghui LYU. UCAV escape maneuvering decision based on fuzzy expert system and IDE algorithm [J]. Systems Engineering and Electronics, 2022, 44(6): 1984-1993.
[2]	Wei ZHANG, Jing HE, Xiaowei XIE, Guoqiang ZHAO, Zhen CHEN. Design and implementation of simulation evaluation system for joint battlefield navigation countermeasure [J]. Systems Engineering and Electronics, 2022, 44(10): 3182-3189.
[3]	Xinmin GUO, Zhen YANG, Kejun YANG, Jianlong ZHANG, Ye WANG. Embedded testing technology of infrared guidance device in the storage tank based on compound eyes array [J]. Systems Engineering and Electronics, 2020, 42(8): 1668-1672.
[4]	Zhihai YAO, Jianping LIU, Jianping WANG, Wei LI, Bo REN. Evaluation index system of ground-based TT&C resource scheduling [J]. Systems Engineering and Electronics, 2020, 42(8): 1751-1758.
[5]	LI Hong-fei， JIN Hong-bin， TIAN Kang-sheng. Combination rule evaluation system based on hybrid DSm model [J]. Journal of Systems Engineering and Electronics, 2013, 35(3): 564-568.