Journal of Systems Engineering and Electronics ›› 2012, Vol. 34 ›› Issue (1): 97-101.doi: 10.3969/j.issn.1001-506X.2012.01.18

• 系统工程 • 上一篇    下一篇

基于RBF神经网络的Q学习飞行器

徐安, 寇英信, 于雷, 李战武   

  1. 空军工程大学工程学院, 陕西 西安 710038
  • 出版日期:2012-01-13 发布日期:2010-01-03

Stealthy engagement maneuvering strategy with Q-learning based on  RBFNN for air vehicles

XU An, KOU Yingxin, YU Lei, LI Zhanwu   

  1. Engineering College, Air Force Engineering University, Xi’an 710038, China
  • Online:2012-01-13 Published:2010-01-03

摘要:

基于马尔科夫决策过程框架研究了三维空间内隐蔽接敌策略的强化学习方法,定义了环境模型中的优势区域和暴露区域。针对高维状态空间策略学习所面临的维数灾问题,给出基于径向基神经网络(radial basis function neural network, RBFNN)的Q学习算法,说明了训练样本的分级采样方法,并针对不同情况下的接敌机动策略学习进行了仿真分析。仿真结果表明,借助于合理的分级采样方法,基于RBFNN的Q学习算法能有效生成隐蔽接敌策略。

Abstract:

Based on the Markov decision process theory, a reinforcement learning method for stealthy engagement strategy for air vehicles in 3D space is proposed. The advantage region and the exposure region for the environment modeling are established. In order to overcome the dimensional disaster problem, a Q-learning algorithm based on the radial basis function neural network (RBFNN) is put forward and a ranked sampling method is explained. Then simulations for two different situations are carried out,and the results show that the proposed algorithm is effective for the stealthy engagement strategy through reasonable ranked sampling methods.