基于Faster R-CNN的航母舰面多尺度目标检测算法

doi:10.12305/j.issn.1001-506X.2022.01.06

Abstract

Abstract:

Aiming at the complex multi-scale object detection environment on the aircraft carrier surface, and the poor performance of existing algorithms for small objects such as tractors and personnel, an improved faster region convolutional neural netuorks(Faster R-CNN) aircraft carrier surface multi-scale object detection algorithm is proposed. Based on the multi-scale feature layer, the region proposal network of different scales is extracted, which improves the detection performance of the algorithm for objects of different scales, especially small objects. Based on the K-means clustering algorithm, a prior box suitable for the aircraft carrier surface object dataset is generated, which further improves the performance of the algorithm. Experiments show that the proposed algorithm effectively improves the detection performance for different scales of objects, especially the detection effect of small objects, and conducts ablation experiments on the improved algorithm. Finally, the performance of different algorithms is compared, which shows that the detection accuracy of the proposed algorithm achieveds the optimal level.

Key words: object detection, multi-scale feature layer, K-means clustering, aircraft carrier surface

CLC Number:

TP391.41

Jiali FAN, Shaobing TIAN, Kui HUANG, Xingdong ZHU. Multi-scale object detection algorithm for aircraft carrier surface based on Faster R-CNN[J]. Systems Engineering and Electronics, 2022, 44(1): 40-46.

Figures/Tables 10

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Table 1

Table 2

Fig.6

Table 3

Table 4

References 30

1	苏建华, 薛栋娥, 刘传凯, 等. HOG内嵌模板匹配的车门夹人检测算法[J]. 北京交通大学学报, 2019, 43 (2): 64- 71. doi: 10.11860/j.issn.1673-0291.20180079
	SU J H , XUE D E , LIU C K , et al. An algorithm for detecting train door persons based on HOG inline template matching[J]. Journal of Beijing Jiaotong University, 2019, 43 (2): 64- 71. doi: 10.11860/j.issn.1673-0291.20180079
2	郭小兵. 基于贝叶斯网络的目标综合识别方法研究[D]. 长沙: 国防科技大学, 2004.
	GUO X B. A research on the algorithms of target identification fusion with Bayesian networks[D]. Changsha: National University of Defense Technology, 2004.
3	黄洁, 张海. 利用支持向量机的飞机目标检测[J]. 电光与控制, 2008, 15 (9): 6- 9. doi: 10.3969/j.issn.1671-637X.2008.09.002
	HUANG J , ZHANG H . Plane detection based on support vector machine and information fusion[J]. Electronics Optics and Control, 2008, 15 (9): 6- 9. doi: 10.3969/j.issn.1671-637X.2008.09.002
4	HE K M , ZHANG X Y , REN S Q , et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2015, 37 (9): 1904- 1916. doi: 10.1109/TPAMI.2015.2389824
5	GIRSHICK R. Fast R-CNN[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2015: 1440-1448.
6	REN S , HE K , GIRSHICK R , et al. Faster R-CNN: towards realtime object detection with region proposal network[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2017, 39 (6): 1137- 1149. doi: 10.1109/TPAMI.2016.2577031
7	REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once unified real-time object detection[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 779-788.
8	REDMON J, FARHADI A. YOLO 9000 better, faster, stronger[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2017: 6517-6525.
9	REDMON J, FARHADI A. YOLO v3 an incremental improvement[EB/OL]. [2018-04-08]. https//arxiv.org/abs/1804.02767.
10	LIU W, ANGUELOY D, ERHAN D, et al. SSD: single shot multibox detector[C]//Proc. of the European Conference on Computer Vision, 2016: 21-37.
11	李晓光, 付陈平, 李晓莉, 等. 面向多尺度目标检测的改进Faster R-CNN算法[J]. 计算机辅助设计与图形学学报, 2019, 31 (7): 1195- 1101.
	LI X G , FU C P , LI X L , et al. Improved Faster R-CNN for multi-scale object detection[J]. Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (7): 1195- 1101.
12	孙皓泽, 常天庆, 王全东, 等. 一种基于分层多尺度卷积特征提取的坦克装甲目标图像检测方法[J]. 兵工学报, 2017, 38 (9): 1681- 1691. doi: 10.3969/j.issn.1000-1093.2017.09.003
	SUN H Z , CHANG T Q , WANG Q D , et al. Image detection method for tank and armored targets based on hierarchical multi-scale convolution feature extraction[J]. Acta Armamentarii, 2017, 38 (9): 1681- 1691. doi: 10.3969/j.issn.1000-1093.2017.09.003
13	黄凤荣, 李杨, 郭兰申, 等. 基于Faster R-CNN的零件表面缺陷检测方法[J]. 计算机辅助设计与图形学学报, 2020, 32 (6): 883- 893.
	HUANG F R , LI Y , GUO L S , et al. Method for detection surface defects of engine parts based on faster R-CNN[J]. Journal of Computer-Aided Design and Computer Graphics, 2020, 32 (6): 883- 893.
14	曹旭, 邹焕新, 成飞, 等. 基于RHTC网络的飞机目标检测与精细识别[J]. 系统工程与电子技术, 2021, 43 (12): 3439- 3451.
	CAO X , ZOU H X , CHENG F , et al. Aircraft target detection and fine-grained recognition based on RHTC network[J]. Systems Engineering and Electronics, 2021, 43 (12): 3439- 3451.
15	孙嘉赤, 邹焕新, 邓志鹏, 等. 基于级联卷积神经网络的港口多方向舰船检测与分类[J]. 系统工程与电子技术, 2020, 42 (9): 1903- 1910.
	SUN J C , ZOU H X , DENG Z P , et al. Oriented inshore ship detection and classification based on cascade RCNN[J]. Systems Engineering and Electronics, 2020, 42 (9): 1903- 1910.
16	LI Y , FU K , SUN H , et al. An aircraft detection framework based on reinforcement learning and convolutional neural networks inremote sensing images[J]. Remote Sensing, 2018, 10 (2): 243. doi: 10.3390/rs10020243
17	CAI Z W , VASCONCELOS N . Cascade R-CNN: high quality target detection and instance segmentation[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2021, 43 (5): 1483- 1498. doi: 10.1109/TPAMI.2019.2956516
18	NAJIBI M, RASTEGARI M, DAVIS L S. G-CNN: an iterative grid based object detector[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 2369-2377.
19	SHRIVASTAVA A, GUPTA A, GIRSHICK R. Training region-based object detectors with online hard example mining[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 761-769.
20	朱兴动, 田少兵, 黄葵, 等. 基于深度卷积神经网络的舰载机目标检测[J]. 计算机应用, 2020, 40 (5): 1529- 1533.
	ZHU X D , TIAN S B , HUANG K , et al. Target detection of carrier-based aircraft based on deep convolutional neural network[J]. Journal of Computer Applications, 2020, 40 (5): 1529- 1533.
21	YANG F, CHOI W, LIN Y Q. Exploit all the layers: fast and accurate CNN object detector with scale dependent pooling and cascaded rejection classifers[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 2129-2137.
22	KONG T, YAO A B, CHEN Y R. HyperNet: towards accurate region proposal generation and joint object detection[C]//Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 845-853.
23	CAO C Q , WANG B . An improved faster R-CNN for small object detection[J]. IEEE Access, 2019, 7, 106838- 106846. doi: 10.1109/ACCESS.2019.2932731
24	GIRSHICK R . Region-based convolutional networks for accurate object detection and segmentation[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2015, 38 (1): 142- 158.
25	REN S Q , HE K M , GIRSHICK R , et al. Faster R-CNN: towards realtime object detection with region proposal networks[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2017, 39 (6): 1137- 1149. doi: 10.1109/TPAMI.2016.2577031
26	DAI J F, LI Y, HE K M. R-FCN: object detection via region-based fully convolutional networks[C]//Proc. of the Advances in Neural Information Processing Systems, 2016: 379-387.
27	周龙, 韦素媛. 基于深度学习的复杂背景雷达图像多目标检测[J]. 系统工程与电子技术, 2019, 41 (6): 1258- 1264.
	ZHOU L , WEI S Y . Multi-objective detection of complex background radar image based on deep learning[J]. Systems Engineering and Electronics, 2019, 41 (6): 1258- 1264.
28	王全东, 常天庆. 基于深度学习算法的坦克装甲目标自动检测与跟踪系统[J]. 系统工程与电子技术, 2018, 40 (9): 2143- 2156.
	WANG Q D , CHANG T Q . Automatic detection and tracking system of tank armored targets based on deep learning algorithm[J]. Systems Engineering and Electronics, 2018, 40 (9): 2143- 2156.
29	李广帅, 苏娟, 李义红. 基于改进Faster R-CNN的SAR图像飞机检测算法[J]. 北京航空航天大学学报, 2021, 47 (1): 159- 168.
	LI G S , SU J , LI Y H . An aircraft detection algorithm in SAR image based on improved Faster R-CNN[J]. Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (1): 159- 168.
30	张玉燕, 李永保. 基于Faster R-卷积神经网络的金属点阵结构缺陷识别方法[J]. 兵工学报, 2019, 40 (11): 2329- 2335. doi: 10.3969/j.issn.1000-1093.2019.11.018
	ZHANG Y Y , LI Y B . Internal detection of metal three-dimensional multi-layer lattice structure based on Faster R-CNN[J]. Acta Armamentarii, 2019, 40 (11): 2329- 2335. doi: 10.3969/j.issn.1000-1093.2019.11.018

舰载机	直升机1	直升机2	牵引车	人员
3 236	3 125	3 058	3 241	3 310

算法	AP/%					mAP/%	Fps(frame·s^-1)
算法	舰载机	直升机1	直升机2	牵引车	人员	mAP/%	Fps(frame·s^-1)
改进前	95.6	91.7	90.3	85.6	81.4	88.97	9
改进后	97.3	94.8	94.6	92.1	88.5	93.46	8

方案	AP					mAP
方案	舰载机	直升机1	直升机2	牵引车	人员	mAP
a	95.6	91.7	90.3	85.6	81.4	88.97
b	96.4	92.9	93.1	90.8	87.9	92.22
c	97.0	93.6	93.0	90.3	87.7	92.32
d	97.3	94.8	94.6	92.1	88.5	93.46

算法	mAP/%	Fps/(frame·s^-1)
YOLO v3	83.64	22
SSD	81.90	20
本文	93.46	8

[1]	Shuang SONG, Yue ZHANG, Linna ZHANG, Yigang CEN, Yidong LI. Lightweight target detection algorithm based on deep learning [J]. Systems Engineering and Electronics, 2022, 44(9): 2716-2725.
[2]	Hongyao LI, Xiaoqiang LI, Xinzhong HAN, Xueli XIE, Jianxiang XI. Cooperative object detection and recognition algorithm for multiple UAVs based on decision fusion [J]. Systems Engineering and Electronics, 2022, 44(3): 746-754.
[3]	Yue LYU, Aiwu YANG, Zhanwu LI, Zhifei XI. Research on the construction method of air combat decision knowledge [J]. Systems Engineering and Electronics, 2021, 43(7): 1866-1874.
[4]	Yiming ZHANG, Jianliang AI. Positioning of aerial refueling drogue and docking control based on binocular vision [J]. Systems Engineering and Electronics, 2021, 43(10): 2940-2953.
[5]	Zhenzhen YANG, Jun LE, Yongpeng YANG, Lu FAN. Object detection algorithm of nonconvex motion-assisted low rank and sparse decomposition [J]. Systems Engineering and Electronics, 2020, 42(6): 1218-1225.
[6]	Juan SU, Long YANG, Hua HUANG, Guodong JIN. Improved SSD algorithm for small-sized SAR ship detection [J]. Systems Engineering and Electronics, 2020, 42(5): 1026-1034.
[7]	ZHANG Yixiao, GUO Wenpu, KANG kai, YAO Yunlong, ZHANG Linke, ZHANG Wei. Radar signal sorting method based on data field combined PRI transform and clustering [J]. Systems Engineering and Electronics, 2019, 41(7): 1509-1515.
[8]	ZHOU Long, WEI Suyuan, CUI Zhongma, FANG Jiaqi, YANG Xiaoting, YANG Long. Multiobjective detection of complex background radar imagebased on deep learning [J]. Systems Engineering and Electronics, 2019, 41(6): 1258-1264.
[9]	GUO Shao-jun, SHEN Tong-sheng, XU Jian, MA Xin-xing. Detection of multi-ship targets at sea based on ObjectNess BING [J]. Systems Engineering and Electronics, 2016, 38(1): 14-20.
[10]	ZHOU Jun-jing, DUAN Jian-min. Moving object detection for intelligent vehicles based on occupancy grid map [J]. Systems Engineering and Electronics, 2015, 37(2): 436-442.
[11]	DI Xiao-guang, FENG Xiao-dan, Fu Shao-wen. Moving object detection in non-planar scenes based on improved gradient suppression [J]. Systems Engineering and Electronics, 2014, 36(6): 1021-1026.
[12]	FU Wei-hong， MA Li-fen， LI Ai-li. Blind estimation of underdetermined mixing matrix based on improved K-means clustering [J]. Systems Engineering and Electronics, 2014, 36(11): 2143-2148.
[13]	LI Meng, WANG Dao-bo, SHENG Shou-zhao, SHEN Zi-ran. Multiple route planning based on particle swarm optimization and weighted k-means clustering [J]. Journal of Systems Engineering and Electronics, 2012, 34(3): 512-516.
[14]	HU Li-ping，YIN Hong-cheng，CHEN Bo，ZHOU Ping. Improved kernel clusteringbased discriminant analysis [J]. Journal of Systems Engineering and Electronics, 2011, 33(5): 1176-.
[15]	LIU Ying-xia, CHANG Fa-liang. Detection algorithm for moving objects based on Bayesian rules and optimized level projection [J]. Journal of Systems Engineering and Electronics, 2011, 33(4): 933-937.

Multi-scale object detection algorithm for aircraft carrier surface based on Faster R-CNN

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 30

Related Articles 15

Recommended Articles

Metrics

Comments