基于光电融合的目标三维结构反演

doi:10.12305/j.issn.1001-506X.2021.09.03

摘要/Abstract

摘要：

针对同传感器视角下的空天目标光电特征融合问题, 提出一种综合利用散射中心参数及轮廓角点特征的目标三维结构反演方法。首先, 基于正交匹配追踪(orthogonal matching pursuit, OMP)算法估计出序列雷达图像中的二维散射中心特征, 并利用Freeman链码提取连续可见光图像的角点特征。然后, 基于图论思想分别对雷达及可见光图像中的二维特征点进行关联。最后, 通过特征点三维重构来实现散射中心特征与光学角点特征之间的融合, 从而反演出较单源特征更为丰富准确的目标结构信息。仿真试验结果验证了所提方法的有效性。

关键词: 雷达图像, 可见光图像, 散射中心, 角点, 光电融合

Abstract:

Aiming at the problem of electro-optical feature fusion simultaneous interpreting the sky and sky targets from the same sensor angle, a three dimensional structure inversion method is proposed, which integrates the parameters of scattering centers and the features of contour points. Firstly, based on orthogonal matching pursuit (OMP) algorithm, the feature of two-dimensional scattering center in radar image sequence is estimated, and the corner feature of continuous visible image is extracted by Freeman chain code. Then, based on graph theory, two-dimensional feature points in radar and visible images are associated. Finally, the fusion of scattering center feature and optical corner feature is realized by three dimensional reconstruction of feature points, so as to reconstruct more abundant and accurate target structure information than single source feature. Simulation results verify the effectiveness of the proposed method.

Key words: radar image, visible image, scattering center, corner, electro-optical fusion

中图分类号:

TN957

邢笑宇, 霍超颖, 殷红成, 王静. 基于光电融合的目标三维结构反演[J]. 系统工程与电子技术, 2021, 43(9): 2392-2399.

Xiaoyu XING, Chaoying HUO, Hongcheng YIN, Jing WANG. Target 3-D structure inversion based on electro-optical fusion[J]. Systems Engineering and Electronics, 2021, 43(9): 2392-2399.

图/表 16

表1

图1

图2

图3

图4

图5

图6

图7

表2

图8

表3

图9

表4

图10

表5

表6

参考文献 31

1	POTTER L C , CHIANG D M , CARRIERE R , et al. A GTD-based parametric model for radar scattering[J]. IEEE Trans.on Antennas and Propagation, 1995, 43 (10): 1058- 1067. doi: 10.1109/8.467641
2	POTTER L C , MOSES R L . Attributed scattering centers for SAR ATR[J]. IEEE Trans.on Image Processing, 1997, 6 (1): 79- 91. doi: 10.1109/83.552098
3	毛士艺, 赵巍. 多传感器图像融合技术综述[J]. 北京航空航天大学学报, 2002, 28 (5): 512- 518. doi: 10.3969/j.issn.1001-5965.2002.05.005
	MAO S Y , ZHAO W . Comments on multisensor image fusion techniques[J]. Journal of Beijing University of Aeronautics and Astronautics, 2002, 28 (5): 512- 518. doi: 10.3969/j.issn.1001-5965.2002.05.005
4	WAXMAN A M , FAY D A , GOVE A N , et al. Color night vision: fusion of intensified visible and thermal IR imagery[J]. Synthetic Vision for Vehicle Guidance and Control, 1995, 2463, 58- 68. doi: 10.1117/12.212755
5	BURT P J , ADELSON E H . The Laplacian pyramid as a compact image code[J]. IEEE Trans.on Communications, 1983, 31 (4): 532- 540. doi: 10.1109/TCOM.1983.1095851
6	LI H , MANJUNATH B S , MITRA S K . Multisensor image fusion using the wavelet transform[J]. Graphical Models and Image Processing, 1995, 57 (3): 235- 245. doi: 10.1006/gmip.1995.1022
7	姚丽莎, 赵海峰, 罗斌, 等. 基于证据理论的小波域多特征医学图像融合[J]. 计算机应用, 2012, 32 (6): 1544- 1547.
	YAO L S , ZHAO H F , LUO B , et al. Medical image fusion with multi-feature based on evidential theory in wavelet domain[J]. Journal of Computer Applications, 2012, 32 (6): 1544- 1547.
8	袁刚. 基于聚类分割和多尺度分解的多波段图像融合算法研究[D]. 成都: 电子科技大学, 2015.
	YUAN G. Research on multiband image fusion algorithm based on clustering and multiscale decomposition[D]. Chengdu: University of Electronic Science and Technology of China, 2015.
9	GUNATILAKA A H , BAERTLEIN B A . Feature-level and decision-level fusion of noncoincidently sampled sensors for land mine detection[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2001, 23 (6): 577- 589. doi: 10.1109/34.927459
10	郝梓淇. 无线传感器网络决策级融合算法研究[D]. 北京: 北京交通大学, 2016.
	HAO Z Q. Research on decision level fusion algorithm for wireless sensor networks[D]. Beijing: Beijing Jiaotong University, 2016.
11	MANDEH A , KHAMFOROOSH K , MAIHAMI V . Data fusion in wireless sensor networks using fuzzy systems[J]. International Journal of Computer Applications, 2015, 125 (12): 31- 36. doi: 10.5120/ijca2015906151
12	ZHANG Z J , LAI C F , CHAO H C . A green data transmission mechanism for wireless multimedia sensor networks using information fusion[J]. IEEE Wireless communications, 2014, 21 (4): 14- 19. doi: 10.1109/MWC.2014.6882291
13	TUPIN F , ROUX M . Markov random field on region adjacency graph for the fusion of SAR and optical data in radargrammetric applications[J]. IEEE Trans.on Geoscience and Remote Sen-sing, 2005, 43 (8): 1920- 1928. doi: 10.1109/TGRS.2005.852080
14	POULAIN V, INGLADA J, SPIGAI M, et al. Fusion of high resolution optical and SAR images with vector data bases for change detection[C]//Proc. of the IEEE International Geo-science and Remote Sensing Symposium, 2009: 956-959.
15	TROPP J A , GILBERT A C . Signal recovery from random measurements via orthogonal matching pursuit[J]. IEEE Trans.on Information Theory, 2007, 53 (12): 4655- 4666. doi: 10.1109/TIT.2007.909108
16	NEEDELL D , VERSHYNIN R . Uniform uncertainty principle and signal recovery via regularized orthogonal matching pursuit[J]. Foundations of Computational Mathematics, 2009, 9 (3): 317- 334. doi: 10.1007/s10208-008-9031-3
17	刘相湖, 王涛, 张小哲. 对Freeman链码分析的角点检测算法[J]. 计算机系统应用, 2018, 27 (4): 202- 208.
	LIU X H , WANG T , ZHANG X Z . Corner detection algorithm based on Freeman code analysis[J]. Computer Systems & Applications, 2018, 27 (4): 202- 208.
18	RACHMAWATI E, SUPRIANA I, KHODRA M L, et al. FAST corner detection in polygonal approximation of shape[C]//Proc. of the SPIE 3rd International Conference on Science in Information Technology, 2017: 166-170.
19	WESTD B, 李建中, 骆吉洲. 图论导引[M]. 北京: 机械工业出版社, 2006: 100- 112.
	WEST D B , LI J Z , LUO J Z . Guide to graph theory[M]. Beijing: China Machine Press, 2006: 100- 112.
20	IWAMOTO M, KDRIMOTO T. A novel algorithm for reconstructing three-dimensional target shapes using sequential radar images[C]//Proc. of the IEEE Intenational Geoscience and Remote Sensing Symposium, 2001: 1607-1609.
21	KELLER J B . Geometrical theory of diffraction[J]. Journal of the Optical Society of America, 1962, 52 (2): 116- 130. doi: 10.1364/JOSA.52.000116
22	胡楚锋, 张麟兮, 沈楠, 等. 基于转台的中场ISAR成像技术研究[J]. 电子测量技术, 2007, 30 (10): 29- 32. doi: 10.3969/j.issn.1002-7300.2007.10.009
	HU C F , ZHANG L X , SHEN N , et al. Investigation on techniques of middle-field ISAR imaging based on rotator mode[J]. Electronic Measurement Technology, 2007, 30 (10): 29- 32. doi: 10.3969/j.issn.1002-7300.2007.10.009
23	CANNY J . A computational approach to edge detection[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 1986, 8 (6): 679- 698.
24	IQBAL B , IQBAL W , KHAN N , et al. Canny edge detection and Hough transform for high resolution video streams using Hadoop and Spark[J]. Cluster Computing, 2020, 23, 397- 408. doi: 10.1007/s10586-019-02929-x
25	WU G H , YANG D Y , CHANG C , et al. Optimizations of Canny edge detection in ghost imaging[J]. Journal of the Korean Physical Society, 2019, 75 (3): 223- 228. doi: 10.3938/jkps.75.223
26	范秋凤, 杨国胜, 王应军, 等. Freeman链码角点和面积比角点检测的比较研究[J]. 计算机工程与应用, 2005, 41 (29): 55- 57, 69. doi: 10.3321/j.issn:1002-8331.2005.29.016
	FAN Q F , YANG G S , WANG Y J , et al. Comparative study of corner detection based on Freeman chain and area ratio[J]. Computer Engineering and Applications, 2005, 41 (29): 55- 57, 69. doi: 10.3321/j.issn:1002-8331.2005.29.016
27	周剑雄. 光学区雷达目标三维散射中心重构理论与技术[D]. 长沙: 国防科学技术大学, 2006.
	ZHOU J X. Theory and technology on reconstructing 3D scattering centers of radar targets in optical region[D]. Changsha: National University of Defense Technology, 2006.
28	王昕, 郭宝锋, 尚朝轩. 基于二维ISAR图像序列的雷达目标三维重建方法[J]. 电子与信息学报, 2013, 35 (10): 2475- 2480.
	WANG X , GUO B F , SHANG C X . 3D reconstruction of target geometry based on 2D data of inverse synthetic aperture radar images[J]. Journal of Electronics & Information Technology, 2013, 35 (10): 2475- 2480.
29	QI J J , SUN K , WANG J H , et al. Dynamic state estimation for multi-machine power system by unscented Kalman filter with enhanced numerical stability[J]. IEEE Trans.on Smart Grid, 2018, 9 (2): 1184- 1196. doi: 10.1109/TSG.2016.2580584
30	MUNKRES J . Algorithms for the assignment and transportation problems[J]. Journal of the Society for Industrial and Applied Mathematics, 1957, 5 (1): 32- 38. doi: 10.1137/0105003
31	WANG T , LIANG Y Z , YANG Y , et al. An intelligent edge-computing-based method to counter coupling problems in cyber-physical systems[J]. IEEE Network, 2020, 34 (3): 16- 22. doi: 10.1109/MNET.011.1900251

α	典型结构
-1.0	角绕射
-0.5	曲边缘绕射
0	点散射体、双弯曲曲面、直边
0.5	单弯曲曲面
1.0	平面、二面角

部件	长或高/m	宽或直径/m
大圆柱	0.50	0.50
小圆柱	0.50	0.30
平板	0.50	0.25
连接杆	0.15	0.01

编号	θ=85°			θ=90°
编号	x/m	y/m	α	x/m	y/m	α
1	-0.650	0.000	1	-0.650	0.000	1
2	0.650	0.000	1	0.650	0.000	1
3	0.000	-0.108	0.5	0.000	-0.150	0.5
4	0.000	-0.247	0.5	0.000	-0.250	0.5

编号	θ=85°		θ=90°
编号	x/m	y/m	x/m	y/m
1	-0.900	0.124	-0.900	0.125
2	-0.400	0.125	-0.400	0.125
3	-0.900	-0.124	-0.900	-0.125
4	-0.400	-0.125	-0.400	-0.125
5	-0.250	0.249	-0.250	0.250
6	0.250	0.249	0.250	0.250
7	-0.250	-0.249	-0.250	-0.250
8	0.250	-0.249	0.250	-0.250
9	-0.150	-0.746	-0.150	-0.750
10	0.150	-0.746	0.150	-0.750
11	0.400	0.125	0.400	0.125
12	0.900	0.125	0.900	0.125
13	0.400	-0.125	0.400	-0.125
14	0.900	-0.125	0.900	-0.125

特征	编号	x/m	y/m	z/m	类型参数
角点	1	0.01	-0.90	0.13	-
	2	-0.01	-0.40	0.13	-
	3	-0.01	-0.90	-0.13	-
	4	0.01	-0.40	-0.13	-
	5	0.00	-0.25	0.25	-
	6	0.00	0.25	0.25	-
	7	0.00	-0.25	-0.25	-
	8	0.00	0.25	-0.25	-
	9	-0.01	-0.15	-0.75	-
	10	-0.01	0.15	-0.75	-
	11	-0.01	0.40	0.13	-
	12	-0.01	0.90	0.13	-
	13	0.01	0.40	-0.13	-
	14	0.01	0.90	-0.13	-
散射中心	15	0.15	0.00	-0.48	0.5
	16	0.25	0.00	-0.02	0.5
	17	0.00	-0.65	0.00	1.0
	18	0.00	0.65	0.00	1.0