基于光电融合的目标三维结构反演

doi:10.12305/j.issn.1001-506X.2021.09.03

Abstract

Abstract:

Aiming at the problem of electro-optical feature fusion simultaneous interpreting the sky and sky targets from the same sensor angle, a three dimensional structure inversion method is proposed, which integrates the parameters of scattering centers and the features of contour points. Firstly, based on orthogonal matching pursuit (OMP) algorithm, the feature of two-dimensional scattering center in radar image sequence is estimated, and the corner feature of continuous visible image is extracted by Freeman chain code. Then, based on graph theory, two-dimensional feature points in radar and visible images are associated. Finally, the fusion of scattering center feature and optical corner feature is realized by three dimensional reconstruction of feature points, so as to reconstruct more abundant and accurate target structure information than single source feature. Simulation results verify the effectiveness of the proposed method.

Key words: radar image, visible image, scattering center, corner, electro-optical fusion

CLC Number:

TN957

Xiaoyu XING, Chaoying HUO, Hongcheng YIN, Jing WANG. Target 3-D structure inversion based on electro-optical fusion[J]. Systems Engineering and Electronics, 2021, 43(9): 2392-2399.

Figures/Tables 16

Table 1

Fig.1

Fig.2

Fig.3

Fig.4

Fig.5

Fig.6

Fig.7

Table 2

Fig.8

Table 3

Fig.9

Table 4

Fig.10

Table 5

Table 6

References 31

1	POTTER L C , CHIANG D M , CARRIERE R , et al. A GTD-based parametric model for radar scattering[J]. IEEE Trans.on Antennas and Propagation, 1995, 43 (10): 1058- 1067. doi: 10.1109/8.467641
2	POTTER L C , MOSES R L . Attributed scattering centers for SAR ATR[J]. IEEE Trans.on Image Processing, 1997, 6 (1): 79- 91. doi: 10.1109/83.552098
3	毛士艺, 赵巍. 多传感器图像融合技术综述[J]. 北京航空航天大学学报, 2002, 28 (5): 512- 518. doi: 10.3969/j.issn.1001-5965.2002.05.005
	MAO S Y , ZHAO W . Comments on multisensor image fusion techniques[J]. Journal of Beijing University of Aeronautics and Astronautics, 2002, 28 (5): 512- 518. doi: 10.3969/j.issn.1001-5965.2002.05.005
4	WAXMAN A M , FAY D A , GOVE A N , et al. Color night vision: fusion of intensified visible and thermal IR imagery[J]. Synthetic Vision for Vehicle Guidance and Control, 1995, 2463, 58- 68. doi: 10.1117/12.212755
5	BURT P J , ADELSON E H . The Laplacian pyramid as a compact image code[J]. IEEE Trans.on Communications, 1983, 31 (4): 532- 540. doi: 10.1109/TCOM.1983.1095851
6	LI H , MANJUNATH B S , MITRA S K . Multisensor image fusion using the wavelet transform[J]. Graphical Models and Image Processing, 1995, 57 (3): 235- 245. doi: 10.1006/gmip.1995.1022
7	姚丽莎, 赵海峰, 罗斌, 等. 基于证据理论的小波域多特征医学图像融合[J]. 计算机应用, 2012, 32 (6): 1544- 1547.
	YAO L S , ZHAO H F , LUO B , et al. Medical image fusion with multi-feature based on evidential theory in wavelet domain[J]. Journal of Computer Applications, 2012, 32 (6): 1544- 1547.
8	袁刚. 基于聚类分割和多尺度分解的多波段图像融合算法研究[D]. 成都: 电子科技大学, 2015.
	YUAN G. Research on multiband image fusion algorithm based on clustering and multiscale decomposition[D]. Chengdu: University of Electronic Science and Technology of China, 2015.
9	GUNATILAKA A H , BAERTLEIN B A . Feature-level and decision-level fusion of noncoincidently sampled sensors for land mine detection[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 2001, 23 (6): 577- 589. doi: 10.1109/34.927459
10	郝梓淇. 无线传感器网络决策级融合算法研究[D]. 北京: 北京交通大学, 2016.
	HAO Z Q. Research on decision level fusion algorithm for wireless sensor networks[D]. Beijing: Beijing Jiaotong University, 2016.
11	MANDEH A , KHAMFOROOSH K , MAIHAMI V . Data fusion in wireless sensor networks using fuzzy systems[J]. International Journal of Computer Applications, 2015, 125 (12): 31- 36. doi: 10.5120/ijca2015906151
12	ZHANG Z J , LAI C F , CHAO H C . A green data transmission mechanism for wireless multimedia sensor networks using information fusion[J]. IEEE Wireless communications, 2014, 21 (4): 14- 19. doi: 10.1109/MWC.2014.6882291
13	TUPIN F , ROUX M . Markov random field on region adjacency graph for the fusion of SAR and optical data in radargrammetric applications[J]. IEEE Trans.on Geoscience and Remote Sen-sing, 2005, 43 (8): 1920- 1928. doi: 10.1109/TGRS.2005.852080
14	POULAIN V, INGLADA J, SPIGAI M, et al. Fusion of high resolution optical and SAR images with vector data bases for change detection[C]//Proc. of the IEEE International Geo-science and Remote Sensing Symposium, 2009: 956-959.
15	TROPP J A , GILBERT A C . Signal recovery from random measurements via orthogonal matching pursuit[J]. IEEE Trans.on Information Theory, 2007, 53 (12): 4655- 4666. doi: 10.1109/TIT.2007.909108
16	NEEDELL D , VERSHYNIN R . Uniform uncertainty principle and signal recovery via regularized orthogonal matching pursuit[J]. Foundations of Computational Mathematics, 2009, 9 (3): 317- 334. doi: 10.1007/s10208-008-9031-3
17	刘相湖, 王涛, 张小哲. 对Freeman链码分析的角点检测算法[J]. 计算机系统应用, 2018, 27 (4): 202- 208.
	LIU X H , WANG T , ZHANG X Z . Corner detection algorithm based on Freeman code analysis[J]. Computer Systems & Applications, 2018, 27 (4): 202- 208.
18	RACHMAWATI E, SUPRIANA I, KHODRA M L, et al. FAST corner detection in polygonal approximation of shape[C]//Proc. of the SPIE 3rd International Conference on Science in Information Technology, 2017: 166-170.
19	WESTD B, 李建中, 骆吉洲. 图论导引[M]. 北京: 机械工业出版社, 2006: 100- 112.
	WEST D B , LI J Z , LUO J Z . Guide to graph theory[M]. Beijing: China Machine Press, 2006: 100- 112.
20	IWAMOTO M, KDRIMOTO T. A novel algorithm for reconstructing three-dimensional target shapes using sequential radar images[C]//Proc. of the IEEE Intenational Geoscience and Remote Sensing Symposium, 2001: 1607-1609.
21	KELLER J B . Geometrical theory of diffraction[J]. Journal of the Optical Society of America, 1962, 52 (2): 116- 130. doi: 10.1364/JOSA.52.000116
22	胡楚锋, 张麟兮, 沈楠, 等. 基于转台的中场ISAR成像技术研究[J]. 电子测量技术, 2007, 30 (10): 29- 32. doi: 10.3969/j.issn.1002-7300.2007.10.009
	HU C F , ZHANG L X , SHEN N , et al. Investigation on techniques of middle-field ISAR imaging based on rotator mode[J]. Electronic Measurement Technology, 2007, 30 (10): 29- 32. doi: 10.3969/j.issn.1002-7300.2007.10.009
23	CANNY J . A computational approach to edge detection[J]. IEEE Trans.on Pattern Analysis and Machine Intelligence, 1986, 8 (6): 679- 698.
24	IQBAL B , IQBAL W , KHAN N , et al. Canny edge detection and Hough transform for high resolution video streams using Hadoop and Spark[J]. Cluster Computing, 2020, 23, 397- 408. doi: 10.1007/s10586-019-02929-x
25	WU G H , YANG D Y , CHANG C , et al. Optimizations of Canny edge detection in ghost imaging[J]. Journal of the Korean Physical Society, 2019, 75 (3): 223- 228. doi: 10.3938/jkps.75.223
26	范秋凤, 杨国胜, 王应军, 等. Freeman链码角点和面积比角点检测的比较研究[J]. 计算机工程与应用, 2005, 41 (29): 55- 57, 69. doi: 10.3321/j.issn:1002-8331.2005.29.016
	FAN Q F , YANG G S , WANG Y J , et al. Comparative study of corner detection based on Freeman chain and area ratio[J]. Computer Engineering and Applications, 2005, 41 (29): 55- 57, 69. doi: 10.3321/j.issn:1002-8331.2005.29.016
27	周剑雄. 光学区雷达目标三维散射中心重构理论与技术[D]. 长沙: 国防科学技术大学, 2006.
	ZHOU J X. Theory and technology on reconstructing 3D scattering centers of radar targets in optical region[D]. Changsha: National University of Defense Technology, 2006.
28	王昕, 郭宝锋, 尚朝轩. 基于二维ISAR图像序列的雷达目标三维重建方法[J]. 电子与信息学报, 2013, 35 (10): 2475- 2480.
	WANG X , GUO B F , SHANG C X . 3D reconstruction of target geometry based on 2D data of inverse synthetic aperture radar images[J]. Journal of Electronics & Information Technology, 2013, 35 (10): 2475- 2480.
29	QI J J , SUN K , WANG J H , et al. Dynamic state estimation for multi-machine power system by unscented Kalman filter with enhanced numerical stability[J]. IEEE Trans.on Smart Grid, 2018, 9 (2): 1184- 1196. doi: 10.1109/TSG.2016.2580584
30	MUNKRES J . Algorithms for the assignment and transportation problems[J]. Journal of the Society for Industrial and Applied Mathematics, 1957, 5 (1): 32- 38. doi: 10.1137/0105003
31	WANG T , LIANG Y Z , YANG Y , et al. An intelligent edge-computing-based method to counter coupling problems in cyber-physical systems[J]. IEEE Network, 2020, 34 (3): 16- 22. doi: 10.1109/MNET.011.1900251

α	典型结构
-1.0	角绕射
-0.5	曲边缘绕射
0	点散射体、双弯曲曲面、直边
0.5	单弯曲曲面
1.0	平面、二面角

部件	长或高/m	宽或直径/m
大圆柱	0.50	0.50
小圆柱	0.50	0.30
平板	0.50	0.25
连接杆	0.15	0.01

编号	θ=85°			θ=90°
编号	x/m	y/m	α	x/m	y/m	α
1	-0.650	0.000	1	-0.650	0.000	1
2	0.650	0.000	1	0.650	0.000	1
3	0.000	-0.108	0.5	0.000	-0.150	0.5
4	0.000	-0.247	0.5	0.000	-0.250	0.5

编号	θ=85°		θ=90°
编号	x/m	y/m	x/m	y/m
1	-0.900	0.124	-0.900	0.125
2	-0.400	0.125	-0.400	0.125
3	-0.900	-0.124	-0.900	-0.125
4	-0.400	-0.125	-0.400	-0.125
5	-0.250	0.249	-0.250	0.250
6	0.250	0.249	0.250	0.250
7	-0.250	-0.249	-0.250	-0.250
8	0.250	-0.249	0.250	-0.250
9	-0.150	-0.746	-0.150	-0.750
10	0.150	-0.746	0.150	-0.750
11	0.400	0.125	0.400	0.125
12	0.900	0.125	0.900	0.125
13	0.400	-0.125	0.400	-0.125
14	0.900	-0.125	0.900	-0.125

特征	编号	x/m	y/m	z/m	类型参数
角点	1	0.01	-0.90	0.13	-
	2	-0.01	-0.40	0.13	-
	3	-0.01	-0.90	-0.13	-
	4	0.01	-0.40	-0.13	-
	5	0.00	-0.25	0.25	-
	6	0.00	0.25	0.25	-
	7	0.00	-0.25	-0.25	-
	8	0.00	0.25	-0.25	-
	9	-0.01	-0.15	-0.75	-
	10	-0.01	0.15	-0.75	-
	11	-0.01	0.40	0.13	-
	12	-0.01	0.90	0.13	-
	13	0.01	0.40	-0.13	-
	14	0.01	0.90	-0.13	-
散射中心	15	0.15	0.00	-0.48	0.5
	16	0.25	0.00	-0.02	0.5
	17	0.00	-0.65	0.00	1.0
	18	0.00	0.65	0.00	1.0

Target 3-D structure inversion based on electro-optical fusion

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 16

References 31

Related Articles 15

Recommended Articles

Metrics

Comments

编号	边	长/m	编号	边	长/m
1	1~2	0.50	8	7~5	0.50
2	2~4	0.26	9	9~10	0.30
3	4~3	0.50	10	11~12	0.50
4	3~1	0.26	11	12~14	0.26
5	5~6	0.50	12	14~13	0.50
6	6~8	0.50	13	13~11	0.26
7	8~7	0.50	-	-	-

[1]	Haoliang LI, Siwei CHEN, Xuesong WANG. Study on characterization of sea corner reflectors in polarimetric rotation domain [J]. Systems Engineering and Electronics, 2022, 44(7): 2065-2073.
[2]	Wenjie YUAN, Kunyi GUO, Xinqing SHENG, Congjun JIN. Modeling method of sliding scattering center based on current phase characteristics [J]. Systems Engineering and Electronics, 2022, 44(6): 1765-1771.
[3]	Jinwen LU, Hua YAN, Lei ZHANG, Hongcheng YIN. 3D-GTD model construction method using the shooting and bouncing ray technique [J]. Systems Engineering and Electronics, 2021, 43(8): 2028-2036.
[4]	Jiahua XU, Xiaokuan ZHANG, Shuyu ZHENG, Binfeng ZONG, Jingwei ZHANG. Attribute scattering center extraction based on improved orthogonal matching pursuit algorithm [J]. Systems Engineering and Electronics, 2021, 43(8): 2076-2082.
[5]	Jiahua XU, Xiaokuan ZHANG, Shuyu ZHENG, Binfeng ZONG, Shuchang ZHENG. GTD model parameter estimation and target recognition based on improved 3D-ESPRIT algorithm [J]. Systems Engineering and Electronics, 2021, 43(2): 336-342.
[6]	Chaoying HUO, Hua YAN, Xuejian FENG, Hongcheng YIN, Xiaoyu XING, Jinwen LU. Correlation research between deep features of HRRP sparse auto-encoder and scattering center features [J]. Systems Engineering and Electronics, 2021, 43(11): 3040-3053.
[7]	Siyuan HE, Lingkun ZHU, Jin LIU, Zhidan BIAN, Yunhua ZHANG, Guoqiang ZHU. Research and implementation of forward automatic modeling methodfor radar target scattering center [J]. Systems Engineering and Electronics, 2021, 43(10): 2706-2717.
[8]	Yanxi CHEN, Kunyi GUO, Hongcheng YIN, Xinqing SHENG. Scattering center modeling and radar imaging application incomplex scenes [J]. Systems Engineering and Electronics, 2021, 43(10): 2733-2741.
[9]	Jia DUAN, Lanying CAO, Yifeng WU. Imaging algorithm for SAR based on attributed scattering center models [J]. Systems Engineering and Electronics, 2021, 43(10): 2782-2788.
[10]	Shangsheng LI, Xukun WANG, Zhequan FU, Juntao ZHANG. Extraction of scattering center parameter and RCS reconstruction based on the improved TLS-ESPRIT algorithm of Hankel matrix [J]. Systems Engineering and Electronics, 2021, 43(1): 62-73.
[11]	Daheng ZHANG, Yingjun ZHANG, Chuang ZHANG. Data fusion of electronic navigational chart and radar images based on Faster R-CNN [J]. Systems Engineering and Electronics, 2020, 42(6): 1267-1273.
[12]	Shuyu ZHENG, Xiaokuan ZHANG, Binfeng ZONG, Jiahua XU, Jiang LI. PQ-FB-2D-ESPRIT algorithm for parameter estimation of 2D-GTD model [J]. Systems Engineering and Electronics, 2020, 42(6): 1283-1289.
[13]	Shuyu ZHENG, Xiaokuan ZHANG, Binfeng ZONG. Extraction of scattering center parameters and reconstruction of RCS based on improved MUSIC algorithm [J]. Systems Engineering and Electronics, 2020, 42(1): 76-82.
[14]	FENG Dejun, XIE Qianpeng, WANG Junjie, LIU Lei. Passive electromagnetic manipulation technology to radar echo and its development [J]. Systems Engineering and Electronics, 2019, 41(6): 1236-1241.
[15]	ZHOU Long, WEI Suyuan, CUI Zhongma, FANG Jiaqi, YANG Xiaoting, YANG Long. Multiobjective detection of complex background radar imagebased on deep learning [J]. Systems Engineering and Electronics, 2019, 41(6): 1258-1264.