全偏振参量低秩稀疏分解伪彩色图像融合

doi:10.3969/j.issn.1001-506X.2020.11.06

Abstract

Abstract:

The polarization image pseudo color fusion is of great significance to improve visual perception and object interpretation. Based on the low-rank and sparse prior of the spatially modulated full-polarization parameter matrix, a fusion method is proposed via Bayesian probability robust matrix factorization. Firstly, the polarization parameter matrix is constructed according to the polarization modulation and analytic algorithm, and the intensity image is synthesized at the same time. Secondly, the sparse and low-rank components of the parameter images are obtained via improved Bayesian robust matrix factorization (BRMF). The influence of background noise and brightness change is reduced via BRMF. Then, the saliency parameter image is obtained by using the Choquet fuzzy integral of variance, definition and entropy. The saliency parameter image is carried out together with the synthesized intensity image to enforce pixel level enhancement. Finally, the pseudo color fusion image is obtained by the processing of histogram normalization and IHS color mapping. The experiment is performed with simulation and measurement images of different materials and objects. The subjective visual results and objective evaluation verify the effectiveness of the proposed method.

Key words: polarization imaging, image fusion, low-rank and sparse, robust matrix factorization

CLC Number:

Guoming XU, Hongwu YUAN, Mogen XUE, Feng WANG. Full polarization parameters low-rank and sparse factorization for pseudo color image fusion[J]. Systems Engineering and Electronics, 2020, 42(11): 2450-2460.

Figures/Tables 10

Fig.1

Fig.2

Fig.3

Fig.4

Table 1

Fig.5

Fig.6

Fig.7

Fig.8

Table 2

References 23

1	王小龙, 王峰, 刘晓, 等. 荒漠背景下典型伪装目标的高光谱偏振特性[J]. 激光与光电子学进展, 2018, 55 (5): 051101.
	WANG X L , WANG F , LIU X , et al. Hyperspectral polarization characteristics of typical camouflage target under desert background[J]. Laser & Optoelectronics Progress, 2018, 55 (5): 051101.
2	ZHAO Y , YI C , KONG S G , et al. Multi-band polarization imaging and applications[M]. Berlin: Springer Publishing Company, Incorporated, 2016: 47- 71.
3	SHUMYATSKY P , MILIONE G , ALFANO R R . Optical memory effect from polarized Laguerre-Gaussian light beam in light-scattering turbid media[J]. Optics Communications, 2014, 321, 116- 123. doi: 10.1016/j.optcom.2014.01.039
4	张家民, 时东锋, 黄见, 等. 图像融合在偏振关联成像中的应用[J]. 红外与激光工程, 2018, 47 (12): 373- 379.
	ZHANG J M , SHI D F , HUANG J , et al. Application of image fusion in polarization correlated imaging[J]. Infrared and Laser Engineering, 2018, 47 (12): 373- 379.
5	ZHANG L , YANG F B , JI L N , et al. Multiple-algorithm parallel fusion of infrared polarization and intensity images based on algorithmic complementarity and synergy[J]. Journal of Electronic Imaging, 2018, 27 (1) doi: 10.1117/1.JEI.27.1.013029
6	TOET A . Natural colour mapping for multiband night vision imagery[J]. Information Fusion, 2003, 4 (3): 155- 166. doi: 10.1016/S1566-2535(03)00038-1
7	WOLFF L B . Polarization vision: a new sensory approach to image understanding[J]. Image and Vision Computing, 1997, 15 (2): 81- 93. doi: 10.1016/S0262-8856(96)01123-7
8	宫剑, 吕俊伟, 刘亮. 基于颜色空间融合与上下文显著性的红外偏振图像目标增强[J]. 光学学报, 2019, 39 (10): 23- 32.
	GONG J , LYU J W , LIU L . Target enhancement of infrared polarization image based on color space fusion and context-aware saliency[J]. Acta Optica Sinica, 2019, 39 (10): 23- 32.
9	LEE D D , SEUNG H S . Learning the parts of objects by non-negative matrix factorization[J]. Nature, 1999, 401 (6755): 788- 791. doi: 10.1038/44565
10	周浦城, 韩裕生, 薛模根, 等. 基于非负矩阵分解和IHS颜色模型的偏振图像融合方法[J]. 光子学报, 2010, 39 (9): 1682- 1687.
	ZHOU P C , HAN Y S , XUE M G , et al. Polarization image fusion approach based on non-negative matrix factorization and ihs color model[J]. Acta Photonica Sinica, 2010, 39 (9): 1682- 1687.
11	SALAKHUTDINOV R , MNIH A . Probabilistic matrix factorization[J]. Advances in Neural Information Processing Systems, 2008, 20, 1257- 1264.
12	常侃, 张智勇, 陈诚, 等. 采用低秩与加权稀疏分解的视频前景检测算法[J]. 电子学报, 2017, 45 (9): 2272- 2280.
	CHANG K , ZHANG Z Y , CHEN C , et al. Video foreground detection by low-rank and reweighted sparse decomposition[J]. Acta Electronica Sinica, 2017, 45 (9): 2272- 2280.
13	TATSUYA Y, KAZUYA K, MUNEYUKI S, et al. Dynamic PET image reconstruction using nonnegative matrix factorization incorporated with deep image prior[C]//Proc.of the IEEE International Conference on Computer Vision, 2019: 3126-3135.
14	宗静静, 邱天爽. 稀疏表示中稀疏系数的l₁范数的特性分析[J]. 系统工程与电子技术, 2019, 41 (12): 2692- 2696.
	ZONG J J , QIU T S . Characteristic analysis for the l₁ norm of sparse coefficients in sparse representation[J]. Systems Engineering and Electronics, 2019, 41 (12): 2692- 2696.
15	PENG Y , GANESH A , WRIGHT J , et al. RASL: robust alignment by sparse and low-rank decomposition for linearly correlated images[J]. IEEE Trans.on Pattern Analysis & Machine Intelligence(TPAMI), 2012, 34 (11): 2233- 2246.
16	ZHANG Z , GANESH A , LIANG X , et al. TILT: Transform invariant low-rank textures[J]. International Journal of Computer Vision, 2012, 99 (1): 1- 24.
17	WRIGHT J, PENG Y G, MA Y. Robust principal component analysis: exact recovery of corrupted low-rank matrices by convex optimization[C]//Proc.of the 23rd Annual Conference on Neural Information Processing Systems, 2009: 2080-2088.
18	SALAKHUTDINOV R, MNIH A. Bayesian probabilistic matrix factorization using Markov chain Monte Carlo[C]//Proc.of the 25th International Conference Machine Learning, 2008: 880-887.
19	WANG N Y, YEUNG D Y. Bayesian robust matrix factorization for image and video processing[C]//Proc.of the IEEE International Conference on Computer Vision, 2013: 1785-1792.
20	WANG N, YAO T, WANG J, et al. A probabilistic approach to robust matrix factorization[C]//Proc.of the European Conference on Computer Vision, 2012: 126-139.
21	SMITH, RAY A. Color gamut transform pairs[C]//Proc.of the 5th Annual Conference on Computer Graphics and Interactive Techniques, 1978: 12-19.
22	安影, 范训礼, 陈莉, 等. 结合FABEMD和改进的显著性检测的图像融合[J]. 系统工程与电子技术, 2020, 42 (2): 292- 300.
	AN Y , FAN X L , CHEN L , et al. Image fusion combining FABEMD with improved saliency detection[J]. Systems Engineering and Electronics, 2020, 42 (2): 292- 300.
23	ZHAO Q , MENG D Y , XU Z B , et al. L1-norm low-rank matrix factorization by variational Bayesian method[J]. IEEE Trans.on Neural Networks and Learning Systems, 2015, 26 (4): 825- 839. doi: 10.1109/TNNLS.2014.2387376

H取值范围	变换方法
[0°, 120°]	${B = I(1- S)}$
	${R = I\left({1 + \frac{{S\cos H}}{{\cos \left({{{60}^\circ } - H} \right)}}} \right)}$
	${G = 3I- (B + R)}$
[120°, 240°]	${R = I(1- S)}$
	${G = I\left({1 + \frac{{S\cos \left({H - {{120}^\circ }} \right)}}{{\cos \left({{{180}^\circ } - H} \right)}}} \right)}$
	${B = 3I- (G + R)}$
[240°, 360°]	${G = I(1- S)}$
	${B = I\left({1 + \frac{{Scos\left({H - {{240}^\circ }} \right)}}{{\cos \left({{{300}^\circ } - H} \right)}}} \right)}$
	${R = 3I- (B + G)}$

目标	Rce			Cor			Con
目标	NMF	SNMF	Proposed	NMF	SNMF	Proposed	NMF	SNMF	Proposed
fabric	9.32	9.45	8.42	0.39	0.17	0.85	25.63	34.85	79.58
mask	12.10	7.30	9.80	0.09	0.35	0.66	20.20	43.88	39.13
tank	12.97	12.72	10.94	-0.11	-0.22	0.77	83.42	70.96	90.98
aircraft	11.76	10.74	9.32	0.44	-0.23	0.19	41.79	35.41	93.67
ship	12.15	11.20	9.55	0.31	0.29	0.41	51.30	74.01	68.61
平均	11.66	10.28	9.61	0.22	0.07	0.58	44.47	51.82	74.39

[1]	Jian WANG, Zihao HE, Jie LIU, Ke YANG. Image fusion algorithm based on gradient domain guided filtering and improved PCNN [J]. Systems Engineering and Electronics, 2022, 44(8): 2381-2392.
[2]	Yingping TONG, Yinghui QUAN, Wei FENG, Mengdao XING. Multi-source remote sensing image fusion method based on spatial-spectrum information collaboration and Gram-Schmidt transform [J]. Systems Engineering and Electronics, 2022, 44(7): 2074-2083.
[3]	Ying AN, Xunli FAN, Li CHEN, Pei LIU. Image fusion combining FABEMD with improved saliency detection [J]. Systems Engineering and Electronics, 2020, 42(2): 292-300.
[4]	ZONG Jingjing, QIU Tianshuang. Characteristic analysis for the l-1 norm of sparse coefficients in sparse representation [J]. Systems Engineering and Electronics, 2019, 41(12): 2692-2696.
[5]	LIU Bin, FU Zhongwang. Multi-focus image fusion based on four-channel non-separable lifting wavelet [J]. Systems Engineering and Electronics, 2018, 40(2): 463-471.
[6]	CHANG Lihong, FENG Xiangchu, ZHANG Rui. Image fusion scheme based on quaternion wavelet transform and sparse representation [J]. Systems Engineering and Electronics, 2017, 39(7): 1633-1639.
[7]	ZHAO Lanfei, WANG Aili, WANG Bo, Lv Xinmiao. Image enhancement algorithm based on sub-image fusion [J]. Systems Engineering and Electronics, 2017, 39(12): 2840-2848.
[8]	HU Xiao-wei, TONG Ning-ning, HE Xing-yu, LEI Teng, WANG Yu-chen. High-speed spinning target imaging based on narrow-band radar networks [J]. Systems Engineering and Electronics, 2016, 38(4): 792-798.
[9]	ZHOU Zhi-qiang, WANG Bo, LI Li-guang, LI Sun. Image fusion based on a hybrid decomposition via bilateral and Gaussian filters [J]. Systems Engineering and Electronics, 2016, 38(1): 8-13.
[10]	LIU Bin, LIU Wei-jie, WEI YAN-ing. Construction of the six channel multi-scale singular value decomposition and its application in multi-focus image fusion [J]. Systems Engineering and Electronics, 2015, 37(9): 2191-2197.
[11]	XING Ya-qiong, WANG Xiao-dan, LIANG Bing-jie, QIN Zhuo. Fusion technique for multi-focus images based on orientation information measurement in non-subsample shearlet transform domain [J]. Systems Engineering and Electronics, 2015, 37(1): 191-198.
[12]	GUO Ming, WANG Shu-man. Image fusion based on region and directional variance weighted entropy [J]. Journal of Systems Engineering and Electronics, 2013, 35(4): 720-724.
[13]	WANG Xiaowen, ZHAO Zonggui, TANG Lei. Novel quality metric for infrared and visible image fusion [J]. Journal of Systems Engineering and Electronics, 2012, 34(5): 871-875.
[14]	ZHOU Pu-cheng, WANG Feng, CUI Xunxue, XUE Mo-gen. Performance evaluation approach to image fusion based on ordering approximate to ideal solution [J]. Journal of Systems Engineering and Electronics, 2011, 33(3): 681-684.
[15]	KONG Weiwei, LEI Yingjie, LEI Yang, NI Xueliang. Fusion technique for grayscale visible light and infrared images based on NSCT and IHS transform [J]. Journal of Systems Engineering and Electronics, 2010, 32(7): 1389-1393.

Full polarization parameters low-rank and sparse factorization for pseudo color image fusion

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 10

References 23

Related Articles 15

Recommended Articles

Metrics

Comments