Share Email Print

Proceedings Paper

Infrared and visible image fusion via NSST and PCNN in multiscale morphological gradient domain
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

With the development of sensor technologies, imaging technology is developing more rapidly. What followed was the widespread use of image processing technology in many kinds of applications. For instance, image processing technology has been widely used in video surveillance, medical diagnosis, remote sensing detection and object tracking. As a sub-field of image processing technology, image fusion is the one of most studied technology. The aim of image fusion is to acquire an integrated image that contains more information. This integrated image is more conductive for a human or a machine to understand and mine the information contained in the image. In all kinds of image fusion, infrared (IR) and visible (VIS) image fusion is one of the most valuable multisource image fusion. When imaging the same scene using both IR and VIS imaging system, more information can be obtained, but more redundant information is generated. The IR sensor acquires the thermal radiation information of the object in a scene, so the object can also be detected when the lighting conditions are poor. The image acquired by VIS light sensors has more spectral information, clearer texture details, and higher spatial resolution. Thus, the scene can be described more completely by integrating the IR and VIS images into one image. Meanwhile, the scene can be readily understood by observers, and the information of the scene can be easily perceived. In this paper, an effective IR and VIS image fusion via non-subsampled shearlet transform (NSST) and pulse-coupled neural network (PCNN) in multi-scale morphological gradient (MSMG) domain is proposed. First, low frequency sub-image and high frequency sub-images are obtained through NSST. Then, the low frequency sub-image and high frequency sub-images are fused via a MSMG domain PCNN (MSMG-PCNN) strategy. Finally, the fused image is reconstructed by inverse NSST. Experimental results demonstrate that the proposed MSMG-PCNN-NSST algorithm performs effectively in most cases by qualitative and quantitative evaluation.

Paper Details

Date Published: 1 April 2020
PDF: 7 pages
Proc. SPIE 11353, Optics, Photonics and Digital Technologies for Imaging Applications VI, 113531E (1 April 2020); doi: 10.1117/12.2551830
Show Author Affiliations
Wei Tan, Xidian Univ. (China)
Univ. of Copenhagen (Denmark)
Jiajia Zhang, Xidian Univ. (China)
Pei Xiang, Xidian Univ. (China)
Huixin Zhou, Xidian Univ. (China)
William Thitøn, Univ. of Copenhagen (Denmark)

Published in SPIE Proceedings Vol. 11353:
Optics, Photonics and Digital Technologies for Imaging Applications VI
Peter Schelkens; Tomasz Kozacki, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?