Adaptive Image Fusion Scheme Based on Contourlet Transform and Machine Learning

M. H. Malik(1*), S. A. M. Gilani(2), Anwaar-ul Haq(3)

(1) Ghulam Ishaq Khan Institute of Engineering and Technology, Pakistan
(2) Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Pakistan
(3) Ghulam Ishaq Khan Institute of Engineering Sciences and Technology, Pakistan
(*) Corresponding author

DOI's assignment:
the author of the article can submit here a request for assignment of a DOI number to this resource!
Cost of the service: euros 10,00 (for a DOI)


Adaptive image fusion scheme based on the combination of contourlet transform, Kernel Principal Component Analysis (K-PCA), Support Vector Machine (SVM) and Mutual Information (MI) is proposed. Contourlet is well suited to image fusion scheme because of its properties, such as localization, multiresolution, directionality and anisotropy. K-PCA operates on low frequency subband to extract feature and SVM is applied to high frequency subbands to obtain a composite image with extended information. Moreover, Mutual Information (MI) is used to adjust the contribution of each source image in the final fused image. Performance evaluation is carried out by using recently developed metric, Image Quality Index (IQI). The proposed scheme outperforms previous approaches both subjectively and quantitatively, and this is evident from the experimental results and findings.
Copyright © 2017 Praise Worthy Prize - All rights reserved.


Contourlet Transform; Image Fusion; Kernel Principal Component Analysis (K-PCA); Mutual Information (MI); Support Vector Machine (SVM)

Full Text:



Yin Chen and R. S. Blum, Experimental Tests of Image Fusion for Night Vision, Proceeding of the 8th International Conference on Information Fusion, (Page: 491-498 Year of Publication: 2005).

Yufeng Zheng, Edward A. Essock and Bruce C. Hansen, An Advanced Image Fusion Algorithm Based on Wavelet Transform- Incorporation with PCA and Morphological Processing, Proceedings of the SPIE, Volume 5298, (Page: 177-187, Year of Publication: 2004).

Anwar-ul-Haq, Muhammad Asad, Muhammad Asif, A. M. Mirza, Multi-sensor Image Fusion for Effective Night Vision through Contourlet Transform and KPCA and Mutual Information, Proceedings of the 6th WSEAS International Conference on Wavelet Analysis and Multirate Systems, (Page: 78-82 Year of Publication: 2006).

S. Li, James T. Kwok, Ivor W. Tsang, Yaonan Wang, Fusing Images with Different Focuses Using Support Vector Machines, IEEE Transactions on Neural Network, Vol. 15, n. 6, pp. 1555-61, 2004.

Jian Wie Liu, Qian Yin and Ping guo, A New Strategy to Improve Image Fusion Effect, Proceedings of the Fifth International Conference on Machine Learning and Cybernetics, (Page: 3770-3775 Year of Publication: 2006).

P. Burt, R Kolczynski, Enhanced Image Capture through Fusion, Proc. 4th International Conference on Computer Vision, (Page: 173-182 Year of Publication: 1993).

P.J. Burt, E.H. Adelson, The Laplacian Pyramid as a Compact Image Code, IEEE Transactions on Communications, Vol. 31, n. 4, pp. 532-540, April 1983.

Toet, L. J. van Ruyven and J. M. Vaelton, Merging Thermal and Visual Images by a Contrast Pyramid, Opt. Eng., Vol. 28, n. 7, pp. 789-792, July 1989.

Anwaar-ul-haq, A. M. Mirza, S. Qamar, A Novel Image Fusion Algorithm Based on Kernel-PCA and Structural Similarity, ACTA Press, Visualization, Imaging, and Image Processing, (Page: 480-490 Year of Publication: 2005).

Rui-Hong Yang, Quan Pan, Yong-Mei Cheng, A New Method of Image Fusion Based on M-Band Wavelet Transform, Proceedings of the Fifth International Conference on Machine Learning and Cybernetics, (Page: 3870-3873 Year of Publication: 2006).

Heng Ma, Chuanying Jia and Shuang Liu, Wavelet-based PAN and Multispectral Image Fusion, Proceedings of the 6th World Congress on Intelligent Control and Automation, (Page: 9613-9617 Year of Publication: 2006).

Adnan Mujahid Khan, Asifullah Khan, Fusion of Visible and Thermal Images Using Support Vector Machines, 10th IEEE International Multitopic Conference, (Page: 146-151 Year of Publication: 2006).

M. N. Do, M. Vetterli, The Contourlet Transform: An Efficient Directional Multi-resolution Image Representation, IEEE Transactions on Image Processing, Vol. 14, n. 12, pp. 2091-2106, 2005.

Liu Yang, Baolong Guo, Wei Ni, Multifocus Image Fusion Algorithm Based on Contourlet Decomposition and Region Statistics, Fourth International Conference on Image and Graphics, (Page: 707-712 Year of Publication: 2007).

Madiha Hussain Malik, S.A.M. Gillani, Anwaar ul Haq, Adaptive Image Fusion Scheme Based on Contourlet Transform, Kernel PCA and Support Vector Machine, Proceedings of CISSE, (Year of Publication: December 3 – 12, 2007).

G. Piella and H. Heijmans, A New Quality Metric for Image Fusion, IEEE International Conference on Image Processing, (Page: 173-176 Year of Publication: 2003).

V. Vapnik, Statistical Learning Theory, (New York: Wiley, 1998).

B. Scholkopf, A. Smola, and K. -R. Muller, Nonlinear Component Analysis as a Kernel Eigenvalue Problem, Neural Computation, Vol. 10, n. 5, pp. 1299-1319, 1998.

Bahadir K. Gunturk, Murat Gevrekci, High-Resolution Image Reconstruction from Multiple Differently Exposed Images, IEEE Signal Processing Letters, Vol. 13, n. 4, pp. 197-200, April 2006.


  • There are currently no refbacks.

Please send any question about this web site to
Copyright © 2005-2021 Praise Worthy Prize