Most of the existing pan-sharpening quality assessment methods consider only the spectral quality and there are just few investigations, which concentrate on spatial characteristics. Spatial quality of pan-sharpened images is vital in elaborating the capability of object extraction, identification, or reconstruction, especially regarding man-made objects and their application for large scale mapping in urban areas. This paper presents an Edge based image Fusion Metric (EFM) for spatial quality evaluation of pan-sharpening in high resolution satellite imagery. Considering Modulation Transfer Function (MTF) as a precise measurement of edge response, MTFs of pan-sharpened images are assessed and compared to those obtained from the original multispectral or panchromatic images. Spatial quality assessment of pan-sharpening is done by comparison of MTF curves of the pan-sharpened and reference images. The capability of the proposed method is evaluated by quality assessment of two different residential and industrial urban areas of WorldView-2 pan-sharpened images. Obtained results clearly show the wide spatial discrepancy in quality of Pan-sharpened images, resulting from different fusion methods, and confirm the need for spatial quality assessment of fused products. The results also prove the capability of the proposed EFM as a powerful tool for evaluation and comparison of different image fusion techniques and products.
References
[1]
Yuhendra, Y.; Alimuddin, I.; Tetuko Sri Sumantyo, J.; Kuze, H. Assessment of pan-sharpening methods applied to image fusion of remotely sensed multi-band data. Int. J. Appl. Earth Obs. Geoinf 2012, 18, 165–175.
[2]
Asha, G.; Philip, A. A review on pixel level satellite image fusion. Int. J. Comput. Appl 2012, 1, 15–19.
[3]
Ehlers, M.; Klonus, S.; Astrand, P.J.; Rosso, P. Multi-sensor image fusion for pansharpening in remote sensing. Int. J. Image Data Fus 2010, 1, 25–45.
[4]
Amolins, K.; Zhang, Y.; Dare, P. Wavelet based image fusion techniques—An introduction, review and comparison. ISPRS J. Photogramm. Remote Sens 2007, 62, 249–263.
[5]
Witharana, C.; Civco, D.L.; Meyer, T. Evaluation of pansharpening algorithms in support of earth observation based rapid mapping workflows. Appl. Geogr 2013, 37, 63–87.
[6]
Shi, W.; Zhu, C.H.; Tian, Y.; Nichol, J. Wavelet-based image fusion and quality assessment. Int. J. Appl. Earth Obs. Geoinf 2005, 6, 241–251.
[7]
Alparone, L.; Wald, L.; Chanussot, J.; Thomas, C.; Gamba, P.; Mann Bruce, L. Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest. IEEE Trans. Geosci. Remote Sens 2007, 45, 3012–3021.
[8]
Makarau, A.; Palubinskas, G.; Reinartz, P. Analysis and selection of pan-sharpening assessment measures. J. Appl. Remote Sens 2012, 6, 1–20.
[9]
Al-Wassai, F.A.; Kalyankar, N.V.; Al-Zaky, A.A. Spatial and spectral quality evaluation based on edges regions of satellite image fusion. Int. J. Latest Technol. Eng. Manag. Appl. Sci. 2012, I, 124–138.
[10]
Ranchin, T.; Wald, L. Comparison of Different Algorithms for the Improvement of the Spatial Resolution of Images. Proceedings of the 24th EARSeL Symposium “Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Image, Sophia Antipolis, France, 26–28 January 2000.
[11]
Wald, L.; Ranchin, T.; Mangolini, M. Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images. Photogramm. Eng. Remote Sens 1997, 63, 691–699.
[12]
Wald, L. Quality of High Resolution Synthesized Images: Is There a Simple Criterion? Proceedings of the Third Conference Fusion of Earth data: Merging Point Measurements, Raster Maps and Remotely Sensed Images, Sophia Antipolis, France, 26–28 January 2000.
[13]
Zhou, J.; Civco, D.; Silander, J. A wavelet transform method to merge Landsat TM and SPOT panchromatic data. Int. J. Remote Sens 1998, 19, 743–757.
[14]
Al-Wassai, F.A.; Kalyankar, N.V. A Novel Metric Approach Evaluation for the Spatial Enhancement of Pansharpened Images. Proceedings of International Conference of Advanced Computer Science & Information Technology, Chennai, India, 15 July 2012.
[15]
Wang, Z.; Bovik, A.C. A universal image quality index. IEEE Signal Process. Lett 2002, 9, 81–84.
[16]
Thomas, C.; Wald, L. A MTF-Based Distance for the Assessment of Geometrical Quality of Fused Products. Proceedings of 2006 29th International Conference on Information Fusion, Florence, Italy, 10–13 July 2006.
Khan, M.M.; Alparone, L.; Chanussot, J. Pansharpening quality assessment using the modulation transfer functions of instruments. IEEE Trans. Geosci. Remote Sens 2009, 47, 3880–3891.
[19]
Kovesi, P. Image features from phase congruency. Videre J. Comput. Vis. Res 1999, 1, 2–26.
[20]
Civco, D.L.; Witharana, C. Assessing the spatial fidelity of resolution-enhanced imagery using fourier analysis: A proof-of-concept study. Proc. SPIE 2012, 8538, doi:10.1117/12.974703.
[21]
Barrett, H.; Swindell, W. Radiological Imaging-The Theory of Image Formation, Detection, and Processing; Academic Press: New York, NY, USA, 1981.
[22]
Choi, T.; Helder, D.L. Generic Sensor Modeling For Modulation Transfer Function (MTF) Estimation 2005. Proceedings of the Pecora 16 Global Priorities in Land Remote Sensing, Sioux Falls, South Dakota, USA, 23–27 October 2005.
[23]
Choi, T. IKONOS Satellite on Orbit Modulation Transfer Function (MTF) Measurement Using Edge and Pulse Method. Presented at Engineering South Dakota State University, Brookings, SD, USA, 19 March 2002.
[24]
Blanc, P.; Wald, L. A Review of Earth-Viewing Methods for In-Flight Assessment of Modulation Transfer Function and Noise of Optical Space Borne Sensors; MINES ParisTech: Paris, France, 2009. HAL-00745076.
[25]
Tu, T.M.; Su, S.C.; Shyn, H.C.; Huang, P.S. A new look at IHS-like image fusion methods. Inf. Fus 2001, 2, 177–186.
[26]
Xu, J.; Guan, Z.; Liu, J. An improved IHS fusion method for merging multi-spectral and panchromatic images considering sensor spectral response. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci 2008, 37, 1169–1174.
[27]
González-Audícana, M; Otazu, X.; Fors, O.; Seco, A. Comparison between Mallat’s and the “à trous” discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images. Int. J. Remote Sens. 2005, 26, 595–614.
[28]
Zhang, Y.; Hong, G. An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images. Inf. Fus 2005, 6, 225–234.
