Numerous satellites collect imagery of the Earth’s surface daily, providing information to the public and private sectors. The fusion (pan-sharpening) of high-resolution panchromatic satellite imagery with lower-resolution multispectral satellite imagery has shown promise for monitoring natural resources and farming areas. It results in new imagery with more detail than the original multispectral or panchromatic images. In agricultural areas in Mississippi, landscapes can range from complex mixtures of vegetation and built-up areas to dense vegetative regions. More information is needed on pan-sharpened imagery for assessing landscapes in rural areas of Mississippi. WorldView 3 satellite imagery consisting of landscapes commonly found in rural areas of Mississippi was subjected to 17 pan-sharpening algorithms. The pan-sharpened images were compared qualitatively and quantitatively with three quality indices: 1) Erreur Relative Globale Addimensionelle de Synthese; 2) Universal Image Quality Index; 3) Bias. à trous wavelet transform with the injection model 3 and hyperspherical color spaced fusion methods were ranked among the best for maintaining image integrity for qualitative and quantitative analyses. The optimized high-pass filter method was often ranked last by the quality indices. The smoothing filter-based intensity modulation algorithm and the gaussian modulation transfer function match filtered with high-pass modulation injection model added artifacts to the images. Pan-sharpened satellite imagery has great potential to enhance the survey of Mississippi’s agricultural areas. The key to success is selecting an image fusion process that increases spatial content while not compromising the image integrity.
References
[1]
Wald, L. (2000) Quality of High Resolution Synthesized Images: Is There a Simple Criterion? In: Ranchin, T. and Wald, L., Eds., Third Conference “Fusion of Earth Data: Merging Point Measurements, Raster Maps and Remotely Sensed Images”, SEE/URISCA, Sophia Antipolis, 99-103. https://hal.archives-ouvertes.fr/hal-00395027
[2]
Vivone, G. (2019) Robust Band-Dependent Spatial-Detail Approaches for Panchromatic Sharpening. IEEE Transactions on Geoscience and Remote Sensing, 57, 6421-6433. https://doi.org/10.1109/TGRS.2019.2906073
[3]
Vivone, G., Alparone, L., Chanussot, J., Dalla Mura, M., Garzelli, A., Licciardi, G.A., Restaino, R. and Wald, L. (2015) A Critical Comparison among Pansharpening Algorithms. IEEE Transactions on Geoscience and Remote Sensing, 53, 2565-2586. https://doi.org/10.1109/TGRS.2014.2361734
[4]
Alparone, L., Aiazzi, B., Baronti, S., Garzelli, A., Nencini, F. and Selva, M. (2008) Multispectral and Panchromatic Data Fusion Assessment without Reference. Photogrammetric Engineering & Remote Sensing, 74, 193-200. https://doi.org/10.14358/PERS.74.2.193
[5]
Loncan, L., Almeida, L.B., Bioucas-Dias, J.M., Briottet, X., Chanussot, J., Dobigeon, N., Fabre, S., Liao, W., Licciardi, G.A., Simões, M., Tourneret, J.-Y., Veganzones, M.A., Vivone, G., Wei, Q. and Yokoya, N. (2015, April 17) Hyperspectral Pansharpening: A Review. http://arxiv.org/abs/1504.04531
[6]
Vaiopoulos, A. and Karantzalos, K. (2016) Pansharpening on the Narrow VNIR and SWIR Spectral Bands of Sentinel-2. ISPRS International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLI-B7, 723-730. https://doi.org/10.5194/isprsarchives-XLI-B7-723-2016
[7]
Thomas, C., Ranchin, T., Wald, L. and Chanussot, J. (2008) Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics. IEEE Transactions on Geoscience and Remote Sensing, 46, 1301-1312. https://doi.org/10.1109/TGRS.2007.912448
[8]
Garzelli, A. (2016) A Review of Image Fusion Algorithms Based on the Super-Resolution Paradigm. Remote Sensing, 8, 797. https://doi.org/10.3390/rs8100797
[9]
Kahraman, S. and Ertürk, A. (2017) A Comprehensive Review of Pansharpening Algorithms for Göktürk-2 Satellite Images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-4/W4, 263-270. https://doi.org/10.5194/isprs-annals-IV-4-W4-263-2017
[10]
Yang, X.H. and Jiao, L.C. (2008) Fusion Algorithm for Remote Sensing Images Based on Nonsubsampled Contourlet Transform. Acta Automatica Sinica, 34, 274-281. https://doi.org/10.3724/SP.J.1004.2008.00274
[11]
Saeedi, J. and Faez, K. (2011) A New Pan-Sharpening Method Using Multiobjective Particle Swarm Optimization and the Shiftable Contourlet Transform. ISPRS Journal of Photogrammetry and Remote Sensing, 66, 365-381. https://doi.org/10.1016/j.isprsjprs.2011.01.006
[12]
Amarsaikhan, D., Blotevogel, H.H., Van Genderen, J.L., Ganzorig, M., Gantuya, R. and Nergui, B. (2010) Fusing High-Resolution SAR and Optical Imagery for Improved Urban Land Cover Study and Classification. International Journal of Image and Data Fusion, 1, 83-97. https://doi.org/10.1080/19479830903562041
[13]
Gilbertson, J.K., Kemp, J. and van Niekerk, A. (2017) Effect of Pan-Sharpening Multi-Temporal Landsat 8 Imagery for Crop Type Differentiation Using Different Classification Techniques. Computers and Electronics in Agriculture, 134, 151-159. https://doi.org/10.1016/j.compag.2016.12.006
[14]
Xu, Y., Smith, S.E., Grunwald, S., Abd-Elrahman, A. and Wani, S.P. (2018) Effects of Image Pansharpening on Soil Total Nitrogen Prediction Models in South India. Geoderma, 320, 52-66. https://doi.org/10.1016/j.geoderma.2018.01.017
[15]
Fleming, S., Jordan, T., Madden, M., Usery, E.L. and Welch, R. (2009) GIS Applications for Military Operations in Coastal Zones. ISPRS Journal of Photogrammetry and Remote Sensing, 64, 213-222. https://doi.org/10.1016/j.isprsjprs.2008.10.004
[16]
Carper, W.J., Lillesand, T.M. and Kiefer, R.W. (1990) The Use of Intensity-Hue-Saturation Transformations for Merging SPOT Panchromatic and Multispectral Image Data. Photogrammetric Engineering and Remote Sensing, 56, 459-467.
[17]
Al-Wassai, F.A. and Kalyankar, N.V. (2011) The IHS Transformations Based Image Fusion. International Journal of Advanced Research in Computer Science, 2, 70-77.
[18]
Zhou, X., Liu, J., Liu, S., Cao, L., Zhou, Q. and Huang, H. (2014) A GIHS-Based Spectral Preservation Fusion Method for Remote Sensing Images Using Edge Restored Spectral Modulation. ISPRS Journal of Photogrammetry and Remote Sensing, 88, 16-27. https://doi.org/10.1016/j.isprsjprs.2013.11.011
[19]
Welch, R. and Ehlers, M. (1987) Merging Multiresolution SPOT HRV and Landsat TM Data. Photogrammetric Engineering and Remote Sensing, 53, 301-303.
[20]
Aiazzi, B., Baronti, S., Selva, M. and Alparone, L. (2007) MS + Pan Image Fusion by an Enhanced Gram-Schmidt Spectral Sharpening. In: Bochenek, Z., Ed., New Developments and Challenges in Remote Sensing, Millpress, Rotterdam, 113-120.
[21]
Maurer, T. (2013) How to Pan-Sharpen Images Using the Gram-Schmidt Pan-Sharpen Method—A Recipe. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-1/W1, 239-244. https://doi.org/10.5194/isprsarchives-XL-1-W1-239-2013
[22]
Aiazzi, B., Baronti, S. and Selva, M. (2007) Improving Component Substitution Pansharpening through Multivariate Regression of MS + Pan Data. IEEE Transactions on Geoscience and Remote Sensing, 45, 3230-3239. https://doi.org/10.1109/TGRS.2007.901007
[23]
Li, X., Chen, H., Zhou, J. and Wang, Y. (2020) Improving Component Substitution Pan-Sharpening through Refinement of the Injection Detail. Photogrammetric Engineering & Remote Sensing, 86, 317-325. https://doi.org/10.14358/PERS.86.5.317
[24]
Teggi, S., Cecchi, R. and Serafini, F. (2003) TM and IRS-1C-PAN Data Fusion Using Multiresolution Decomposition Methods Based on the “a Tròus” Algorithm. International Journal of Remote Sensing, 24, 1287-1301. https://doi.org/10.1080/01431160210144561
[25]
Amolins, K., Zhang, Y. and Dare, P. (2007) Wavelet Based Image Fusion Techniques—An Introduction, Review and Comparison. ISPRS Journal of Photogrammetry and Remote Sensing, 62, 249-263. https://doi.org/10.1016/j.isprsjprs.2007.05.009
[26]
Dong, L., Yang, Q., Wu, H., Xiao, H. and Xu, M. (2015) High Quality Multispectral and Panchromatic Image Fusion Technologies Based on Curvelet Transform. Neurocomputing, 159, 268-274. https://doi.org/10.1016/j.neucom.2015.01.050
[27]
Gonzalez-Audicana, M., Saleta, J.L., Catalan, R.G. and Garcia, R. (2004) Fusion of Multispectral and Panchromatic Images Using Improved IHS and PCA Mergers Based on Wavelet Decomposition. IEEE Transactions on Geoscience and Remote Sensing, 42, 1291-1299. https://doi.org/10.1109/TGRS.2004.825593
[28]
Chen, F., Qin, F., Peng, G. and Chen, S. (2012) Fusion of Remote Sensing Images Using Improved ICA Mergers Based on Wavelet Decomposition. Procedia Engineering, 29, 2938-2943. https://doi.org/10.1016/j.proeng.2012.01.418
[29]
Padwick, C., Deskevich, M., Pacifici, F. and Smallwood, S. (2010) Worldview2 Pan-Sharperning. ASPRS 2010 Annual Conference, San Diego, 26-30 April 2010, 14.
[30]
Chikr El-Mezouar, M., Kpalma, K., Taleb, N. and Ronsin, J. (2014) A Pan-Sharpening Based on the Non-Subsampled Contourlet Transform: Application to Worldview-2 Imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7, 1806-1815. https://doi.org/10.1109/JSTARS.2014.2306332
[31]
Lillo-Saavedra, M., Gonzalo-Martín, C., García-Pedrero, A. and Lagos, O. (2016) Scale-Aware Pansharpening Algorithm for Agricultural Fragmented Landscapes. Remote Sensing, 8, 870. https://doi.org/10.3390/rs8100870
[32]
QGIS Development Team (2021) QGIS Geographic Information System. Open Source Geospatial Foundation Project. http://qgis.osgeo.org
[33]
Zhang, X. and Li, D. (2001) Trous Wavelet Decomposition Applied to Image Edge Detection. Annals of GIS, 7, 119-123. https://doi.org/10.1080/10824000109480563
[34]
Otazu, X., Gonzalez-Audicana, M., Fors, O. and Nunez, J. (2005) Introduction of Sensor Spectral Response into Image Fusion Methods. Application to Wavelet-Based Methods. IEEE Transactions on Geoscience and Remote Sensing, 43, 2376-2385. https://doi.org/10.1109/TGRS.2005.856106
[35]
Liu, J.G. (2000) Smoothing Filter-Based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details. International Journal of Remote Sensing, 21, 3461-3472. https://doi.org/10.1080/014311600750037499
[36]
Addesso, P., Restaino, R. and Vivone, G. (2021) An Improved Version of the Generalized Laplacian Pyramid Algorithm for Pansharpening. Remote Sensing, 13, 3386-3405. https://doi.org/10.3390/rs13173386
[37]
Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A. and Selva, M. (2006) MTF-Tailored Multiscale Fusion of High-Resolution MS and Pan Imagery. Photogrammetric Engineering & Remote Sensing, 72, 591-596. https://doi.org/10.14358/PERS.72.5.591
[38]
Benzenati, T., Kessentini, Y., Kallel, A. and Hallabia, H. (2019) Generalized Laplacian Pyramid Pan-Sharpening Gain Injection Prediction Based on CNN. IEEE Geoscience and Remote Sensing Letters, 99, 1-5.
[39]
Chavez, P.S. (1988) Comparison of the Spectral Information Content of Landsat Thematic Mapper and SPOT for Three Different Sites in the Phoenix, Arizona Region. Photogrammetric Engineering and Remote Sensing, 54, 1699-1708.
[40]
Laben, C.A. and Brower, B.V. (2000, January 4) Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening. https://patents.google.com/patent/US6011875A/en
[41]
Jat, M., Garg, P. and Dahiya, S. (2013) A Comparative Study of Various Pixel Based Image Fusion Techniques as Applied to an Urban Environment. International Journal of Image and Data Fusion, 4, 197-213. https://doi.org/10.1080/19479832.2013.778335
[42]
Ranchin, T. and Wald, L. (2000) Fusion of High Spatial and Spectral Resolution Images: The ARSlS Concept and Its Implementation. Photogrammetric Engineering and Remote Sensing, 66, 49-61.
[43]
de Béthune, S., Muller, F. and Donnay, J.-P. (1998) Fusion of Multispectral and Panchromatic Images by Local Mean and Variance Matching Filtering Techniques. Proceedings of the 2nd International Conference—Fusion of Earth Data Merging Point Measurements, Raster Maps and Remotely Sensed Images, Antipolis, 28-30 January 1998, 31-36.
[44]
de Béthune, S., Muller, F. and Binard, M. (1997) Adaptive Intensity Matching Filters: A New Tool for Multiresolution Data Fusion. Proceedings of the AGARD Conference 595, Multi-Sensor Systems and Data Fusion for Telecommunications, Remote Sensing and Radar, Lisbon, 29 September-2 October 1997, 28:1-28:15.
[45]
Gillespie, A.R., Kahle, A.B. and Walker, R.E. (1987) Color Enhancement of Highly Correlated Images. II. Channel Ratio and “Chromaticity” Transformation Techniques. Remote Sensing of Environment, 22, 343-365. https://doi.org/10.1016/0034-4257(87)90088-5
[46]
Choi, M. (2006) A New Intensity-Hue-Saturation Fusion Approach to Image Fusion with a Tradeoff Parameter. IEEE Transactions on Geoscience and Remote Sensing, 44, 1672-1682. https://doi.org/10.1109/TGRS.2006.869923
[47]
Chaudhary, S.K., Kumar, D. and Jain, M.K. (2016) Performance Analysis of Hyperspherical Colour Sharpening Method for IRS Satellite Images. The Imaging Science Journal, 64, 305-312. https://doi.org/10.1080/13682199.2016.1190898
[48]
Nikolakopoulos, K. and Oikonomidis, D. (2015) Quality Assessment of Ten Fusion Techniques Applied on Worldview-2. European Journal of Remote Sensing, 48, 141-167. https://doi.org/10.5721/EuJRS20154809
[49]
Jawak, S.D. and Luis, A.J. (2013) A Comprehensive Evaluation of PAN-Sharpening Algorithms Coupled with Resampling Methods for Image Synthesis of Very High Resolution Remotely Sensed Satellite Data. Advances in Remote Sensing, 2, 332-344. https://doi.org/10.4236/ars.2013.24036
[50]
Johnson, B. (2014) Effects of Pansharpening on Vegetation Indices. ISPRS International Journal of Geo-Information, 3, 507-522. https://doi.org/10.3390/ijgi3020507
[51]
Wang, Z. and Bovik, A.C. (2002) A Universal Image Quality Index. IEEE Signal Processing Letters, 9, 81-84. https://doi.org/10.1109/97.995823
