Electro-optic (EO) image sensors exhibit the properties of high resolution and low noise level at daytime, but they do not work in dark environments. Infrared (IR) image sensors exhibit poor resolution and cannot separate objects with similar temperature. Therefore, we propose a novel framework of IR image enhancement based on the information (e.g., edge) from EO images, which improves the resolution of IR images and helps us distinguish objects at night. Our framework superimposing/blending the edges of the EO image onto the corresponding transformed IR image improves their resolution. In this framework, we adopt the theoretical point spread function (PSF) proposed by Hardie et al. for the IR image, which has the modulation transfer function (MTF) of a uniform detector array and the incoherent optical transfer function (OTF) of diffraction-limited optics. In addition, we design an inverse filter for the proposed PSF and use it for the IR image transformation. The framework requires four main steps: (1) inverse filter-based IR image transformation; (2) EO image edge detection; (3) registration; and (4) blending/superimposing of the obtained image pair. Simulation results show both blended and superimposed IR images, and demonstrate that blended IR images have better quality over the superimposed images. Additionally, based on the same steps, simulation result shows a blended IR image of better quality when only the original IR image is available.
References
[1]
Liu, G.; Sun, S.; Jing, Z. Image fusion based on an expectation maximization algorithm. Opt. Eng. 2005, 44, 386–389.
[2]
Zheng, Y.; Essock, E.A.; Hansen, B.C. Advanced discrete wavelet transform fusing algorithm and its optimization by using the metric of image quality index. Opt. Eng. 2004, 44, 037003.
[3]
Zheng, Y. Multi-Scale Fusion Algorithm Comparisons: Pyramid, DWT and Iterative DWT. Proceedings of the 12th International Conference on Fusion, Seattle, WA, USA, 6–9 2009; pp. 1060–1067.
[4]
Toet, A.; Hogervorst, M.A. Progress in color night vision. Opt. Eng. 2012, 51, 010901:1–010901:20.
[5]
Rodger, J.A. Toward reducing failure risk in an integrated vehicle health maintenance system: A fuzzy multi-sensor data fusion Kalman filter approach for IVHMS. Exp. Syst. Appl. 2012, 39, 9821–9836, doi:10.1016/j.eswa.2012.02.171.
Watson, E.A.; Muse, R.A.; Blommel, F.P. Aliasing and blurring in microscanned imagery. Proc. SPIE 1992, 1689, 242–250.
[8]
Hardie, R.C.; Barnard, K.J.; Bognar, J.G.; Armstrong, E.E.; Watson, E.A. High-resolution image reconstruction from a sequence of rotated and translated frames and its application to an infrared imaging system. Opt. Eng. 1998, 37, 247–260, doi:10.1117/1.601623.
[9]
Alam, M.S.; Bognar, J.G.; Hardie, R.C.; Yasuda, B.J. Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames. IEEE Trans. Instrum. Meas. 2000, 49, 915–923, doi:10.1109/19.872908.
[10]
Gonzalez, R.C.; Woods, R.E.; Eddins, S.L. Digital Image Processing Using Matlab, 2nd ed. ed.; Gatesmark: Knoxville, TN, USA, 2009.
[11]
Maini, R.; Aggarwal, H. Study and comparison of various image edge detection techniques. Int. J. Image Process. 2009, 3, 1–12, doi:10.1049/iet-ipr:20080080.
[12]
Huang, X.; Netravali, R.; Man, H.; Lawrence, V. Fusing Electro-Optic and Infrared Signals for High Resolution Night Images. Proc. SPIE 2012, 8295, 829510:1–829510:10.
[13]
Huang, X.; Netravali, R.; Man, H.; Lawrence, V. Improved Fusing Infrared and Electro-Optic Signals for High-Resolution Night Images. Proc. SPIE 2012, 8355, 835517:1–835517:10.
[14]
Jayaraman, S.; Esakkirajan, S.; Veerakumar, T. Digital Image Processing; McGraw Hill: New York, NY, USA, 2009.
