Images from high dynamic range (HDR) scenes must be obtained with minimum loss of information. For this purpose it is necessary to take full advantage of the quantification levels provided by the CCD/CMOS image sensor. LinLog CMOS sensors satisfy the above demand by offering an adjustable response curve that combines linear and logarithmic responses. This paper presents a novel method to quickly adjust the parameters that control the response curve of a LinLog CMOS image sensor. We propose to use an Adaptive Proportional-Integral-Derivative controller to adjust the exposure time of the sensor, together with control algorithms based on the saturation level and the entropy of the images. With this method the sensor’s maximum dynamic range (120 dB) can be used to acquire good quality images from HDR scenes with fast, automatic adaptation to scene conditions. Adaptation to a new scene is rapid, with a sensor response adjustment of less than eight frames when working in real time video mode. At least 67% of the scene entropy can be retained with this method.
References
[1]
Reinhard, E; Ward, G; Pattanaik, S; Debevec, P. High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting; Elsevier/Morgan Kaufmann: Amsterdam, The Netherlands, 2006; pp. 7–18.
[2]
Bandoh, Y; Qiu, G; Okuda, M; Daly, S; Aach, T; Au, OC. Recent Advances in High Dynamic Range Imaging Technology. Proceedings of the 17th IEEE International Conference on Image Processing, ICIP’10, Hong Kong, China, 26–29 September 2010; pp. 3125–3128.
[3]
Llorca, DF; Sánchez, S; Oca？a, M; Sotelo, MA. Vision-based traffic data collection sensor for automotive applications. Sensors 2010, 10, 860–875.
[4]
Foresti, GL; Micheloni, C; Piciarelli, C; Snidaro, L. Review: Visual sensor technology for advanced surveillance systems: Historical view, technological aspects and research activities in Italy. Sensors 2009, 9, 2252–2270.
[5]
Navarro, PJ; Iborra, A; Fernández, C; Sánchez, P; Suardíaz, J. A sensor system for detection of hull surface defects. Sensors 2010, 10, 7067–7081.
[6]
Battiato, S; Castorina, A; Mancuso, M. High dynamic range imaging for digital still camera: An overview. J. Electron. Imag 2003, 12, 459–469.
[7]
Brauers, J; Schulte, N; Bell, A; Aach, T. Multispectral High Dynamic Range Imaging; IS/&T/SPIE Electronic Imaging: San Jose, CA, USA, 2008; pp. 680704:1–680704:12.
[8]
Hazelwood, M; Hutton, S; Weatherup, C. Smear Reduction in CCD ImagesUS Patent 7,808,534, 2010.
[9]
Burghartz, JN; Graf, H; Harendt, G; Klinger, W; Richter, H; Strobel, M. HDR CMOS Imagers and Their Applications. Proceedings of the 8th International Conference on Solid-State and Integrated Circuit Technology, ICSICT’06, Shanghai, China, 22–26 October 2006; pp. 528–531.
[10]
Nayar, SK; Mitsunaga, T. High Dynamic Range Imaging: Spatially Varying Pixel Exposures. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, USA, 13–15 June 2000; 1, pp. 472–479.
[11]
Bigas, M; Cabruja, E; Forest, J; Salvi, J. Review of CMOS image sensors. Microelectron. J 2006, 37, 433–451.
[12]
Dumont, GA; Huzmezan, M. Concepts, methods and techniques in adaptive control. Proceedings of the 2002 American Control Conference; 2002; pp. 1137–1150.
[13]
Bela, L. Instrument Engineers’ Handbook: Process Control; Chilton Book Company: Radnor, PA, USA, 1995; pp. 20–29.
[14]
Mohan, M; Sinha, A. Mathematical Model of the Simplest Fuzzy PID Controller with Asymmetric Fuzzy Sets. Proceedings of the 17th World Congress the International Federation of Automatic Control, Seoul, Korea, 6–11 July 2008; 7, pp. 15399–15404.
[15]
Chaínho, J; Pereira, P; Rafael, S; Pires, AJ. A Simple PID Controller with Adaptive Parameter in a dsPIC: A Case of Study. Proceedings of the 9th Spanish-Portuguese Congress on Electrical Engineering, Marbella, Spain, 30 June–2 July 2005.
[16]
Hang, CC; Astrom, JK; Wo, WK. Refinements of the Ziegler-Nichols tuning formula. IEEE Proc. Control Theory Appl 1991, 138, 111–118.
[17]
Navid, N; Roberts, J. Automatic Camera Exposure Control. Proceedings of the 2007 Australasian Conference on Robotics & Automation, Brisbane, Australia, 10–12 December 2007.
[18]
Neves, JA; Cunha, B; Pinho, A; Pinheiro, I. Autonomous Configuration of Parameters in Robotic Digital Cameras. Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis, IbPRIA’09, Póvoa de Varzim, Portugal, 10–12 June 2009.
[19]
Nilsson, M; Weerasinghe, C; Lichman, S; Shi, Y; Kharitonenko, I. Design and Implementation of a CMOS Sensor Based Video Camera Incorporating a Combined AWB/AEC Module. Proceedings of 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, (ICASSP '03), Hong Kong, China, 6？10 April 2003; 2, pp. 477–480.
[20]
Tsai, DY; Lee, Y; Matsuyama, E. Information entropy measure for evaluation of image quality. J Digital Imaging 2008, 21, 338–347.
[21]
Shannon, CE; Weaver, W. The Mathematical Theory of Communication; University of Illinois Press: Urbana, IL, USA, 1949.
[22]
Gray, RM. Entropy and Information Theory, 2nd ed ed.; Springer-Verlag Inc: New York, NY, USA, 2010; pp. 17–44.
[23]
Hendrix, EMT; Toth, BG. Introduction to Nonlinear and Global Optimization; Springer: Cambridge, UK, 2010.
[24]
Moneta, CA; de Natale, FGB; Vernazza, G. Adaptive Control in Visual Sensing. Proceedings of the IMACS International Symposium on Signal Processing, Robotics, and Neural Networks, Lille, France, 25–27 April 1994.
[25]
Malis, E. Improving Vision-Based Control Using Efficient Second-Order Minimization Techniques. Proceedings of the IEEE Internacional Conference on Robotics and Automation (ICRA’04), New Orleans, LA, USA, 26 April–1 May 2004.
[26]
Kabus, S; Netsch, T; Fischer, B; Modersitzki, J. B-spline registration of 3D images with levenberg-marquardt optimization. Proc. SPIE 2004, 5370, 304–313.
[27]
LabVIEW (Laboratory Virtual Instrumentation Engineering Workbench). National Instruments Corporation: Austin, TX, USA. Available online: http://www.ni.com/labview/ (accessed on 10 August 2011).
