Time-of-flight cameras, based on Photonic Mixer Device (PMD) technology, are capable of measuring distances to objects at high frame rates, however, the measured ranges and the intensity data contain systematic errors that need to be corrected. In this paper, a new integrated range camera self-calibration method via joint setup with a digital (RGB) camera is presented. This method can simultaneously estimate the systematic range error parameters as well as the interior and external orientation parameters of the camera. The calibration approach is based on photogrammetric bundle adjustment of observation equations originating from collinearity condition and a range errors model. Addition of a digital camera to the calibration process overcomes the limitations of small field of view and low pixel resolution of the range camera. The tests are performed on a dataset captured by a PMD[vision]-O3 camera from a multi-resolution test field of high contrast targets. An average improvement of 83% in RMS of range error and 72% in RMS of coordinate residual, over that achieved with basic calibration, was realized in an independent accuracy assessment. Our proposed calibration method also achieved 25% and 36% improvement on RMS of range error and coordinate residual, respectively, over that obtained by integrated calibration of the single PMD camera.
References
[1]
Natroshvili, K; Schmid, M; Stephan, M; Stiegler, A; Schamm, T. Real Time Pedestrian Detection by Fusing PMD and CMOS Cameras. Proceedings of the IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands, 4–6 June 2008; pp. 925–929.
[2]
Van den Bergh, M; Van Gool, L. Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction. Proceedings of the IEEE Workshop on Applications of Computer Vision, Kona, HI, USA, 5–7 January 2011; pp. 66–72.
[3]
Prusak, A; Melnychuk, O; Roth, H; Schiller, I; Koch, R. Pose estimation and map building with a Time-of-Flight camera for robot navigation. Int. J. Intell. Syst. Technol. Appl 2008, 5, 355–364.
[4]
Hochdorfer, S; Schlegel, C. 6 DoF SLAM Using a ToF Camera: The Challenge of a Continuously Growing Number of Landmarks. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 December 2010; pp. 3981–3986.
[5]
Rapp, H; Frank, M; Hamprecht, FA; J？hne, B. Theoretical and experimental investigation of the systematic errors and statistical uncertainties of Time-of-Flight cameras. Int. J. Intell. Syst. Technol. Appl 2008, 5, 402–413.
[6]
Reulke, R. Combination of distance data with high resolution images. Proceedings of ISPRS Commission V Symposium Image Engineering and Vision Metrology, 25–27 September 2006; Dresden, Germany. Part 3/W52..
[7]
Santrac, N; Friedland, G; Rojas, R. High Resolution Segmentation with a Time-of-Flight 3D-Camera Using the Example of a Lecture Scene, Technical Report B-06-09; 2006. Available online: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.149.7888&rep=rep1&type=pdf (accessed on 16 Auguest 2011).
[8]
Beder, C; Koch, R. Calibration of focal length and 3D pose based on the reflectance and depth. Int. J. Intell. Syst. Technol. Appl 2008, 5, 285–294.
[9]
Kahlmann, T; Remondino, F; Ingensand, H. Calibration for increased accuracy of the range imaging camera SwissRanger. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Paris, France, 1–3 September 2006; pp. 136–141.
[10]
Lindner, M; Kolb, A. Lateral and depth calibration of PMD-distance sensors. Lect Note Comput Sci 2006, 4292, 524–533.s.
[11]
Lindner, M; Kolb, A. Calibration of the Intensity-Related Distance Error of the PMD TOF-Camera. Proceedings of the SPIE Intelligent Robots and Computer Vision XXV, Boston, MA, USA, 16 July 2007; pp. 6764–6735.
[12]
Fuchs, S; Hirzinger, G. Extrinsic and Depth Calibration of ToF Cameras. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA, 24–26 June 2008; pp. 1–6.
[13]
Schiller, I; Beder, C; Koch, R. Calibration of a PMD-camera using a planar calibration pattern together with a multi-camera setup. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Beijing, China, 3–11 July 2008; pp. 297–302.
[14]
Lindner, M; Schiller, I; Kolb, A; Koch, R. Time-of-flight sensor calibration for accurate range sensing. Comput. Vis. Image Underst 2010, 114, 1318–1328, doi:10.1016/j.cviu.2009.11.002.
[15]
Karel, W. Integrated range camera calibration using image sequences from hand-held operation. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci 2008, 37, 945–951.
[16]
Kager, H; Rottensteiner, F; Kerschner, M; Stadler, P. Orpheus 3.2.1 User Manual; Institute of Photogrammetry and Remote Sensing, Vienna University of Technology: Vienna, Austria, 2002.
[17]
Robbins, S; Murawski, B; Schroeder, B. Photogrammetric calibration and colorization of the swissranger SR-3100 3-D range imaging sensor. Opt. Eng 2009, 48, 1–8.
[18]
Chiabrando, FC; hiabrando, R; Piatti, D; Rinaudo, F. Sensors for 3D imaging: Metric evaluation and calibration of a CCD/CMOS time-of-flight camera. Sensors 2009, 9, 10080–10096, doi:10.3390/s91210080. 22303163
[19]
Pattinson, T. Quantification and Description of Distance Measurement Errors of a Time-of-Flight CameraM.Sc. Thesis. University of Stuttgart, Stuttgart, Germany, 2010.
[20]
Lichti, DD. Self-calibration of a 3D range camera. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci 2008, 37, 927–932.
[21]
Lichti, DD; Kim, C; Jamtsho, S. An integrated bundle adjustment approach to range camera geometric self-calibration. ISPRS J. Photogramm 2010, 65, 360–368, doi:10.1016/j.isprsjprs.2010.04.002.
[22]
Westfeld, P; Mulsow, C; Schulze, M. Photogrammetric Calibration of Range Imaging Sensors Using Intensity and Range Information Simultaneously. Proceedings of the Optical 3-D Measurement Techniques IX, Vienna, Austria, 1–3 July 2009; pp. 1–10.
[23]
Lichti, DD; Kim, C. A comparison of three geometric self-calibration methods for range cameras. Remote Sens 2011, 3, 1014–1028, doi:10.3390/rs3051014.
[24]
Moller, T; Kraft, H; Frey, J; Albrecht, M; Lange, R. Robust 3D Measurement with PMD Sensors. Proceedings of the First Range Imaging Research Day, ETH Zurich, Switzerland, 8–9 September 2005.
[25]
Luhmann, T; Robson, S; Kyle, S; Harley, I. Close Range Photogrammetry: Principles, Techniques and Applications; John Wiley & Sons: Hoboken, NJ, USA, 2007.
[26]
Fraser, CS. Digital camera self-calibration. ISPRS J. Photogramm 1997, 52, 149–159, doi:10.1016/S0924-2716(97)00005-1.
[27]
Fuchs, S; May, S. Calibration and registration for precise surface reconstruction with time-of-flight cameras. Int. J. Intell. Syst. Technol. Appl 2008, 5, 274–284.
[28]
Du, H; Oggier, T; Lustenburger, F; Charbon, E. A Virtual Keyboard Based on True-3D Optical Ranging. Proceedings of the British Machine Vision Conference, Oxford, UK, 5–8 September 2005; pp. 1–10.
[29]
Mikhail, EM. Observations and Least Squares; IEP-A Dun-Donelley: New York, NY, USA, 1976.
[30]
Yang, Y. Robust estimation for dependent observation. Manuscr. Geod 1994, 19, 10–17.
[31]
Rufli, M; Scaramuzza, D; Siegwart, R. Automatic Detection of Checkerboards on Blurred and Distorted Images. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France, 22–26 September 2008; pp. 3121–3126.
[32]
Zhong, D. Robust estimation and optimal selection of polynomial parameters for the interpolation of GPS geoid heights. J. Geod 1997, 71, 552–561, doi:10.1007/s001900050123.
[33]
Wolf, PR; Dewitt, BA. Elements of Photogrammetry: With Applications in GIS, 3rd ed ed.; The McGraw-Hill Companies: Boston, MA, USA, 2000.
