In the last years, 3D-vision systems based on the time-of-flight (ToF) principle have gained more importance in order to obtain 3D information from the workspace. In this paper, an analysis of the use of 3D ToF cameras to guide a robot arm is performed. To do so, an adaptive method to simultaneous visual servo control and camera calibration is presented. Using this method a robot arm is guided by using range information obtained from a ToF camera. Furthermore, the self-calibration method obtains the adequate integration time to be used by the range camera in order to precisely determine the depth information.
References
[1]
Chaumette, F; Hutchinson, S. Visual servo control. I. Basic approaches. IEEE Robot. Autom. Mag？2006, 13, 82–90, doi:10.1109/MRA.2006.250573.
[2]
de Jong, F; Pieter, PJ. Visual Servoing in PCB Manufacturing. Proceedings of the 6th Annual Conference of the Advanced School for Computing and Imaging (ASCI), Lommel, Belgium, June 14–16, 2000; pp. 59–63.
[3]
Reiser, U; Kubacki, J. Using a 3D Time-of-Flight Range Camera for Visual Tracking. Proceedings of 6th IFAC Symposium on Intelligent Autonomous Vehicles, Toulouse, France, September 3–5, 2007.
[4]
Klank, U; Pangercic, D; Rusu, RB; Beetz, M. Real-time CAD Model Matching for Mobile Manipulation and Grasping. Proceedings of the 9th IEEE-RAS International Conference on Humanoid Robots (Humanoids), Paris, France, December 7–10, 2009.
[5]
Fuchs, S; Hirzinger, G. Extrinsic and Depth Calibration of ToF-cameras. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), Anchorage, AK, USA, June 24–26, 2008; pp. 1–6.
[6]
Khongsab, P. Signal Processing and Performance Evaluation of a PMD Camera for Space Docking. Master Thesis. Lulea University of Technology, Lule？, Sweden, 2009.
[7]
Lindner, M; Kolb, A. Calibration of the Intensity-Related Distance Error of the PMD TOF-Camera. Proceedings of SPIE XXV Conference on Intelligent Robots and Computer Vision, Boston, MA, USA, September 15–17, 2007; pp. 6764–6771.
[8]
Wiedemann, M; Sauer, M; Driewer, F; Schilling, K. Analysis and Characterization of the PMD Camera for Application in Mobile Robotics. Proceedings of the 17th IFAC World Congress, Coex, Korea, July 6–11, 2008; pp. 13689–13694.
[9]
May, S; Werner, B; Surmann, H; Perv？lz, K. 3D Time-of-flight Cameras for Mobile Robotics. Proceedings of IEEE Conference on Intelligent Robots and Systems (IROS 2006), Beijing, China, October 9–15, 2006; pp. 790–795.
[10]
Mure Dubois, J; Hugli, H. Fusion of Time of Flight Camera Point Clouds. Proceedings of Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications, Marseille, France, October 18, 2008.
[11]
Comport, AI; Marchand, E; Pressigout, M; Chaumette, F. Real-time Markerless Tracking for Augmented Reality: The Virtual Visual Servoing Framework. IEEE Trans. Visual. Comput. Gr？2006, 12, 615–628, doi:10.1109/TVCG.2006.78.
[12]
Marchand, E; Chaumette, F. Virtual Visual Servoing: A Framework for Real-time Augmented Reality. Computer Graphics Forum？2002, 21, 289–298, doi:10.1111/1467-8659.t01-1-00588.
[13]
Benhimane, S; Malis, E. Homography-based 2D Visual Tracking and Servoing. Int. J. Robot. Res？2007, 26, 661–676, doi:10.1177/0278364907080252.
[14]
Hadj-Abdelkader, H; Mezouar, Y; Martinet, P; Chaumette, F. Catadioptric Visual Servoing from 3D Straight Lines. IEEE Trans. Robot？2008, 24, 652–665, doi:10.1109/TRO.2008.919288.
[15]
Zhang, Z. Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece, September 20–27, 1999; 1, pp. 666–673.
[16]
Rapp, H. Experimental and Theorical Investigation of Correlating ToF Camera Systems. Master Thesis. University of Heidelberg, Heidelberg, Germany, September, 2007.
[17]
Gil, P; Pomares, J; Torres, F. Analysis and Adaptation of Integration Time in PMD Camera for Visual Servoing. Proceedings of 20th International Conference on Pattern Recongnition (ICPR 2010), Istanbul, Turkey, August 2010.
[18]
Pomares, J; Chaumette, F; Torres, F. Adaptive visual servoing by simultaneous camera calibration. Proceedings of IEEE International Conference on Robotics and Automation, Rome, Italy, April 10–14, 2007; pp. 2811–2816.
