We present a technique for the multi-sensor registration of featureless datasets based on the photogrammetric tracking of the acquisition systems in use. This method is developed for the in situ study of cultural heritage objects and is tested by digitizing a small canvas successively with a 3D digitization system and a multispectral camera while simultaneously tracking the acquisition systems with four cameras and using a cubic target frame with a side length of 500 mm. The achieved tracking accuracy is better than 0.03 mm spatially and 0.150 mrad angularly. This allows us to seamlessly register the 3D acquisitions and to project the multispectral acquisitions on the 3D model.
References
[1]
Pelagotti, A.; del Mastio, A.; de Rosa, A.; Piva, A. Multispectral imaging of paintings. IEEE Signal Process. Mag. 2008, 25, 27–36.
[2]
Arnaoutoglou, F.; Koutsoudis, A.; Pavlidis, G.; Tsioukas, V.; Chamzas, C. Towards a Versatile Handheld 3D Laser Scanner. Proceedings of the 7th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, Dresden, Germany, 25–27 September 2006.
[3]
Tsirliganis, N.C.; Arnaoutoglou, F.; Koutsoudis, A.; Pavlidis, G.; Chamzas, C. 3D-archGIS: Archiving cultural heritage in a 3D multimedia space. DigiCult. Inform. 2003, 6, 6–10.
[4]
Merritt, J.; Entwisle, D.; Monaghan, A. Integrated geoscience data, maps and 3D models for the City of Glasgow, UK. IAEG 2006, 394, 1–10.
[5]
Serna, S.P.; Schmedt, H.; Ritz, M.; Stork, A. Interactive Semantic Enrichment of 3D Cultural Heritage Collections. Proceedings of the 13th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, Brighton, UK, 19–21 November 2012.
[6]
Mansouri, A.; Lathuiliere, A.; Marzani, F.; Voisin, Y.; Gouton, P. Toward a 3D multispectral scanner: An application to multimedia. IEEE MultiMed. 2007, 14, 40–47.
[7]
Brusco, N.; Cortelazzo, G.M.; Capeleto, S.; Fedel, M.; Poletto, L.; Paviotti, A.; Tondello, G. A system for 3D modeling frescoed historical buildings with multispectral texture information. Mach. Vis. Appl. 2006, 17, 373–393.
[8]
Tonsho, K.; Akao, Y.; Tsumura, N.; Miyake, Y. Development of gonio-photometric imaging system for recording reflectance spectra of 3D objects. Proc. SPIE 2001, 4663, 370–378.
[9]
Sitnik, R.; Mczkowski, G.; Krzeslowski, J. Integrated shape, color, and reflectivity measurement method for 3D digitization of cultural heritage objects. Proc. SPIE 2010, 7526, 1–10.
[10]
Bianco, G.; Bruno, F.; Tonazzini, A.; Salerno, E.; Savino, P.; Zitova, B.; Sroubek, F.; Console, E. A. Framework for Virtual Restoration of Ancient Documents by Combination of Multispectral and 3D Imaging; Puppo, E., Brogni, A., de Floriani, L., Eds.; Eurographics Italian Chapter Conference: Genova, Italy, 2010.
[11]
Tsai, R. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Autom. 1987, 3, 323–344.
[12]
Pulli, K. Surface Reconstruction and Display from Range and Color Data. Ph.D. Thesis, University of Washington, Seattle, WA, USA, 1997.
[13]
Rocchini, C.; Cignoni, P.; Montani, C.; Scopigno, R. Acquiring, stitching and blending diffuse appearance attributes on 3D models. Vis. Comput. 2002, 18, 186–204.
[14]
Viola, P.; Wells, W.M.I. Alignment by maximization of mutual information. Int. J. Comput. Vis. 1997, 24, 137–154.
[15]
Maes, F.; Collignon, A.; Vandermeulen, D.; Marchal, G.; Suetens, P. Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imag. 1997, 16, 187–198.
[16]
Remondino, F.; Pelagotti, A.; Del Mastio, A.; Uccheddu, F. Novel Data Registration Techniques for Art Diagnostics and 3D Heritage Visualization. Proceedings of the 9th Conference on Optical 3D Measurement Techniques, Vienna, Austria, 1–3 July 2009.
[17]
Palma, G.; Corsini, M.; Dellepiane, M.; Scopigno, R. Improving 2D-3D Registration by Mutual Information Using Gradient Maps; Puppo, E., Brogni, A., de Floriani, L., Eds.; Eurographics Italian Chapter Conference: Genova, Italy, 2010; pp. 89–94.
[18]
Corsini, M.; Dellepiane, M.; Ponchio, F.; Scopigno, R. Image-to-geometry registration: A mutual information method exploiting illumination-related geometric properties. Comput. Graph. Forum 2009, 28, 1755–1764.
[19]
Raab, F.H.; Blood, E.B.; Steiner, T.O.; Jones, H.R. Magnetic position and orientation tracking system. IEEE Trans. Aero. Electron. Syst. 1979, 15, 709–718.
[20]
Paperno, E.; Sasada, I.; Leonovich, E. A new method for magnetic position and orientation tracking. IEEE Trans. Magn. 2001, 37, 1938–1940.
[21]
Sherman, J.T.; Lubkert, J.K.; Popovic, R.S.; DiSilvestro, M.R. Characterization of a novel magnetic tracking system. IEEE Trans. Magn. 2007, 43, 2725–2727.
[22]
Bernardini, F.; Rushmeier, H.; Martin, I.M.; Mittleman, J.; Taubin, G. Building a digital model of michelangelo's florentine pietà. IEEE Comput. Graph. Appl. 2002, 22, 59–67.
[23]
Karaszewski, M.; Sitnik, R.; Bunsch, E. On-line, collision-free positioning of a scanner during fully automated three-dimensional measurement of cultural heritage objects. Robot. Autonom. Syst. 2012, 60, 1205–1219.
[24]
Leica. T-Scan. Available online: http://metrology.leica-geosystems.com/en/Leica-T-Scan_1836.htm (accessed on 21 September 2012).
[25]
Steinbichler. T-Scan 3. Available online: http://www.steinbichler.com/products/surface-scanning/3d-digitizing/t-scan-3.html (accessed on 21 September 2012).
[26]
Creaform. MetraScan 70 and 120. Available online: http://www.creaform3d.com/en/metrology-solutions/optical-3d-scanner-metrascan (accessed on 21 September 2012).
[27]
NDI. ScanTrak. Available online: http://www.ndigital.com/industrial/optotrakproseries-models.php (accessed on 21 September 2012).
[28]
Blais, F.; Taylor, J.; Beraldin, J.A.; Godin, G.; Cournoyer, L.; Picard, M.; Borgeat, L.; Dicaire, L.; Rioux, M.; Lahanier, C.; Aitken, G. Ultra-high resolution imaging at 50？？m using a portable XYZ-RGB color laser scanner. In International Workshop on Recording, Modeling and Visualization of Cultural Heritage; Taylor & Francis: Ascona, Switzerland, 2005.
[29]
Luhmann, T. Close range photogrammetry for industrial applications. ISPRS J. Photogramm. Rem. Sens. 2010, 65, 558–569.
[30]
Simon, C.; Schütze, R.; Boochs, F.; Marzani, F.S. Asserting the precise position of 3D and multispectral acquisition systems for multisensor registration applied to cultural heritage analysis. In Advances in Multimedia Modeling LNCS 7131; Schoeffmann, K., Merialdo, B., Hauptmann, A.G., Ngo, C.W., Andreopoulos, Y., Breiteneder, C., Eds.; Springer-Verlag: Heidelberg, Germany, 2012; pp. 597–608.
[31]
FluxData. The FD-1665-MS 7 Channel Camera. Available online: http://www.fluxdata.com/products/fd-1665-ms7 (accessed on 18 October 2012).
[32]
Berns, R.S.; Taplin, L.; Nezamabadi, M.; Mohammadi, M.; Zhao, Y. Spectral Imaging Using a Commercial Color-Filter Array Digital Camera. Proceedings of the 14th Triennial ICOM-CC Meeting, Citeseer, The Netherlands, 12–16 September 2005. Volume 2.
[33]
Mansouri, A.; Marzani, F.S.; Gouton, P. Neural networks in two cascade algorithms for spectral reflectance reconstruction. IEEE Int. Conf. Image Process. 2005, 2, 718–721.
[34]
Gom. ATOS-Industrial 3D Scanning Technology. Available online: http://www.gom.com/metrology-systems/3d-scanner.html (accessed on 6 October 2012).
[35]
Gom. Tritop Deformation Software. Available online: http://www.gom.com/3d-software/tritop-deformation-software.html (accessed on 10 December 2012).
[36]
Axios3D. Axori Photogrammetric Bundle Block Adjustment, AXOriLib 1.10.8. Available online: http://www.axios3d.de (accessed on 10 December 2012).
[37]
Besl, P.J.; McKay, N.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14, 239–256.
[38]
Rusinkiewicz, S.; Levoy, M. Efficient Variants of the ICP Algorithm. Proceedings of the 3rd International Conference on 3-D Digital Imaging and Modeling, Quebec, Canada, 28 May-1 June 2001; pp. 145–152.
