In recent years there has been a growing interest in the use of multimedia mobile guides in museum environments. Mobile devices have the capabilities to detect the user context and to provide pieces of information suitable to help visitors discover and follow the logical and emotional connections that develop during the visit. In this scenario, location based services (LBS) currently represent an asset, and the choice of the technology to determine users’ position, combined with the definition of methods that can effectively convey information, become key issues in the design process. In this work, we present Museum Assistant (MusA), a general framework for the development of multimedia interactive guides for mobile devices. Its main feature is a vision-based indoor positioning system that allows the provision of several LBS, from way-finding to the contextualized communication of cultural contents, aimed at providing a meaningful exploration of exhibits according to visitors’ personal interest and curiosity. Starting from the thorough description of the system architecture, the article presents the implementation of two mobile guides, developed to respectively address adults and children, and discusses the evaluation of the user experience and the visitors’ appreciation of these applications.
References
[1]
Boiano, S.; Bowen, J.; Gaia, G. Usability, Design and Content Issues of Mobile Apps for Cultural Heritage Promotion: The Malta Culture Guide Experience. Proceedings of the Computing Research Repository (CoRR), London, UK, 10–12 July 2012.
[2]
Proctor, N. Mobile Apps for Museums: The AAM Guide to Planning and Strategy; The American Association of Museums: Washington, DC, USA, 2011.
[3]
Economou, M.; Meintani, E. Promising Beginnings? Evaluating Museum Mobile Phone Apps. Proceedings of the Re-Thinking Technology in Museums: Emerging Experience Conference, Limerick, Ireland, 26–27 May 2011; pp. 87–101.
[4]
Kray, C.; Baus, J. A. Survey of Mobile Guides. Proceedings of HCI in Mobile Guides, in Conjunction with the 5th International Symposium on Human Computer Interaction with Mobile Devices and Services, Udine, Italy, 8–11 September 2003.
[5]
Raptis, D.; Tselios, N.; Avouris, N. Context-Based Design of Mobile Applications for Museums: A Survey of Existing Practices. Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services (MobileHCI '05), Salzburg, Austria, 19–22 September 2005; pp. 153–160.
[6]
Kenteris, M.; Gavalas, D.; Economou, D. Electronic mobile guides: A Survey. Pers. Ubiquitous Comput. 2011, 15, 97–111.
[7]
Emmanouilidis, C.; Koutsiamanis, R.; Tasidou, A. Mobile guides: Taxonomy of architectures, context awareness, technologies and applications. J. Netw. Comput. Appl. 2013, 36, 103–125.
[8]
Rounds, J. Strategies for the curiosity-driven museum visitor. Curator Mus. J. 2004, 47, 389–412.
[9]
Bitgood, S. An analysis of visitor circulation: Movement patterns and the general value principle. Curator Mus. J. 2006, 49, 463–475.
[10]
Mulloni, A.; Wagner, D.; Barakonyi, I.; Schmalstieg, D. Indoor positioning and navigation with camera phones. IEEE Pervas. Comput. 2009, 8, 22–31.
[11]
Campus Guiden. Available online: http://www.campusguiden.no/ (accessed on 30 September 2013).
[12]
Klopschitz, M.; Schall, G.; Schmalstieg, D.; Reitmayr, G. Visual Tracking for Augmented Reality. Proceedings of the 2010 International Conference on Indoor Positioning and Indoor Navigation (IPIN 2010), Zurich, Switzerland, 15–17 September 2010.
[13]
Yanying, G.; Lo, A.; Niemegeers, I. A survey of indoor positioning systems for wireless personal networks. IEEE Commun. Surv. Tutor. 2009, 1, 13–32.
[14]
Ruíz, B.; Pajares, J.L.; Utray, F.; Moreno, L. Design for all in multimedia guides for museums. Proc. Comput. Hum. Behav. 2011, 27, 1408–1415.
[15]
Kuflik, T.; Lanir, J.; Dim, E.; Wecker, A.; Corra, M.; Zancanaro, M.; Stock, O. Indoor Positioning in Cultural Heritage: Challenges and a Solution. Proceedings of the IEEE 27th Convention of Electrical & Electronics Engineers in Israel (IEEEI), Eilat, Israel, 14–17 November 2012.
[16]
Ghiani, G.; Paternò, F.; Santoro, C.; Spano, L.D. A Location-Aware Guide Based on Active RFIDs in Multi-Device Environments. In Computer-Aided Design of User Interfaces VI; Springer-Verlag: Albacete, Spain, 2008; pp. 59–70.
[17]
Ghiani, G.; Leporini, B.; Paternò, F. Vibrotactile feedback to aid blind users of mobile guides. J. Vis. Lang. Comput. 2009, 20, 305–317.
[18]
Huang, Y.; Wang, S.; Sandnes, F.E. RFID-based guide gives museum visitors more freedom. IT Prof. 2011, 13, 25–29.
[19]
Fevgas, A.; Tsompanopoulou, P.; Bozanis, P. iMuse Mobile Tour: A Personalized Multimedia Museum Guide Opens to Groups. Proceedings of IEEE Symposium on Computers and Communications (ISCC), Kerkyra, Greece, 28 June–1 July 2011; pp. 971–975.
[20]
Hsu, H.; Liao, H. A mobile RFID-based tour system with instant microblogging. J. Comput. Syst. Sci. 2011, 720–727.
[21]
Perry-Lube, L.; Lefkowitz, M. Explorer—Mobile Navigation and Interpretation at the American Museum of Natural History. Proceedings of the Museums and the Web 2011: The International Conference for Culture and Heritage On-Line, Philadelphia, PA, USA, 6–9 April 2011.
[22]
Bl?ckner, M.; Danti, S.; Forrai, J.; Broll, G.; Luca, A.D. Please Touch the Exhibits! Using NFC-Based Interaction for Exploring a Museum. Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09), Bonn, Germany, 15–18 September 2009.
[23]
Storms, W.; Shockley, J.; Raquet, J. Magnetic Field Navigation in an Indoor Environment. Proceedings of Positioning Indoor Navigation and Location Based Service (UPINLBS), Kirkkonummi, Finland, 14–15 October 2010.
[24]
Ciavarella, C.; Paternò, F. Design Criteria for Location-Aware, Indoor, PDA Applications. Proceedings of the 5th International Symposium, MobileHCI, Udine, Italy, September 2003; pp. 131–144.
[25]
Bihler, P.; Imhoff, P.; Cremers, A.B. SmartGuide–A smartphone museum guide with ultrasound control. Proced. Comput. Sci. 2011.
[26]
Mulloni, A.; Seichter, H.; Schmalstieg, D. Handheld Augmented Reality Indoor Navigation with Activity-Based Instructions. Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, Stockholm, Sweden, 30 August–2 September 2011; pp. 211–220.
[27]
Oppermann, R.; Specht, M. A Nomadic Information System for Adaptive Exhibition Guidance. Proceedings of the ICHIM99 Conference, Washington, DC, USA, 22–26 September 1999; pp. 103–109.
[28]
Stock, O.; Zancanaro, M. PEACH: Intelligent Interfaces for Museum Visits; Cognitive Technologies Series; Springer-Verlag: Berlin, Germany, 2006.
[29]
Serrell, B. Paying attention: The duration and allocation of visitors' time in museum exhibitions. Curator Mus. J. 1997, 40, 108–125.
[30]
Dean, D. Museum Exhibition: Theory and Practice; Routledge: London, UK, 1994.
[31]
Sparacino, F. The Museum Wearable: Real-Time Sensor-Driven Understanding of Visitors' Interests for Personalized Visually-Augmented Museum Experiences. Proceedings of the Museums and the Web (MW2002), Boston, MA, USA, 18–20 April 2002.
[32]
Veron, E.; Levasseur, M. Ethographie de l'Exposition; Bibliotheque Publique d'Information, Centre Georges Pompidou: Paris, France, 1983; pp. 91–92.
Packer, J.; Ballantyne, R. Motivational factors and the visitor experience: A comparison of three sites. Curator Mus. J. 2002, 45, 183–198.
[35]
Morris Hargreaves McIntyre Never Mind the Width, Feel the Quality; Report Elaborated for the Museums and Heritage Show: London, UK, 2005. Available online: http://visitors.org.uk/files/Meaningful%20Measures%20-%20A%20McIntyre.pdf (accessed on 30 November 2013).
[36]
Lykourentzou, I.; Claude, X.; Naudet, Y.; Tobias, E.; Antoniou, A.; Lepouras, G.; Vassilakis, C. Improving Museum Visitors' Quality of Experience through Intelligent Recommendations: A Visiting Style-Based Approach. Proceedings of the 9th International Conference on Intelligent Environments (IE'13), Athens, Greece, 16–19 July 2013.
[37]
Petrelli, D. Museums as Theatre: Suggestions for an Emotional Visit. Proceedings of the Workshop on Affect in Interactions, Siena, Italy, 20–22 October 1999; pp. 107–110.
[38]
Waltl, C. Museums for Visitors: Audience Development—A Crucial Role for Successful Museum Management Strategies. Available online: http://www.intercom.museum/documents/1-4Waltl.pdf (accessed on 30 November 2013).
[39]
Ceipidor, U.B.; Medaglia, C.M.; Volpi, V.; Moroni, A.; Sposato, S.; Carboni, M.; Caridi, A. NFC Technology Applied to Touristic-Cultural Field: A Case Study on an Italian Museum. Proceedings of the Near Field Communication (NFC), Zurich, Switzerland, 5 February 2013.
[40]
Faugeras, O. Three-Dimensional Computer Vision: A Geometric Viewpoint; MIT Press: Cambridge, MA, USA, 1993.
[41]
Tsai, R.Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Rob. Autom. 1987, 3, 323–344.
[42]
Sturm, P.F.; Maybank, S.J. On Plane-Based Camera Calibration: A General Algorithm, Singularities, Applications. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA, 23–25 June 1999.
[43]
Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1330–1334.
[44]
Zhang, Z. Camera calibration with one-dimensional objects. IEEE Trans. Pattern Analys. Mach. Intell. 2004, 26, 892–899.
[45]
Maybank, S.J.; Faugeras, O.D. A theory of self-calibration of a moving camera. Int. J. Comput. Vis. 1992, 8, 123–152.
[46]
Schweighofer, G.; Pinz, A. Robust pose estimation from a planar target. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28, 2024–2030.
[47]
Kato, H.; Billinghurst, M. Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System. Proceedings of the Second IEEE and ACM Int'l Workshop Augmented Reality, San Francisco, CA, USA, 20–21 October 1999; pp. 85–94.
[48]
Malik, S.; Roth, G.; McDonald, C. Robust 2D Tracking for Real-Time Augmented Reality. Proceedings of the Conference Vision Interface, Calgary, Canada, 27–29 May 2002.
[49]
Guillemaut, J.-Y.; Aguado, A.S.; Illingworth, J. Using points at infinity for parameter decoupling in camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27, 265–270.
[50]
Orghidan, R.; Salvi, J.; Gordan, M.; Orza, B. Camera Calibration Using Two or Three Vanishing Points. Proceedings of the Federated Conference on Computer Science and Information Systems (FedCSIS), Wroc?aw, Poland, 9–12 September 2012; pp. 123–130.
[51]
Wang, L.L.; Tsai, W.-H. Camera calibration by vanishing lines for 3-D computer vision. IEEE Trans. Pattern Anal. Mach. Intell. 1991, 13, 370–376.
[52]
Chen, Q.; Wu, H.; Wada, T. Camera calibration with two arbitrary coplanar circles. Lect. Note. Comput. Sci. 2004, 3023, 521–532.
[53]
Chen, Y.; Ip, H.; Huang, Z.; Wang, G. Full camera calibration from a single view of planar scene. Lect. Note. Comput. Sci. 2008, 5358, 815–824.
[54]
Chen, X.; Li, R.; Xuan, W.; Tian, Y.; Huang, Q. A Novel Artificial Landmark for Monocular Global Visual Localization of Indoor Robots. Proceedings of the 2010 International Conference on Mechatronics and Automation (ICMA), Xi'an, China, 4–7 August 2010; pp. 1314–1319.
[55]
Schmalstieg, D.; Wagner, D. Experiences with Handheld Augmented Reality. Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, 13–16 November 2007; pp. 13–16.
[56]
Fischler, M.; Bolles, R. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commum. ACM 1981, 24, 381–395.
[57]
Douglas, D.; Peucker, T. Algorithms for the reduction of the number of points required to represent a digitized line or its caricature. Can. Cartogr. 1973, 10, 112–122.
[58]
Alciatore, D.; Miranda, R. The Best Least-Squares Line Fit. In Graphics Gems; Paeth, A.W., Ed.; Academic Press: Waltham, MA, USA, 1995; pp. 91–97.
[59]
Armanno, G.; Bottino, A.; Martina, A. SkyLineDroid: An Outdoor Mobile Augmented Reality Application for Virtual Heritage. Proceedings of the International Conference on Cultural Heritage and Tourism (CUHT'12), Cambridge, England, 25–27 February 2012.
[60]
G?rbacia, F.; Butnariu, S.; Orman, A.P.; Postelnicu, C.C. Virtual Restoration of Deteriorated Religious Heritage Objects Using Augmented Reality Technologies. Proceedings of the IVth European Symposium on Religious Art, Restoration and Conservation, Iasi, Romania, 3–5 May 2012.
[61]
Kang, J. AR teleport: Digital reconstruction of historical and cultural-heritage sites using mobile augmented reality. Wirel. Personal Commun. 2013, 70, 1443–1462.
[62]
Streetmuseum–Museum of London. Available online: http://www.museumoflondon.org.uk/Resources/app/you-are-here-app/home.html (accessed on 30 September 2013).
[63]
Iurgel, I. From another point of view: Art-E-fact. Lect. Note. Comput. Sci. 2004, 3105, 26–35.
[64]
Traum, D.R.; Aggarwal, P.; Artstein, R.; Foutz, S.; Gerten, J.; Katsamanis, A.; Leuski, A.; Noren, D.; Swartout, W.R. Ada and Grace: Direct interaction with museum visitors. Lect. Note. Comput. Sci. 2012, 7502, 245–251.
[65]
Yiannoutsou, N.; Papadimitriou, I.; Komis, V.; Avouris, N. Playing with Museum Exhibits: Designing Educational Games Mediated by Mobile Technology. Proceedings of the 8th International Conference on Interaction Design and Children (IDC'09), Como, Italy, 3–5 June 2009; pp. 230–233.
[66]
Russo, A.; Watkins, J.; Kelly, L.; Chan, S. Participatory communication with social media. Curator Mus. J. 2008, 51, 21–32.
[67]
Hausmann, A. The importance of word of mouth for museums: A framework of analysis. Int. J. Arts Manag. 2012, 14, 32–43.
[68]
Hausmann, A.; Poellmann, L. Using social media for arts marketing: Theoretical analysis and empirical insights for performing arts organizations. Int. Rev. Public Nonprofit Market. 2013, 12, 1–19.
[69]
Bruno, A.; Pollichino, G.B. Sperimentare una Nuova Metodologia di Analisi Comportamentale Durante le Visite nei Musei. Palazzo Madama. Studi e Notizie. 2011, 1, 209–213.
[70]
Chan, L.W.; Hsu, Y.Y.; Hung, Y.P.; Hsu, J.Y. Orientation-Aware Handhelds for Panorama-Based Museum Guiding System. Proceedings of the UbiComp 2005 Workshop: Smart Environments and Their Applications to Cultural Heritage, Tokyo, Japan, 11–14 September 2005.
[71]
Bellotti, F.; Berta, R.; de Gloria, A.; Panizza, G.; Pellegrino, M.; Primavera, L. Designing Serious Games for Cultural Heritage Purposes. In Digital Games and Learning; Bloomsbury Publishing: London, UK, 2011.
[72]
Fatih, N.; Desharnais, J.-M.; Abran, A. The State of the Art of Mobile Application Usability Evaluation. Proceedings of the 25th IEEE Canadian Conference on Electrical and Computer Engineering (IEEE CD: 978-1-4673-6/12), Montreal, QB, Canada, 29 April–2 May 2012.
[73]
Baharuddin, R.; Singh, D.; Razali, R. Usability dimensions for mobile applications—A review. Res. J. Appl. Sci. Eng. Technol. 2013, 5, 2225–2231.
[74]
Gansemer, S.; Groβmann, U.; Suttorp, O.; Dobbelmann, H. Evaluating a Location Sensitive Multimedia Museum Guide: Results from a Field Trial. Proceedings of the Digital Cultural Heritage—Essential for Tourism, 2nd EVA 2008 Vienna Conference, Vienna, Austria, 25–28 August 2008.
[75]
Csikszentmihalyi, M.; Hermanson, K. Intrinsic Motivation in Museums: Why Does One Want to Learn? In Public Institutions for Personal Learning: Understanding the Long-Term Impact of Museum; American Association of Museums: Washington, DC, USA, 1995; pp. 67–78.
[76]
Bitgood, S. An Attention-Value Model of Museum Visitors; Center for Advancement of Informal Science Education: Washington, DC, USA, 2010.
[77]
Fui-Hoon Nah, F.; Zhou, Y.; Boey, A.; Li, H. Understanding Engagement in Educational Computer Games. Avaiable online: http://meaningfulplay.msu.edu/proceedings2012/mp2012_submission_167.pdf (accessed on 30 November 2013).