Recent advancements in computing research and technology will allow future immersive virtual reality systems to be voxel-based, i.e. entirely based on gap-less, spatial representations of volumetric pixels. The current popularity of pixel-based videoconferencing systems could turn into true telepresence experiences that are voxel-based. Richer, non-verbal communication will be possible thanks to the three-dimensional nature of such systems. An effective telepresence experience is based on the users’ sense of copresence with others in the virtual environment and on a sense of embodiment. We investigate two main quality of service factors, namely voxel size and network latency, to identify acceptable threshold values for maintaining the copresence and embodiment experience. We present a working prototype implementation of a voxel-based telepresence system and can show that even a coarse 64 mm voxel size and an overall round-trip latency of 542 ms are sufficient to maintain copresence and embodiment experiences. We provide threshold values for noticeable, disruptive, and unbearable latencies that can serve as guidelines for future voxel and other telepresence systems.
References
[1]
Regenbrecht, H., Meng, K., Reepen, A., Beck, S. and Langlotz, T. (2017) Mixed Voxel Reality: Presence and Embodiment in Low Fidelity, Visually Coherent, Mixed Reality Environments. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, Nantes, 9-13 October 2017, 90-99.
https://ieeexplore.ieee.org/document/8115408/
https://doi.org/10.1109/ISMAR.2017.26
[2]
Hoetzlein, R.K. (2016) GVDB: Raytracing Sparse Voxel Database Structures on the GPU. Proceedings of High Performance Graphics, Goslar Germany, Germany, 109-117. https://dl.acm.org/citation.cfm?id=2977351
[3]
Corporation, I. (2018) NFL+Intel True View.
https://www.intel.com/content/www/us/en/sports/nfl/overview.html
[4]
Buxton, W.A.S. (1992) Telepresence: Integrating Shared Task and Person Spaces. In: Booth, K.S. and Fournier, A., Eds., Proceedings of the Conference on Graphics Interface, Morgan Kaufmann Publishers Inc., San Francisco, CA, 123-129.
https://dl.acm.org/citation.cfm?id=155309
[5]
Zhao, S. (2003) Toward a Taxonomy of Copresence. Presence: Teleoperators and Virtual Environments, 12, 445-455.
http://www.mitpressjournals.org/doi/10.1162/105474603322761261
https://doi.org/10.1162/105474603322761261
[6]
Campos-Castillo, C. (2012) Copresence in Virtual Environments. Sociology Compass, 6, 425-433. https://doi.org/10.1111/j.1751-9020.2012.00467.x
[7]
Nowak, K.L. and Biocca, F. (2003) The Effect of the Agency and Anthropomorphism on Users’ Sense of Telepresence, Copresence, and Social Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments, 12, 481-494.
http://www.mitpressjournals.org/doi/10.1162/105474603322761289
https://doi.org/10.1162/105474603322761289
[8]
Schroeder, R. (2002) Copresence and Interaction in Virtual Environments: An Overview of the Range of Issues. Presence 2002: 5th Annual International Workshop on Presence, Porto, Portugal, 9-11 October 2002, 274-295.
http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.105.3059
[9]
Beck, S., Kunert, A.A., Kulik, A. and Froehlich, B. (2013) Immersive Group-to-Group Telepresence. IEEE Transactions on Visualization and Computer Graphics, 19, 616-625. https://ieeexplore.ieee.org/document/6479190/
https://doi.org/10.1109/TVCG.2013.33
[10]
Beck, S. and Froehlich, B. (2017) Sweeping-Based Volumetric Calibration and Registration of Multiple RGBD-Sensors for 3D Capturing Systems. 2017 IEEE Virtual Reality, Los Angeles, CA, 18-22 March 2017, 167-176.
https://ieeexplore.ieee.org/document/7892244/
https://doi.org/10.1109/VR.2017.7892244
[11]
Maimone, A. and Fuchs, H. (2012) Real-Time Volumetric 3D Capture of Room-Sized Scenes for Telepresence. Proceedings of the 2012 3DTV-Conference: The True Vision—Capture, Transmission and Display of 3D Video (3DTV-CON), Zurich, 15-17 October 2012, 1-4. http://ieeexplore.ieee.org/document/6365430/
https://doi.org/10.1109/3DTV.2012.6365430
[12]
Maldonado, S.A.A., Maldonado, D.M.A., Quinde, C.P., Freire, E.X.G. and Vaca, G.K.A. (2017) Voxel: A 3D Rendering Proposal. Proceedings of the 2017 Conference on Information and Communication Technology (CICT), Gwalior, 3-5 November 2017, 1-5. http://ieeexplore.ieee.org/document/8340601/
https://doi.org/10.1109/INFOCOMTECH.2017.8340601
[13]
Kaufman, A., Yagel, R. and Cohen, D. (1993) Volume Graphics. Computer, 26, 51-64. http://ieeexplore.ieee.org/document/274942/
https://doi.org/10.1109/MC.1993.274942
[14]
Zucker, S.W. and Hummel, R.A. (1981) A Three-Dimensional Edge Operator. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 3, 324-331.
http://ieeexplore.ieee.org/document/4767105/
https://doi.org/10.1109/TPAMI.1981.4767105
[15]
Steuer, J. (1992) Defining Virtual Reality: Dimensions Determining Telepresence. Journal of Communication, 42, 73-93.
https://academic.oup.com/joc/article-abstract/42/4/73/4210117?redirectedFrom=fulltext
https://doi.org/10.1111/j.1460-2466.1992.tb00812.x
[16]
Schubert, T., Friedmann, F. and Regenbrecht, H. (2001) The Experience of Presence: Factor Analytic Insights. Presence: Teleoperators and Virtual Environments, 10, 266-281. http://www.mitpressjournals.org/doi/10.1162/105474601300343603
https://doi.org/10.1162/105474601300343603
[17]
Witmer, B.G. and Singer, M.J. (1998) Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 7, 225-240. http://www.mitpressjournals.org/doi/10.1162/105474698565686
https://doi.org/10.1162/105474698565686
[18]
Kilteni, K., Groten, R. and Slater, M. (2012) The Sense of Embodiment in Virtual Reality. Presence: Teleoperators and Virtual Environments, 21, 373-387.
https://ieeexplore.ieee.org/document/6797786/
https://doi.org/10.1162/PRES_a_00124
[19]
Glenberg, A.M. (1997) What Is Memory for. Behavioral and Brain Sciences, 20, 1-19.
https://www.cambridge.org/core/journals/behavioral-and-brain-sciences/article/what-memory-is-for/46E0F728DAA67D54AA44D2C4634D9556
[20]
Zahorik, P. and Jenison, R.L. (1998) Presence as Being-in-the-World. Presence: Teleoperators and Virtual Environments, 7, 78-89.
http://www.mitpressjournals.org/doi/10.1162/105474698565541
https://doi.org/10.1162/105474698565541
[21]
Bystrom, K.-E., Barfield, W. and Hendrix, C. (1999) A Conceptual Model of the Sense of Presence in Virtual Environments. Presence: Teleoperators and Virtual Environments, 8, 241-244. https://doi.org/10.1162/105474699566107
http://www.mitpressjournals.org/doi/10.1162/105474699566107
[22]
Minsky, M. (1980) Telepresence. OMNI Magazine, 44-52.
https://philpapers.org/rec/MINT
[23]
Guadagno, R.E., Blascovich, J., Bailenson, J.N. and McCall, C. (2007) Virtual Humans and Persuasion: The Effects of Agency and Behavioral Realism. Media Psychology, 10, 1-22.
https://www.tandfonline.com/doi/full/10.1080/15213260701300865?scroll=topf&gneedAccess=true
[24]
Bovet, S., Debarba, H.G., Herbelin, B., Molla, E. and Boulic, R. (2018) The Critical Role of Self-Contact for Embodiment in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics, 24, 1428-1436.
http://ieeexplore.ieee.org/document/8283639/
https://doi.org/10.1109/TVCG.2018.2794658
[25]
De Vignemont, F. (2011) Embodiment, Ownership and Disownership. Consciousness and Cognition, 20, 82-93. https://doi.org/10.1016/j.concog.2010.09.004
https://www.sciencedirect.com/science/article/pii/S1053810010001704
[26]
Kuster, C., Ranieri, N., Zimmer, H., Bazin, J.C., Sun, C., Popa, T. and Gross, M. (2012) Towards Next Generation 3D Telconferencing Systems. Proceedings of the 2012 3DTV-Conference: The True Vision—Capture, Transmission and Display of 3D Video (3DTV-CON), Zurich, 15-17 October 2012, 1-4.
https://ieeexplore.ieee.org/document/6365454/
https://doi.org/10.1109/3DTV.2012.6365454
[27]
Regenbrecht, H. and Langlotz, T. (2015) Mutual Gaze Support in Videoconferencing Reviewed. Communications of the Association for Information Systems, 37, 965-989. http://aisel.aisnet.org/cais/vol37/iss1/45/
https://doi.org/10.17705/1CAIS.03745
[28]
Hauber, J., Regenbrecht, H., Billinghurst, M. and Cockburn, A. (2006) Spatiality in Videoconferencing: Trade-Offs between Efficiency and Social Presence. Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work, ACM, New York, 413-422. https://dl.acm.org/citation.cfm?id=1180937
https://doi.org/10.1145/1180875.1180937
[29]
Petkova, V.I., Khoshnevis, M. and Ehrsson, H.H. (2011) The Perspective Matters! Multisensory Integration in Egocentric Reference Frames Determines Full-Body Ownership. Frontiers in Psychology, 2, 35-41.
http://www.ncbi.nlm.nih.gov/pubmed/21687436
https://doi.org/10.3389/fpsyg.2011.00035
[30]
Regenbrecht, H.T., Park, N.J.-W., Ott, C., Mills, S., Cook, M. and Langlotz, T. (2019) Preaching Voxels: An Alternative Approach to Mixed Reality. Frontiers in ICT, 6, 7. https://doi.org/10.3389/fict.2019.00007
https://www.frontiersin.org/articles/10.3389/fict.2019.00007/full
[31]
Mori, M., MacDorman, K.F. and Kageki, N. (2012) The Uncanny Valley. IEEE Robotics and Automation Magazine, 19, 98-100.
https://ieeexplore.ieee.org/document/6213238/
https://doi.org/10.1109/MRA.2012.2192811
[32]
Bailenson, J.N., Swinth, K., Hoyt, C., Persky, S., Dimov, A. and Blascovich, J. (2005) The Independent and Interactive Effects of Embodied-Agent Appearance and Behavior on Self-Report, Cognitive, and Behavioral Markers of Copresence in Immersive Virtual Environments. Presence: Teleoperators and Virtual Environments, 14, 379-393. http://www.mitpressjournals.org/doi/10.1162/105474605774785235
https://doi.org/10.1162/105474605774785235
[33]
Llobera, J., Sanchez-Vives, M.V. and Slater, M. (2013) The Relationship between Virtual Body Ownership and Temperature Sensitivity. Journal of the Royal Society Interface, 10, 1-11. http://rsif.royalsocietypublishing.org/content/10/85/20130300
https://doi.org/10.1098/rsif.2013.0300
[34]
Kennedy, R.S., Lane, N.E., Berbaum, K.S. and Lilienthal, M.G. (1993) Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. The International Journal of Aviation Psychology, 3, 203-220.
https://www.tandfonline.com/doi/abs/10.1207/s15327108ijap0303_3
https://doi.org/10.1207/s15327108ijap0303_3
[35]
Alghamdi, M., Regenbrecht, H., Hoermann, S., Langlotz, T. and Aldridge, C. (2016) Social Presence and Mode of Videocommunication in a Collaborative Virtual Environment. Pacific Asia Conference on Information Systems 2016 Proceedings, 126.
https://aisel.aisnet.org/pacis2016/126
[36]
MacDorman, K.F., Green, R.D., Ho, C.C. and Koch, C.T. (2009) Too Real for Comfort? Uncanny Responses to Computer Generated Faces. Computers in Human Behavior, 25, 695-710. http://www.ncbi.nlm.nih.gov/pubmed/25506126
https://doi.org/10.1016/j.chb.2008.12.026
