This paper examines dependencies of voice and video contents on human perception of group (or inter-destination) synchronization error in remote learning by Quality of Experience (QoE) assessment. In our assessment, we use two videos and three voices (two voices for one video and one voice for the other video). We also investigate influences of silence periods in the voices and temporal relations between the voices and videos (called the tightly-coupled and loosely-coupled contents here). The voices are spoken by a teacher according to the videos. Each subject as a student assesses the group synchronization quality by watching each lecture video and the corresponding explanation voice, and then the subject answers whether he/she perceives the group synchronization error or not. As a result, assessment results illustrate that silence periods mitigate the perception rate of the error, and we can also find that we can more easily perceive the error for tightly-coupled contents than loosely-coupled ones.
References
[1]
Blakowski, G. and Steinmetz, R. (1996) A Media Synchronization Survey: Reference Model, Specification, and Case Studies. IEEE Journal on Selected Areas in Communications, 14, 5-35. https://doi.org/10.1109/49.481691
[2]
Montagud, M., Cesar, P., Boronat, F. and Jansen, J. (2018) MediaSync: Handbook on Multimedia Synchronization. Springer International Publishing, Cham.
https://doi.org/10.1007/978-3-319-65840-7
[3]
Huang, Z., Nahrstedt, K. and Steinmetz, R. (2013) Evolution of Temporal Multimedia Synchronization Principles: A Historical Viewpoint. ACM Transactions on Multimedia Computing, Communications and Applications, 9, Article No. 34.
https://doi.org/10.1145/2490821
[4]
Montagud, M., Jansen, J., Cesar, P. and Boronat, F. (2015) Review of Media Sync Reference Models: Advance and Open Issues. Proceeding of MediaSync Workshop, Brussels, 3 June 2015, 1-8.
[5]
Rop, K.V. and Bett, N.K. (2012) Video Conferencing and Its Application in Distance Learning. Proceedings of Annual Interdisciplinary Conference, Vol. 1, Nairobi, June 2012, 1-9.
[6]
Costa, R.M. and Santos, C.A.S. (2014) Systematic Review of Multiple Contents Synchronization in Interactive Television Scenario. ISRN Communications and Networking, 2014, Article ID: 127142. https://doi.org/10.1155/2014/127142
[7]
Vakiliand, A. and Gregoire, J.C. (2013) QoE Management in a Video Conferencing Application. Computer Networks, 57, 1726-1738.
https://doi.org/10.1016/j.comnet.2013.03.002
[8]
Spyridonis, F., Daylamani-Zad, D. and O’Brien, M.P. (2018) Efficient In-Game Communication in Collaborative Online Multiplayer Games. Proceedings of the 10th International Conference on Virtual Worlds and Games for Serious Application (VS-Games), Würzburg, 5-7 September 2018, 1-4.
https://doi.org/10.1109/VS-Games.2018.8493420
[9]
Ishibashi, Y. and Tasaka, S. (1995) A Synchronization Mechanism for Continuous Media in Multimedia Communications. Proceedings of IEEE INFOCOM, Boston, 2-6 April 1995, 1010-1019. https://doi.org/10.1109/INFCOM.1995.515977
[10]
Ishibashi, Y., Tsuji, A. and Tasaka, S. (1997) A Group Synchronization Mechanism for Stored Media in Multicast Communications. Proceedings of IEEE INFOCOM, Kobe, 7-11 April 1997, 692-700. https://doi.org/10.1109/INFCOM.1997.644522
[11]
Ishibashi, Y. and Tasaka, S. (1997) A Group Synchronization Mechanism for Live Media in Multicast Communications. GLOBECOM 97. IEEE Global Telecommunications Conference. Conference Record, Phoenix, 3-8 November 1997, 746-752.
https://doi.org/10.1109/GLOCOM.1997.638431
[12]
Ishibashi, Y. and Tasaka, S. (1999) A Distributed Control Scheme for Group Synchronization in Multicast Communications. Proceedings of International Symposium on Communications, Kaohsiung, November 1999, 317-323.
[13]
IETF RFC7272 (2014) Inter-Destination Media Synchronization (IDMS) Using the RTP Control Protocol (RTCP).
[14]
ITU-T Recommendation G.1070 (2018) Opinion Model for Video-Telephony Applications. International Telecommunication Union, Geneva.
[15]
Nawaz, O., Fielder, M., Moor, K.D. and Khatibi, S. (2020) Influence of Gender and Viewing Frequency on Quality of Experience. Proceedings of 2020 20th International Conference on Quality of Multimedia Experience (QoMEX), Athlone, 26-28 May 2020, 1-4. https://doi.org/10.1109/QoMEX48832.2020.9123106
[16]
Miyashita, Y., Ishibashi, Y., Fukushima, N., Sugawara, S. and Psannis, K.E. (2011) QoE Assessment of Group Synchronization in Networked Chorus with Voice and Video. TENCON 2011: 2011 IEEE Region 10 Conference, Bali, 21-24 November 2011, 192-196. https://doi.org/10.1109/TENCON.2011.6129090
[17]
Huang, P., Ishibashi, Y., Fukushima, N. and Sugawara, S. (2012) QoE Assessment of Group Synchronization Control Scheme with Prediction in Work Using Haptic Media. International Journal of Communications, Network and System Science (IJCNS), 5, 321-331. https://doi.org/10.4236/ijcns.2012.56042
[18]
Ishibashi, Y., Nagasaka, M. and Fujiyoshi, N. (2006) Subjective Assessment of Fairness among Users in Multipoint Communications. Proceedings of ACM SIGCHI Advance in Computer Entertainment Technology (ACE), Hollywood, 14-16 June 2006. https://doi.org/10.1145/1178823.1178905
[19]
Hosoya, K., Ishibashi, Y., Sugawara, S. and Psannis, K.E. (2009) Group Synchronization Control Considering Difference of Conversation Roles. Proceedings of the 13th IEEE International Symposium on Consumer Electronics (ISCE), Kyoto, 25-28 May 2009, 948-952. https://doi.org/10.1109/ISCE.2009.5156876
[20]
Kwon, D., Kim, H. and Ju, H. (2018) Play Sharing a Group Synchronization Scheme for Media Streaming Services in Hierarchical WLANs. International Journal of Network Management, 28, Article ID: e2024. https://doi.org/10.1002/nem.2024
[21]
Ida, Y., Ishibashi, Y., Fukushima, N. and Sugawara, S. (2010) QoE Assessment of Interactivity and Fairness in First Person Shooting with Group Synchronization Control. Proceedings the 9th Annual Workshop on Network and Systems Support for Games (NetGames), Taipei, 16-17 November 2010, 1-5.
https://doi.org/10.1109/NETGAMES.2010.5680283
[22]
Huang, P., Ishibashi, Y. and Sithu, M. (2016) Enhancement of Simultaneous Output-Timing Control with Human Perception of Synchronization Errors among Multiple Destinations. Proceedings of the 2nd IEEE International Conference on Computer and Communications (ICCC), Chengdu, 14-17 October 2016, 2099-2103.
https://doi.org/10.1109/CompComm.2016.7925070
[23]
Ishibashi, Y., Kanbara, T. and Tasaka, S. (2004) Inter-Stream Synchronization between Haptic Media and Voice in Collaborative Virtual Environments. Proceedings of 12th Annual ACM International Conference on Multimedia, New York, 10-16 October 2004, 604-611. https://doi.org/10.1145/1027527.1027670
[24]
Steinmetz, R. (1996) Human Perception of Jitter and Media Synchronization. IEEE Journal on Selected Areas in Communications, 14, 61-72.
https://doi.org/10.1109/49.481694
[25]
Staelens, N., De Meulenaere, J., Glenn, L.B.. Wallendael, V., Cock, J.D., Geeraert, K., Vercammen, N., Broeck, W.V., Vermeulen, B., Van de Walle, R. and Demeester, P. (2012) Assessing the Importance of Audio/Video Synchronization for Simultaneous Translation of Video Sequences. Multimedia Systems, 18, 445-457.
https://doi.org/10.1007/s00530-012-0262-4
[26]
Younkin, A.C. and Corriveau, P.J. (2008) Determining the Amount of Audio-Video Synchronization Errors Perceptible to the Average End-User. IEEE Transactions on Broadcasting, 54, 623-627. https://doi.org/10.1109/TBC.2008.2002102
[27]
ITU-R Recommendation BT.500. (2009) Methodology for the Subjective Assessment of the Quality of Television Pictures. International Telecommunication Union, Geneva.
[28]
Cute Pets (2021, August 3) Cat in the Grass in the Sun #2.
https://www.youtube.com/watch?v=zl8ZVbFX3RQ
[29]
iPanda (2019, February 21) Giant Pandas in the Snow Feb. 20, 2019.
https://www.youtube.com/watch?v=pNff91GIIUg
[30]
NHD-TV (2016, March 22) Cutes Dogs | Cutest Dog in the World | Cute Dogs Clips 2016. https://www.youtube.com/watch?v=dQ5BAupEKvw
[31]
Funnyplox (2016, December 17) Most Funny and Cute Baby Elephant Videos Compilation. https://www.youtube.com/watch?v=SNggmeilXDQ
[32]
The Pet Collective (2016, July 27) Sh*t Birds Say Video Compilation 2016.
https://www.youtube.com/watch?v=Wjvov2fo9vo
[33]
Kennys Wild Things (2014, December 5) Cute Tiger Cub Exploring, Playing & Talking. https://www.youtube.com/watch?v=EuvHmfQMD30
[34]
Mo Mo Lwin, H.M., Ishibashi, Y. and Mya, K.T. (2019) Human Perception of Group Synchronization Error for Remote Learning: One-Way Communication Case. Proceedings of IEEE International Conference on Consumer Electronics—Taiwan (ICCE-TW), Yilan, 20-22 May 2019, 1-2.
https://doi.org/10.1109/ICCE-TW46550.2019.8991984
[35]
Mo Mo Lwin, H.M., Ishibashi, Y. and Mya, K.T. (2020) Influence of Voice Delay on Human Perception of Group Synchronization Error for Remote Learning: One-way Communication Case. Proceedings of 2020 IEEE Conference on Computer Applications (ICCA), Yangon, 27-28 February 2020, 1-5.
https://doi.org/10.1109/ICCA49400.2020.9022835
