Quality of experience in telemeetings and videoconferencing: a comprehensive survey

Telemeetings such as audiovisual conferences or virtual meetings play an increasingly important role in our professional and private lives. For that reason, system developers and service providers will strive for an optimal experience for the user, while at the same time optimizing technical and financial resources. This leads to the discipline of Quality of Experience (QoE), an active field originating from the telecommunication and multimedia engineering domains, that strives for understanding, measuring, and designing the quality experience with multimedia technology. This paper provides the reader with an entry point to the large and still growing field of QoE of telemeetings, by taking a holistic perspective, considering both technical and non-technical aspects, and by focusing on current and near-future services. Addressing both researchers and practitioners, the paper first provides a comprehensive survey of factors and processes that contribute to the QoE of telemeetings, followed by an overview of relevant state-of-the-art methods for QoE assessment. To embed this knowledge into recent technology developments, the paper continues with an overview of current trends, focusing on the field of eXtended Reality (XR) applications for communication purposes. Given the complexity of telemeeting QoE and the current trends, new challenges for a QoE assessment of telemeetings are identified. To overcome these challenges, the paper presents a novel Profile Template for characterizing telemeetings from the holistic perspective endorsed in this paper

Videoconference fatigue: a conceptual analysis

Videoconferencing (VC) is a type of online meeting that allows two or more participants from different locations to engage in live multi-directional audio-visual communication and collaboration (e.g., via screen sharing). The COVID-19 pandemic has induced a boom in both private and professional videoconferencing in the early 2020s that elicited controversial public and academic debates about its pros and cons. One main concern has been the phenomenon of videoconference fatigue. The aim of this conceptual review article is to contribute to the conceptual clarification of VC fatigue. We use the popular and succinct label “Zoom fatigue” interchangeably with the more generic label “videoconference fatigue” and define it as the experience of fatigue during and/or after a videoconference, regardless of the specific VC system used. We followed a structured eight-phase process of conceptual analysis that led to a conceptual model of VC fatigue with four key causal dimensions: (1) personal factors, (2) organizational factors, (3) technological factors, and (4) environmental factors. We present this 4D model describing the respective dimensions with their sub-dimensions based on theories, available evidence, and media coverage. The 4D-model is meant to help researchers advance empirical research on videoconference fatigue

Exploring Audiovisual Support Systems for In-Car Multiparty Conferencing

Calling while driving poses a severe safety risk. When more than two people are involved in a call - a conference call - this risk increases even more. Intelligent vehicles could offer support systems that ease the cognitive burden of such a multiparty calls. We explore the possibilities of such advanced driving assistant systems (ADAS) in two ways: first, we investigate object-based spatial audio where each remote caller is modeled as a distinct audio source. Second, we apply a non-intrusive ambient stereoscopic 3D (S3D) visualization that indicates the current speaker and its location. In a between-subject design driving simulator study (n=56), we assess workload, user experience and driving performance. Surprisingly, we found no positive effect of object-based audio. However, we present evidence how a supporting visualization might lower situational stress and increase the system’s dependability. We conclude that a supportive and intelligent stereoscopic visualization is a promising candidate for enhancing multiparty conference calls while driving

Glitching justice: Audio visual links and the sonic world of technologised courts

My earlier work on the prison endpoint of audio visual link technologies found that a ‘soundtrack of incarceration’ often infiltrates prison audio visual link studios and may be unintentionally transmitted to the remote courtroom (McKay 2016, 2017, 2018a,b). This article shifts attention to the courtroom endpoint of audio-visual links to examine the audio dimensions of this form of communication. Drawing on case law and transcripts from Australia, New Zealand and England, this article identifies a range of acoustic issues, or glitches, that are analysed through the lens of emergent criminological and socio-legal understandings of sound to grasp the sonic world of increasingly technologised courtrooms

Effects of Spatial Speech Presentation on Listener Response Strategy for Talker-Identification

This study investigates effects of spatial auditory cues on human listeners' response strategy for identifying two alternately active talkers (“turn-taking” listening scenario). Previous research has demonstrated subjective benefits of audio spatialization with regard to speech intelligibility and talker-identification effort. So far, the deliberate activation of specific perceptual and cognitive processes by listeners to optimize their task performance remained largely unexamined. Spoken sentences selected as stimuli were either clean or degraded due to background noise or bandpass filtering. Stimuli were presented via three horizontally positioned loudspeakers: In a non-spatial mode, both talkers were presented through a central loudspeaker; in a spatial mode, each talker was presented through the central or a talker-specific lateral loudspeaker. Participants identified talkers via speeded keypresses and afterwards provided subjective ratings (speech quality, speech intelligibility, voice similarity, talker-identification effort). In the spatial mode, presentations at lateral loudspeaker locations entailed quicker behavioral responses, which were significantly slower in comparison to a talker-localization task. Under clean speech, response times globally increased in the spatial vs. non-spatial mode (across all locations); these “response time switch costs,” presumably being caused by repeated switching of spatial auditory attention between different locations, diminished under degraded speech. No significant effects of spatialization on subjective ratings were found. The results suggested that when listeners could utilize task-relevant auditory cues about talker location, they continued to rely on voice recognition instead of localization of talker sound sources as primary response strategy. Besides, the presence of speech degradations may have led to increased cognitive control, which in turn compensated for incurring response time switch costs

Instructional Message Design: Theory, Research, and Practice (Volume 2)

Message design is all around us, from the presentations we see in meetings and classes, to the instructions that come with our latest tech gadgets, to multi-million-dollar training simulations. In short, instructional message design is the real-world application of instructional and learning theories to design the tools and technologies used to communicate and effectively convey information. This field of study pulls from many applied sciences including cognitive psychology, industrial design, graphic design, instructional design, information technology, and human performance technology to name just a few. In this book we will visit several foundational theories that guide our research, look at different real-world applications, and begin to discuss directions for future best practice. For instance, cognitive load and multimedia learning theories provide best practice, virtual reality and simulations are only a few of the multitude of applications. Special needs learners and designing for online, e-learning, and web conferencing are only some of many applied areas where effective message design can improve outcomes. Studying effective instructional message design tools and techniques has and will continue to be a critical aspect of the overall instructional design process. Hopefully, this book will serve as an introduction to these topics and inspire your curiosity to explore further

Instructional Message Design: Theory, Research, and Practice (Volume 2)

Message design is all around us, from the presentations we see in meetings and classes, to the instructions that come with our latest tech gadgets, to multi-million-dollar training simulations. In short, instructional message design is the real-world application of instructional and learning theories to design the tools and technologies used to communicate and effectively convey information. This field of study pulls from many applied sciences including cognitive psychology, industrial design, graphic design, instructional design, information technology, and human performance technology to name just a few. In this book we visit several foundational theories that guide our research, look at different real-world applications, and begin to discuss directions for future best practice. For instance, cognitive load and multimedia learning theories provide best practice, virtual reality and simulations are only a few of the multitude of applications. Special needs learners and designing for online, e-learning, and web conferencing are only some of many applied areas where effective message design can improve outcomes. Studying effective instructional message design tools and techniques has and will continue to be a critical aspect of the overall instructional design process. Hopefully, this book will serve as an introduction to these topics and inspire your curiosity to explore further!https://digitalcommons.odu.edu/distancelearning_books/1003/thumbnail.jp

Content-prioritised video coding for British Sign Language communication.

Video communication of British Sign Language (BSL) is important for remote interpersonal communication and for the equal provision of services for deaf people. However, the use of video telephony and video conferencing applications for BSL communication is limited by inadequate video quality. BSL is a highly structured, linguistically complete, natural language system that expresses vocabulary and grammar visually and spatially using a complex combination of facial expressions (such as eyebrow movements, eye blinks and mouth/lip shapes), hand gestures, body movements and finger-spelling that change in space and time. Accurate natural BSL communication places specific demands on visual media applications which must compress video image data for efficient transmission. Current video compression schemes apply methods to reduce statistical redundancy and perceptual irrelevance in video image data based on a general model of Human Visual System (HVS) sensitivities. This thesis presents novel video image coding methods developed to achieve the conflicting requirements for high image quality and efficient coding. Novel methods of prioritising visually important video image content for optimised video coding are developed to exploit the HVS spatial and temporal response mechanisms of BSL users (determined by Eye Movement Tracking) and the characteristics of BSL video image content. The methods implement an accurate model of HVS foveation, applied in the spatial and temporal domains, at the pre-processing stage of a current standard-based system (H.264). Comparison of the performance of the developed and standard coding systems, using methods of video quality evaluation developed for this thesis, demonstrates improved perceived quality at low bit rates. BSL users, broadcasters and service providers benefit from the perception of high quality video over a range of available transmission bandwidths. The research community benefits from a new approach to video coding optimisation and better understanding of the communication needs of deaf people

"Seeing the Faces Is So Important" -- Experiences From Online Team Meetings on Commercial Virtual Reality Platforms

During the Covid-19 pandemic, online meetings became common for daily teamwork in the home office. To understand the opportunities and challenges of meeting in virtual reality (VR) compared to video conferences, we conducted the weekly team meetings of our human-computer interaction research lab on five off-the-shelf online meeting platforms over four months. After each of the 12 meetings, we asked the participants (N = 32) to share their experiences, resulting in 200 completed online questionnaires. We evaluated the ratings of the overall meeting experience and conducted an exploratory factor analysis of the quantitative data to compare VR meetings and video calls in terms of meeting involvement and co-presence. In addition, a thematic analysis of the qualitative data revealed genuine insights covering five themes: spatial aspects, meeting atmosphere, expression of emotions, meeting productivity, and user needs. We reflect on our findings gained under authentic working conditions, derive lessons learned for running successful team meetings in VR supporting different kinds of meeting formats, and discuss the team's long-term platform choice.Comment: This article has been published at Frontiers in Virtual Reality, Research Topic "Everyday Virtual and Augmented Reality: Methods and Applications, Volume II": https://doi.org/10.3389/frvir.2022.94579