The effect of audio on the experience in virtual reality: a scoping review

Neng-Hao Yu Chung-Wei Wang Mike Y. Chen + 4 lainnya

21 April 2020

Virtual Reality (VR) sickness is common with symptoms such as headaches, nausea, and disorientation, and is a major barrier to using VR. We propose WalkingVibe, which applies unobtrusive vibrotactile feedback for VR walking experiences, and also reduces VR sickness and discomfort while improving realism. Feedback is delivered through two small vibration motors behind the ears at a frequency that strikes a balance in inducing vestibular response while minimizing annoyance. We conducted a 240-person study to explore how visual, audio, and various tactile feedback designs affect the locomotion experience of users walking passively in VR while seated statically in reality. Results showed timing and location for tactile feedback have significant effects on VR sickness and realism. With WalkingVibe, 2-sided step-synchronized design significantly reduces VR sickness and discomfort while significantly improving realism. Furthermore, its unobtrusiveness and ease of integration make WalkingVibe a practical approach for improving VR experiences with new and existing VR headsets.

Edith Van Dyck Lies Bouckaert Kelsey E Onderdijk + 1 lainnya

5 Juni 2023

Spurred by recent advances in digital technologies, virtual concerts have become established modes for event attendance and represent a rapidly growing segment of the music industry. Yet, up to now, general experience of virtual concert attendees remains largely underexplored. Here, we focus on a subcategory in this domain: music concerts in virtual reality (VR). Our approach is situated within the theoretical framework of embodied music cognition and entailed investigation through a survey study. Responses of seventy-four VR concert attendees were collected, consisting of demographics, motivations, experiences, and future perspectives. In contrast to previous research, which generally identified social connectedness as a main motivator for concert attendance, our sample regarded it as one of the least important incentives. On the other hand, in line with previous studies, ‘seeing specific artists perform’ and ‘uniqueness of the experience’, were pivotal. The latter was mostly fueled by the possibility to experience/interact with visuals and environments considered as unconceivable in the real world. Furthermore, 70% of our sample regarded VR concerts as ‘the future of the music industry’, mainly relating to the accessibility of such events. Positive evaluations of VR concert experiences, as well as future perspectives regarding the medium, were significantly influenced by the level of experienced immersivity. To our knowledge, this is the first study to provide such an account.

S. Palmisano Rikeya Constable

8 Maret 2022

While head-mounted display (HMD) based gaming is often limited by cybersickness, research suggests that repeated exposure to virtual reality (VR) can reduce the severity of these symptoms. This study was therefore aimed at: (1) examining the exposure conditions required to reduce cybersickness during HMD VR; and (2) learning whether such reductions generalise from one HMD VR game to another. Our participants played two commercially-available HMD VR video games over two consecutive days. Their first exposure to HMD VR on both days was always to a 15-min virtual rollercoaster ride. On Day 1, half of our participants also played a virtual climbing game for 15-min, while the rest of them finished testing early. Participants in the latter group were only exposed to the climbing game late on Day 2. We found that sickness was significantly reduced for our participants on their second exposure to the virtual rollercoaster. However, sickness to the rollercoaster on Day 2 was unaffected by whether they had played the climbing game on Day 1. Sickness during virtual climbing was also unaffected by group differences in exposure to the virtual rollercoaster. This convergent evidence suggested that the reductions in cybersickness produced by repeated exposure to HMD VR were game-specific. While these benefits did not generalise to the second game, two 15-min exposures to the same HMD VR game was sufficient to significantly reduce cybersickness in this study.

J.S. Gallego Domna Banakou Francisco Macía Varela + 3 lainnya

27 Juni 2022

We review the concept of presence in virtual reality, normally thought of as the sense of “being there” in the virtual world. We argued in a 2009 paper that presence consists of two orthogonal illusions that we refer to as Place Illusion (PI, the illusion of being in the place depicted by the VR) and Plausibility (Psi, the illusion that the virtual situations and events are really happening). Both are with the proviso that the participant in the virtual reality knows for sure that these are illusions. Presence (PI and Psi) together with the illusion of ownership over the virtual body that self-represents the participant, are the three key illusions of virtual reality. Copresence, togetherness with others in the virtual world, can be a consequence in the context of interaction between remotely located participants in the same shared virtual environments, or between participants and virtual humans. We then review several different methods of measuring presence: questionnaires, physiological and behavioural measures, breaks in presence, and a psychophysics method based on transitions between different system configurations. Presence is not the only way to assess the responses of people to virtual reality experiences, and we present methods that rely solely on participant preferences, including the use of sentiment analysis that allows participants to express their experience in their own words rather than be required to adopt the terminology and concepts of researchers. We discuss several open questions and controversies that exist in this field, providing an update to the 2009 paper, in particular with respect to models of Plausibility. We argue that Plausibility is the most interesting and complex illusion to understand and is worthy of significant more research. Regarding measurement we conclude that the ideal method would be a combination of a psychophysical method and qualitative methods including sentiment analysis.

Joanna Kisker Roman Osinsky Benjamin Schöne + 3 lainnya

15 Februari 2023

Virtual reality (VR) has become a popular tool for investigating human behavior and brain functions. Nevertheless, it is unclear whether VR constitutes an actual form of reality or is more like an advanced simulation. Determining the nature of VR has been mostly achieved by self-reported presence measurements, defined as the feeling of being submerged in the experience. However, subjective measurements might be prone to bias and, most importantly, do not allow for a comparison with real-life experiences. Here, we show that real-life and VR height exposures using 3D-360° videos are mostly indistinguishable on a psychophysiological level (EEG and HRV), while both differ from a conventional 2D laboratory setting. Using a fire truck, three groups of participants experienced a real-life (N = 25), a virtual (N = 24), or a 2D laboratory (N = 25) height exposure. Behavioral and psychophysiological results suggest that identical exogenous and endogenous cognitive as well as emotional mechanisms are deployed to process the real-life and virtual experience. Specifically, alpha- and theta-band oscillations in line with heart rate variability, indexing vigilance, and anxiety were barely indistinguishable between those two conditions, while they differed significantly from the laboratory setup. Sensory processing, as reflected by beta-band oscillations, exhibits a different pattern for all conditions, indicating further room for improving VR on a haptic level. In conclusion, the study shows that contemporary photorealistic VR setups are technologically capable of mimicking reality, thus paving the way for the investigation of real-world cognitive and emotional processes under controlled laboratory conditions. For a video summary, see https://youtu.be/fPIrIajpfiA.