Systematic Review of Multimodal Human-Computer Interaction

Aaron Cecil-Xavier J. Cecil Avinash Gupta + 2 lainnya

14 September 2022

Abstract This article provides a systematic review of research related to Human–Computer Interaction techniques supporting training and learning in various domains including medicine, healthcare, and engineering. The focus is on HCI techniques involving Extended Reality (XR) technology which encompasses Virtual Reality, Augmented Reality, and Mixed Reality. HCI-based research is assuming more importance with the rapid adoption of XR tools and techniques in various training and learning contexts including education. There are many challenges in the adoption of HCI approaches, which results in a need to have a comprehensive and systematic review of such HCI methods in various domains. This article addresses this need by providing a systematic literature review of a cross-section of HCI approaches involving proposed so far. The PRISMA-guided search strategy identified 1156 articles for abstract review. Irrelevant abstracts were discarded. The whole body of each article was reviewed for the remaining articles, and those that were not linked to the scope of our specific issue were also eliminated. Following the application of inclusion/exclusion criteria, 69 publications were chosen for review. This article has been divided into the following sections: Introduction; Research methodology; Literature review; Threats of validity; Future research and Conclusion. Detailed classifications (pertaining to HCI criteria and concepts, such as affordance; training, and learning techniques) have also been included based on different parameters based on the analysis of research techniques adopted by various investigators. The article concludes with a discussion of the key challenges for this HCI area along with future research directions. A review of the research outcomes from these publications underscores the potential for greater success when such HCI-based approaches are adopted during such 3D-based training interactions. Such a higher degree of success may be due to the emphasis on the design of user-friendly (and user-centric) training environments, interactions, and processes that positively impact the cognitive abilities of users and their respective learning/training experiences. We discovered data validating XR-HCI as an ascending method that brings a new paradigm by enhancing skills and safety while reducing costs and learning time through replies to three exploratory study questions. We believe that the findings of this study will aid academics in developing new research avenues that will assist XR-HCI applications to mature and become more widely adopted.

D. Szafir T. Williams M. Walker + 2 lainnya

23 Februari 2022

Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI) has been gaining considerable attention in HRI research in recent years. However, the HRI community lacks a set of shared terminology and framework for characterizing aspects of mixed reality interfaces, presenting serious problems for future research. Therefore, it is important to have a common set of terms and concepts that can be used to precisely describe and organize the diverse array of work being done within the field. In this article, we present a novel taxonomic framework for different types of VAM-HRI interfaces, composed of four main categories of virtual design elements (VDEs). We present and justify our taxonomy and explain how its elements have been developed over the past 30 years as well as the current directions VAM-HRI is headed in the coming decade.

G. Burdea Philippe Coiffet

1 Agustus 2024

From the Publisher: This in-depth review of current virtual reality technology and its applications provides a detailed analysis of the engineering, scientific and functional aspects of virtual reality systems and the fundamentals of VR modeling and programming. It also contains an exhaustive list of present and future VR applications in a number of diverse fields. Virtual Reality Technology is the first book to include a full chapter on force and tactile feedback and to discuss newer interface tools such as 3-D probes and cyberscopes. Supplemented with 23 color plates and more than 200 drawings and tables which illustrate the concepts described.

Ayah Hamad Bochen Jia

1 September 2022

Despite virtual reality (VR) being initially marketed toward gaming, there are many potential and existing VR applications in various sectors and fields, including education, training, simulations, and even in exercise and healthcare. Unfortunately, there is still a lack of general understanding of the strengths and limitations of VR as a technology in various application domains. Therefore, the aim of this literature review is to contribute to the library of literature concerning VR technology, its applications in everyday use, and some of its existing drawbacks. Key VR applications were discussed in terms of how they are currently utilized or can be utilized in the future, spanning fields such as medicine, engineering, education, and entertainment. The main benefits of VR are expressed through the text, followed by a discussion of some of the main limitations of current VR technologies and how they can be mitigated or improved. Overall, this literature review shows how virtual reality technology has the potential to be a greatly beneficial tool in a multitude of applications and a wide variety of fields. VR as a technology is still in its early stages, but more people are becoming interested in it and are optimistic about seeing what kind of changes VR can make in their everyday lives. With how rapidly modern society has adapted to personal computers and smartphones, VR has the opportunity to become the next big technological turning point that will eventually become commonplace in most households.

Yudi April Nando Yose Indarta Taali + 6 lainnya

21 Maret 2023

Augmented reality (AR) and virtual reality (VR) provide new experiences in the digital and simulation worlds. While they are intended to stimulate users’ perception and senses in general, the two differ significantly. This study aimed to seek and analyze international publications on the trends, similarities, differences, advantages, and disadvantages of AR and VR for learning over the period 2001-2021. In this study, bibliometric analysis using VOSViewer with the help of MS Excel was utilized to visualize metadata obtained from Scopus. Publish or Perish software supported the data collection of this study, which included retrieving and analyzing academic citations. The findings show that the AR/VR has trend continued to rise over the years. The results showed that Denmark and India (based on country bibliographic pairs), Journal of Physics Conference Series (based on journal bibliographic pairs), Y. Zhou publications (2018) (based on bibliographic pairs of publications), and Archana M. (India) with Lars K. (Denmark) (based on author bibliographic pairs) have become the most influential in the field of augmented reality and virtual reality for learning. AR and VR are two technologies changing how people use screens, thus creating new and exciting interactive experiences. In the future, it is expected that further research related to AR/VR and even Mixed Reality (MR) will continue to develop along with technological advancement. However, pedagogical competence remains an essential key to learning.