Real-Time Remote Maintenance Support Based on Augmented Reality (AR)
Abstrak
In the realm of the current industrial revolution, interesting innovations as well as new techniques are constantly being introduced by offering fertile ground for further investigation and improvement in the industrial engineering domain. More specifically, cutting-edge digital technologies in the field of Extended Reality (XR) have become mainstream including Augmented Reality (AR). Furthermore, Cloud Computing has enabled the provision of high-quality services, especially in the controversial field of maintenance. However, since modern machines are becoming more complex, maintenance must be carried out from experienced and well-trained personnel, while overseas support is timely and financially costly. Although AR is a back-bone technology facilitating the development of robust maintenance support tools, they are limited to the provision of predefined scenarios, covering only a limited number of scenarios. This research work aims to address this emerging challenge with the design and development of a framework, for the support of remote maintenance and repair operation based on AR, by creating suitable communication channels between the shop-floor technicians and the expert engineers who are utilizing real-time feedback from the operator’s field of view. The applicability of the developed framework is tested in vitro in a lab-based machine shop and in a real-life industrial scenario.
Artikel Ilmiah Terkait
Nikolaos Fourtakas C. Gkournelos S. Makris + 4 lainnya
30 Juli 2022
ABSTRACT This paper presents an Augmented Reality software suite aiming at supporting the operator’s interaction with flexible mobile robot workers. The developed AR suite, integrated with the shopfloor’s Digital Twin, provides the operators’ a) virtual interfaces to easily program the mobile robots b) information on the process and the production status, c) safety awareness by superimposing the active safety zones around the robots and d) instructions for recovering the system from unexpected events. The application’s purpose is to simplify and accelerate the industrial manufacturing process by introducing an easy and intuitive way of interaction with the hardware, without requiring special programming skills or long training from the human operators. The proposed software is developed for the Microsoft’s HoloLens Mixed Reality Headset 2, integrated with Robotic Operation System (ROS), and it has been tested in a case study inspired from the automotive industry.
Andrzej Szajna W. Woźniak M. Kostrzewski + 2 lainnya
22 Agustus 2020
Digitalization of production environment, also called Industry 4.0 (the term invented by Wahlster Wolfgang in Germany) is now one of the hottest topics in the computer science departments at universities and companies. One of the most significant topics in this area is augmented reality (AR). The interest in AR has grown especially after the introduction of the Microsoft HoloLens in 2016, which made this technology available for researchers and developers all around the world. It is divided into numerous subtopics and technologies. These wireless, see-through glasses give a very natural human-machine interface, with the possibility to present certain necessary information right in front of the user’s eyes as 3D virtual objects, in parallel with the observation of the real world, and the possibility to communicate with the system by simple gestures and speech. Scientists noted that in-depth studies connected to the effects of AR applications are presently sparse. In the first part of this paper, the authors recall the research from 2019 about the new method of manual wiring support with the AR glasses. In the second part, the study (tests) for this method carried out by the research team is described. The method was applied in the actual production environment with consideration of the actual production process, which is manual wiring of the industrial enclosures (control cabinets). Finally, authors deliberate on conclusions, technology’s imperfections, limitations, and future possible development of the presented solution.
C. Sahu C. Young Rahul Rai
28 Desember 2020
ABSTRACT Augmented reality (AR) has proven to be an invaluable interactive medium to reduce cognitive load by bridging the gap between the task-at-hand and relevant information by displaying information without disturbing the user's focus. AR is particularly useful in the manufacturing environment where a diverse set of tasks such as assembly and maintenance must be performed in the most cost-effective and efficient manner possible. While AR systems have seen immense research innovation in recent years, the current strategies utilised in AR for camera calibration, detection, tracking, camera position and orientation (pose) estimation, inverse rendering, procedure storage, virtual object creation, registration, and rendering are still mostly dominated by traditional non-AI approaches. This restricts their practicability to controlled environments with limited variations in the scene. Classical AR methods can be greatly improved through the incorporation of various AI strategies like deep learning, ontology, and expert systems for adapting to broader scene variations and user preferences. This research work provides a review of current AR strategies, critical appraisal for these strategies, and potential AI solutions for every component of the computational pipeline of AR systems. Given the review of current work in both fields, future research work directions are also outlined.
Wei Song Shunhu Su Fei Wang + 1 lainnya
1 Desember 2020
As a new information technology, mobile augmented reality (AR) technology has attracted more and more attention in recent years. Mobile AR uses mobile terminal, with the help of entity object recognition, obtains virtual information through calculation or in database, and superimposes virtual information on live video to realize the "enhancement" of virtual information to reality. In order to explore the application of AR technology in inhouse logistics, this paper analyses the principle and technical characteristics of AR technology. By analysing the application status of AR technology in inhouse logistics, the application advantages of AR technology in inhouse logistics are obtained. This paper summarizes 36 cases of AR technology application in inhouse logistics, summarizes and analyses the application prospect of AR technology in inhouse logistics. The functions of AR technology in the process of receiving, storage, sorting, transportation, inventory and planning are put forward. It provides theoretical guidance for the practical application of AR technology in inhouse logistics.
Guangzhi Wang T. Song Nassir Navab + 6 lainnya
17 Agustus 2022
The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to provide visual information that surgeons can use during the performance of the task. Existing medical-grade tracking systems use infrared cameras placed inside the Operating Room (OR) to identify retro-reflective markers attached to objects of interest and compute their pose. Some commercially available AR Head-Mounted Displays (HMDs) use similar cameras for self-localization, hand tracking, and estimating the objects’ depth. This work presents a framework that uses the built-in cameras of AR HMDs to enable accurate tracking of retro-reflective markers without the need to integrate any additional electronics into the HMD. The proposed framework can simultaneously track multiple tools without having previous knowledge of their geometry and only requires establishing a local network between the headset and a workstation. Our results show that the tracking and detection of the markers can be achieved with an accuracy of <inline-formula><tex-math notation="LaTeX">$0.09\pm 0.06\ mm$</tex-math><alternatives><mml:math><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>09</mml:mn><mml:mo>±</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>06</mml:mn><mml:mspace width="4pt"/><mml:mi>m</mml:mi><mml:mi>m</mml:mi></mml:mrow></mml:math><inline-graphic xlink:href="martingomez-ieq1-3238309.gif"/></alternatives></inline-formula> on lateral translation, <inline-formula><tex-math notation="LaTeX">$0.42 \pm 0.32\ mm$</tex-math><alternatives><mml:math><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>42</mml:mn><mml:mo>±</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>32</mml:mn><mml:mspace width="4pt"/><mml:mi>m</mml:mi><mml:mi>m</mml:mi></mml:mrow></mml:math><inline-graphic xlink:href="martingomez-ieq2-3238309.gif"/></alternatives></inline-formula> on longitudinal translation and <inline-formula><tex-math notation="LaTeX">$0.80 \pm 0.39^\circ$</tex-math><alternatives><mml:math><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>80</mml:mn><mml:mo>±</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:msup><mml:mn>39</mml:mn><mml:mo>∘</mml:mo></mml:msup></mml:mrow></mml:math><inline-graphic xlink:href="martingomez-ieq3-3238309.gif"/></alternatives></inline-formula> for rotations around the vertical axis. Furthermore, to showcase the relevance of the proposed framework, we evaluate the system's performance in the context of surgical procedures. This use case was designed to replicate the scenarios of k-wire insertions in orthopedic procedures. For evaluation, seven surgeons were provided with visual navigation and asked to perform 24 injections using the proposed framework. A second study with ten participants served to investigate the capabilities of the framework in the context of more general scenarios. Results from these studies provided comparable accuracy to those reported in the literature for AR-based navigation procedures.
Daftar Referensi
0 referensiTidak ada referensi ditemukan.