Mobile augmented reality for furniture visualization using Simultaneous Localization and Mapping (SLAM)

M F Syahputra M R Aulia Dedi Arisandy

30 Mei 2020

Planning the placement of furniture in a room is an important planning process, with proper planning, the placement of furniture can be more efficient in the use of space, as well as from an aesthetic point of view. During this time the process can be done by using a sketch or other manual method. In this research, we use augmented reality technology to plan furniture placement in a room. We use the Markerless technique in the implementation of this AR system, and use the Simultaneous Localization and Mapping (SLAM) technique to determine the geospatial point where the furniture will be the desired layout. The results of this application ifound that good minimum distance in detecting SLAM on the ground is 60 cm and can only be seen up to a maximum position of 45 ° from the Z axis of the camera’s initial position when tracking. This application runs on the Android mobile platform Introduction.

Wei Song Shunhu Su Fei Wang + 1 lainnya

1 Desember 2020

As a new information technology, mobile augmented reality (AR) technology has attracted more and more attention in recent years. Mobile AR uses mobile terminal, with the help of entity object recognition, obtains virtual information through calculation or in database, and superimposes virtual information on live video to realize the "enhancement" of virtual information to reality. In order to explore the application of AR technology in inhouse logistics, this paper analyses the principle and technical characteristics of AR technology. By analysing the application status of AR technology in inhouse logistics, the application advantages of AR technology in inhouse logistics are obtained. This paper summarizes 36 cases of AR technology application in inhouse logistics, summarizes and analyses the application prospect of AR technology in inhouse logistics. The functions of AR technology in the process of receiving, storage, sorting, transportation, inventory and planning are put forward. It provides theoretical guidance for the practical application of AR technology in inhouse logistics.

Amir Firdhaus Razali Nik Adilah Hanin Nurulhuda Ghazali + 2 lainnya

1 Februari 2020

This paper presents the development of Augmented Reality (AR) for smart campus urbanization using library as the environment for the demonstration of the AR prototype. The main goal of the AR development is to help users to get information and direction easily using AR based mobile application when walking inside the library. In normal circumstances, users typically walk around and explore the library area before reaching their targeted destinations. Depending on the library size and number of reading corners, exploration and walking in the library can be time consuming. Therefore, an AR technology is introduced in this paper to improve the user experience inside the library in the right direction and information instantly. This application is developed using Vuforia software to set the image marker-based and process the output into Unity3D software, Android Studio for the Main Menu interface and IBM Watson for voice recognition. The final form of the application is successfully generated from the development of Augmented Reality (AR) application for the smart campus by using a library for the demonstration of the AR prototype. A series of application tests are conducted in each corner of the library to evaluate the effectiveness of developed AR.

Guangzhi Wang T. Song Nassir Navab + 6 lainnya

17 Agustus 2022

The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to provide visual information that surgeons can use during the performance of the task. Existing medical-grade tracking systems use infrared cameras placed inside the Operating Room (OR) to identify retro-reflective markers attached to objects of interest and compute their pose. Some commercially available AR Head-Mounted Displays (HMDs) use similar cameras for self-localization, hand tracking, and estimating the objects’ depth. This work presents a framework that uses the built-in cameras of AR HMDs to enable accurate tracking of retro-reflective markers without the need to integrate any additional electronics into the HMD. The proposed framework can simultaneously track multiple tools without having previous knowledge of their geometry and only requires establishing a local network between the headset and a workstation. Our results show that the tracking and detection of the markers can be achieved with an accuracy of <inline-formula><tex-math notation="LaTeX">$0.09\pm 0.06\ mm$</tex-math><alternatives><mml:math><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>09</mml:mn><mml:mo>±</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>06</mml:mn><mml:mspace width="4pt"/><mml:mi>m</mml:mi><mml:mi>m</mml:mi></mml:mrow></mml:math><inline-graphic xlink:href="martingomez-ieq1-3238309.gif"/></alternatives></inline-formula> on lateral translation, <inline-formula><tex-math notation="LaTeX">$0.42 \pm 0.32\ mm$</tex-math><alternatives><mml:math><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>42</mml:mn><mml:mo>±</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>32</mml:mn><mml:mspace width="4pt"/><mml:mi>m</mml:mi><mml:mi>m</mml:mi></mml:mrow></mml:math><inline-graphic xlink:href="martingomez-ieq2-3238309.gif"/></alternatives></inline-formula> on longitudinal translation and <inline-formula><tex-math notation="LaTeX">$0.80 \pm 0.39^\circ$</tex-math><alternatives><mml:math><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>80</mml:mn><mml:mo>±</mml:mo><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:msup><mml:mn>39</mml:mn><mml:mo>∘</mml:mo></mml:msup></mml:mrow></mml:math><inline-graphic xlink:href="martingomez-ieq3-3238309.gif"/></alternatives></inline-formula> for rotations around the vertical axis. Furthermore, to showcase the relevance of the proposed framework, we evaluate the system's performance in the context of surgical procedures. This use case was designed to replicate the scenarios of k-wire insertions in orthopedic procedures. For evaluation, seven surgeons were provided with visual navigation and asked to perform 24 injections using the proposed framework. A second study with ten participants served to investigate the capabilities of the framework in the context of more general scenarios. Results from these studies provided comparable accuracy to those reported in the literature for AR-based navigation procedures.

Jaewook Lee Wyatt Olson Kaiming Cheng + 4 lainnya

11 April 2024

The safety and accessibility of our homes is critical to quality of life and evolves as we age, become ill, host guests, or experience life events such as having children. Researchers and health professionals have created assessment instruments such as checklists that enable homeowners and trained experts to identify and mitigate safety and access issues. With advances in computer vision, augmented reality (AR), and mobile sensors, new approaches are now possible. We introduce RASSAR, a mobile AR application for semi-automatically identifying, localizing, and visualizing indoor accessibility and safety issues such as an inaccessible table height or unsafe loose rugs using LiDAR and real-time computer vision. We present findings from three studies: a formative study with 18 participants across five stakeholder groups to inform the design of RASSAR, a technical performance evaluation across ten homes demonstrating state-of-the-art performance, and a user study with six stakeholders. We close with a discussion of future AI-based indoor accessibility assessment tools, RASSAR’s extensibility, and key application scenarios.