Internal Medicine: Open Access
Open Access

Current and Feature of Wearable Devices in Augmented and Virtual Reality

Hoshang Kolivand^{* *}Correspondence: Hoshang Kolivand, Department of Computer Science, Liverpool John Moores University, Liverpool, United Kingdom, Email:

Author info »

Introduction

Realism in augmented and virtual reality

Realistic rendering technique of outdoor Augmented Reality (AR) has been an attractive topic since last two decades due to the large number of publications in computer graphics. Realistic virtual objects in outdoor rendering AR systems require sophisticated effects such as shadows, daylight and interaction between sky colour and virtual as well as real objects. A few realistic rendering techniques have been proposed to overcome this issue most of which are related to non-real-time rendering. However, this problem still persists especially in outdoor rendering. This research proposed a new technique to achieve realistic real-time outdoor rendering taking into account the interaction between sky colour and objects in AR systems with respect to shadows in any specific location, date and time. This approach involved four main phases, which cover different outdoor AR rendering requirements. In the first phase, sky colour was generated with respect to the sun position. The second phase involved the shadow generation algorithm which is called Hybrid Shadow Mapping (HSM). During this phase some improvements in shadow volume and projection shadow are employed. The third phase started with the introduction of a coherent formula for the sun position and shadows in any specific location, date and time. The coherent formula aims to find the shadow positioning automatically. This phase also addressed the interaction between sky colour and objects in virtual environments. Finally, a technique to integrate sky colour and shadows through the effects of sky colour on virtual objects in the AR system is proposed. The experimental results reveal that the proposed technique has significantly improved the realism of real- time outdoor AR rendering thus solving the problem of realistic AR systems [1,2].

Interaction in augmented reality

To achieve realistic Augmented Reality (AR), shadows play an important role in creating a 3-D impression of a scene. Casting virtual shadows on real and virtual objects is one of the topics of research being conducted in this area. In this paper, we propose a new method for creating complex AR indoor scenes using real time depth detection to exert virtual shadows on virtual and real environments. A Kinect camera was used to produce a depth map for the physical scene mixing into a single real-time transparent tacit surface. Once this is created, the camera's position can be tracked from the reconstructed 3-D scene. Real objects are represented by virtual object phantoms in the AR scene enabling users holding a webcam and a standard Kinect camera to capture and reconstruct environments simultaneously. The tracking capability of the algorithm is shown and the findings are assessed drawing upon qualitative and quantitative methods making comparisons with previous AR phantom generation applications. The results demonstrate the robustness of the technique for realistic indoor rendering in AR systems [3].

Virtual heritage in augmented reality

Today’s modern organizations are striving hard to trace the beginnings of human civilization and maintain cultural heritage throughout the world; as a result the need for an integrative technique materializing this dream is felt more than ever. Realistic historical buildings in outdoor rendering Augmented Reality (AR) systems require sophisticated effects such as shadows, lighting and the ability to reveal the effect of sky dome illumination on virtual as well as real objects. In this project, the sun position and sky colour are simulated using Julian dating and Perez model respectively. The historical buildings are pre-created using Light Wave 3-D. An AR system is created using a new marker-less camera setting. The sky illumination is exerted on the virtual historical buildings using a Hemicube Radiosity technique. We have tested the proposed method on Portuguese Malacca heritage building (Melaka, Malaysia) in different places to reveal the auto-adjustment of the system in the case of shadow positioning, lighting and the sky’s illumination. The final system could be installed on HMD (Head Mounted Display) or in our device called ReVit Age to show the realistic reconstructed virtual heritage buildings, taking the main outdoor illumination components into account. Throughout this method, listed heritage buildings can be revived in the minds of people from different backgrounds who share the same ambitious dream. It is strongly hoped that this idea can make historical buildings a virtual reality; closer to people’s hearts [4].

Brain computer interface

A Brain-Computer Interface (BCI) is the device that can read and acquire the brain activities. A human body is controlled by Brain- Signals, which considered as a main controller. Furthermore, the human emotions and thoughts will be translated by brain through brain signals and expressed as human mood. This controlling process mainly performed through brain signals, the brain signals is a key component in electroencephalogram (EEG). Based on signal processing the features representing human mood (behaviour) could be extracted with emotion as a major feature. This paper proposes a new framework in order to recognize the human inner emotions that have been conducted on the basis of EEG signals using a BCI device controller. This framework go through five steps starting by classifying the brain signal after reading it in order to obtain the emotion, then map the emotion, synchronize the animation of the 3-D virtual human, test and evaluate the work. Based on our best knowledge there is no framework for controlling the 3-D virtual human. As a result for implementing our framework will enhance the game field of enhancing and controlling the 3-D virtual humans’ emotion walking in order to enhance and bring more realistic as well. Commercial games and Augmented Reality systems are possible beneficiaries of this technique [5,6].

Wearable devices

In terms of wearable AR/VR devices the following details Figure 1 and Figure 2 have been discussed in this talk.

Figure 1: Comparison between exiting wearable devices.

Figure 2: Comparison between exiting wearable devices.

References

1. Kolivand H, Sunar MS. Realistic real-time outdoor rendering in augmented reality. PloS one. 2014; 9(9): e108334.
2. Kolivand H, Sunar MS. Covering photo-realistic properties of outdoor components with the effects of sky color in mixed reality. Multimed Tools Appl. 2014; 72(3):2143-2162.
3. Kolivand H, Billinghurst M, Sunar MS. Livephantom: retrieving virtual world light data to real environments. PloS one. 2016; 11(12):e0166424.
4. Kolivand H, Rhalibi EL A, Sunar MS, Saba T. ReVitAge: Realistic virtual heritage taking shadows and sky illumination into account. J Cult Herit. 2018; 32:166-175.
5. Abuhashish FAM, Kolivand H, Sunar MS, Mohamad D. Framework of controlling 3-D virtual human emotional walking using BCI. J Teknol. 2015; 75(4):17-25.
6. Abuhashish F, Kolivand H. Using Augmented Reality Technology in Pathfinding. In: 2019 12th International Conference on Developments in eSystems Engineering (DeSE). 2019; 1042-1046.