key: cord-1017716-woiiiboi
authors: Syamimi, Athirah; Gong, Yiwei; Liew, Ryan
title: VR industrial applications―A singapore perspective
date: 2020-10-31
journal: Virtual Reality & Intelligent Hardware
DOI: 10.1016/j.vrih.2020.06.001
sha: ad8d01a460f629ce8ee76df092a69655a516521f
doc_id: 1017716
cord_uid: woiiiboi

Virtual Reality (VR) has been around for a long time but has come into the spotlight only recently. From an industrial perspective, this article serves as a proverbial scalpel to dissect the different use cases and commercial applications of VR in Singapore. Before researching the Singapore market, we examine how VR has evolved. At the moment, the global annual budget for VR (and augmented reality) is at an upward trend with a leading growth in market value for the training sector. VR in Singapore has also seen a rapid development in recent years. We discuss some of the Singapore government's initiatives to promote the commercial adoption of VR for the digital economy of the nation. To address the mass adoption of VR, we present VRcollab's business solutions for the construction and building industry. 2020 is one of the most important years for VR in history.

Virtual Reality (VR) is widely credited to Ivan Sutherland for his work [1] in the 1960s. Over the last 50 years, the popularity of VR has gone up and down. In particular, VR has garnered the attention of many tech giants in terms of investments into VR and its counterpart, Augmented Reality (AR) in recent years.

For instance, in 2014, Facebook acquired Oculus, a VR technology company [2] , for 2 billion US dollars and started driving VR into its new era. Today, all major players, such as Apple, Google, Sony, and Samsung, have significantly invested in the field with efforts to make VR accessible and affordable.

In this article, we first revisit VR from a global view before we turn to the VR landscape in Singapore.

Specifically, we elaborate Singapore government's new initiatives aiming to increase the adoption of VR in both commercial and consumer markets as part of Singapore's digital economy. In fact, VR is now one of the four key technology advancements of the state country. From the application point of view, VR is commonly used in the entertainment industry. An increasing number of game developers have turned their business focus to create a variety of VR games. This is accompanied by industrial applications of VR in healthcare, construction, retail, and education. Several case studies are discussed to showcase the VR industrial landscape in the context of Singapore.

VRcollab is a startup in Singapore with a core business focusing on VR technology applications for Architecture, Engineering, and Construction (AEC). This article will share VRcollab's solution, which is already deployed in the AEC industry in Singapore. More specifically, the next generation of the Virtual Design & Construction (VDC) software with VRcollab solution through stakeholder collaboration for Building Information Modeling (BIM) interrogation will be discussed with an emphasis on its conciseness and on the effectiveness of the software tool. Currently, Singapore and the rest of the world are facing crisis due to the Covid-19 pandemic. For instance, the work-from-home scenario in Singapore is calling for new ways of working or collaborating. VR is offering an alternative solution to the conventional working mode. In this article, we present the latest work from VRcollab to assist our clients in these unusual circumstances.

A brief history of VR is presented in Section 2. Section 3 discusses the current VR development landscape. Section 4 introduces VRcollab, a VR Startup in Singapore. Section 5 presents the conclusions of this paper. VR HMD has evolved since then. In 2019, Facebook released its standalone and wireless VR headset, Oculus Quest [4] . Users no longer require a PC or mobile phone to operate and use camera-based positional tracking (Oculus Insight). This new headset, with a built-in computer unit, brings a new era of mobility and freedom to VR. The Oculus Quest headset was sold out across multiple retail stores in a week [5] and brought $5 million worth of VR content sales [6] in the first two weeks.

The global growth of VR has been aggressive in recent years partially due to its fast acceptance by the consumer market. Its primary demand comes from the industries of gaming, entertainment, and experiential events. VR has changed the way we consume content, giving users a more interactive and immersive experience. The VR industry is projected to reach US $209.2 billion [4] globally by 2022.

"AR/VR commercial uptake will continue to expand as cost of entry declines and benefits from full deployment become more tangible. Focus is shifting from talking about technology benefits to showing real and measurable business outcomes, including productivity and efficiency gains, knowledge transfer, employee's safety, and more engaging customer experiences", said Giulia Carosella from European Industry Solutions, Customer Insights & Analysis [6] .

Almost 50% of all AR/VR spending in 2020 is for commercial use cases with US$2.6 billion in training and US $914 million in industrial maintenance. Consumer spending takes up a third of the total AR/VR spending with US$3.3 billion in VR games and US$1.4 billion in VR feature viewing [6] . According to IDC Media Centre on Worldwide Spending on AR and VR, the top 3 fastest forecast spending growths from 2019-2023 are post-secondary lab and field at a 190.1% Compound Annual Growth Rate (CAGR), K-12 lab and field at 168.7% CAGR, and onsite assembly and safety with a CAGR of 129.5%. Training use cases will be the largest forecast spending in 2023 [6] .

Seeing the potential of VR growth, Apple, Google, Microsoft, Facebook, Samsung, IBM and other major players invested heavily in VR as of 2020. VR definitely has promising backers and believers moving forward. The use of VR for commerce [7] , primarily by enhancing shoppers' experience, is also a trend. Often, virtual tools 7 are used to augment real world environments helping shoppers locate items in a physical store [7] . VR is also used by allowing shoppers to customize a product of their interest. Even more interestingly, shoppers are now able to remotely and virtually walk through a digital twin of the store and purchase products as they would do in real life.

An upcoming trend in recent years would be the use of artificial intelligence (AI) technology to further enhance existing immersive technologies. Google in 2018 released a blogpost [8] explaining how they retrofitted the lens of a microscope with a deep learning computational device which feeds its overlay outputs to the AR display sitting over the lens. This device may be potentially used to better identify cancer tumors with the aid of deep learning, virtual and augmented reality technologies.

The Infocomm Media Development Authority of Singapore has VR immersive media as one key technology of its four focus areas in establishing Singapore's digital economy [9] . VR is expected to hugely impact the evolution of Singapore's digital economy in engineering, media, healthcare, education and retail. Among several national initiatives, here we introduce two of them which were mentioned by Dr.

Yaacob Ibrahim, Minister of Communications and Information [10] . The first is a pilot project launched in The other was launched in 2017 for VR/AR enhanced clinical training at Tan Tock Seng Hospital. "At present, VR will be used to complement traditional methods of clinical training because it cannot yet fully replicate qualities like tactile responses, patient and dynamic environmental changes, " said Dr. Ibrahim during his speech at the Infocomm Media Business Exchange (imbX) opening ceremony [10] .

Since the birth of the Internet, Infocomm and Media Technology has been growing exponentially, with VR innovation playing a significant role. In the past, VR was primarily in the consumer gaming space. While this trend will continue, we are seeing a rapid increase in VR commercial applications. This is largely due to the change of consumer habits as well as the drastic reduction of VR hardware cost. A further contribution comes from the relatively lower entry barriers to do VR compared to decades ago, allowing for VR to be a feasible solution and enhancement for multiple segments of use cases.

To improve productivity, increase efficiency, and reduce operation costs, a good number of enterprises in Singapore are embracing the latest VR technology for various applications from training to working. On the other end, general consumers, especially the younger population, become increasingly ready to use VR for the purpose of enhancing their different consuming experiences, such as shopping and entertainment.

Government agencies are also incorporating VR in some of their critical operations. For instance, police and civil defense departments have adopted VR in their training. VR is mandated for certain government building projects. We will further elaborate on these applications in the following areas of communication, collaboration and coordination, training, as well as visualization.

With the Internet, it is possible to work with people across different geographical locations in real time. 411

Yet, VR brings a new way of communication and collaboration. It creates an immersive and interactive experience for VR video conferencing by bringing people virtually closer to one another. Immersed in a VR environment, people can become much more focused in meetings without physical distractions.

Research shows a 25% higher attention can be expected in VR immersive conferencing in comparison to conventional video conferencing [11] . There are other substantial savings in terms of costs for traveling and spaces for physical meeting.

In the following, we will use the AEC industry as an example to illustrate the benefits of adopting VR.

For example, architects, engineers and contractors are able to virtually walk in their building before construction begins. Coordination in a VR environment makes it easier for teams to work together, understand better the building design, and resolve issues [12] . An architect overseas in New Zealand can collaborate and coordinate their work on the same building model with a contractor in Singapore as if they were in the same room.

In light of the Covid-19 pandemic and social distancing measures, many social and community functions and events have been cancelled entirely. Some of these events are of great importance to their participants. Events such as convocation ceremonies can be done in VR space. Graduates and event attendees are able to use their mobile phones and VR sets to join a virtual graduation ceremony from all over the world [13] .

VR is often used for training as it allows trainees to experience real situations in an immersive and safe environment. Traditional hands-on training typically requires physical equipment, space, and operational downtime. In some cases, trainees might be exposed to workplace hazards they are not prepared for. With VR, the training can take place anywhere and anytime, reducing costs for resources and waiting time.

Trainers can also customize the VR environment to train employees for different scenarios, equipping trainees with a vast knowledge to tackle varying problems.

Bombardier is an engineering firm in Singapore that is using a visualization program for training. This VR video helps their training team to showcase upcoming transportation system changes, developing a

better understanding of what is to be expected [14] .

The Home Team, consisting of the Singapore Police Force, Immigrations & Checkpoints Authority, International Security Department and Central Narcotics Bureau, have been using VR technology paired with a multi-directional treadmill allowing trainees to move around a certain scenario in order to further hone their skills before going on to the actual field where the margin for error is small if not non-existent [15] .

For example, first responders to a crime scene can be trained to handle a multitude of simulated scenarios and hone their decision-making skills repeatedly. This implementation also allows The Home

Team to be more effective in use of physical storage and spaces, allowing for a larger number of people to be trained more frequently compared to traditional scenario mockups, which require physical props, mockups and costly spaces.

Again in AEC businesses, VR helps users to visualize the design of a site before its construction, saving costs and producing better outcomes. From 2017 to 2019, there has been a rise in tender requirements for VR to be adopted in the direction of Virtual Design and Construction (VDC). A company will be at a big disadvantage without the VDC capability, if not completely excluded from competing for such projects.

BIM is a mandatory process in Singapore and VR is in trend to follow suit.

Furthermore, industry sources have claimed that VR has even been mandated for highly confidential construction projects in Singapore dealing with Military Bases and Prison Complexes, where it is used in building design sign-offs before construction begins. This works by using mandatory BIM submissions that are converted into VR usage via software that is built on top of game engines like Unity or Unreal.

One of the advantages of using VR with BIM is that designers and security consultants can validate their building design before construction can begin. This process allows for huge cost savings and mitigation of security concerns before the building is built.

In the following section, a number of companies from Singapore will be presented to showcase the latest status of industrial VR development.

Hiverlab [16] is an award-winning company with a focus on immersive technology. Hiverlab provides service on VR, AR, Mixed Reality (MR), Data Visualization System Integration and more. Digital Twin and

Storyhive are two of their main products.

Digital Twin is a digital replica of physical objects. Hiverlab VR system is able to visualize and interact with real-time data at different scales of perspectives. Such a digital twin service can effectively help in system monitoring, data analytics, scenarios simulation, and so on. In addition to preventing downtime, optimizing operations and improving performance, it can enable collaborations and assist decision making across geographies. Ultimately, all these lead a step forward into creating a smart city, a smart nation, and a smart world [17] .

Storyhive is Hiverlab's proprietary AR/VR system and platform for interactive presentation, broadcasting, and communication with immersive technology. It empowers content creators to upload and create their immersive experiences. Since its launch in 2016, Storyhive has been widely used for training, education, corporate communication, marketing campaigns, public events, virtual tourism regionally and globally [18] .

Believing that the virtual space will be a game changer in many aspects of human activities, IgniteVR [19] is committed to being part of this change. Their services are geared towards exposing the masses to the possibilities of VR, by providing immersive experiences along with informative discussions. IgniteVR offers services such as VR hardware rental, VR events, VR development and prototyping.

"VR is a new thing so we need to educate people on how to use the hardware, what are the benefits, why they are paying so much for it and what is their return on investment", said Roy Koo, founder of IgniteVR.

He also highlighted some daily challenges we face with VR.

Based in Singapore, VizioFly [20] is an interactive media content production company for film, education, 

Creating meaningful solutions in the domain of VR, AR & Applied Games, MAGES STUDIO [21] is a Creative Tech solution provider in Singapore. MAGES STUDIO is skilled in building complex interactions for 3D VR solutions using popular game engines like Unreal and Unity3D. MAGES STUDIO provides virtual shopping experience by creating a 360°virtual retail environment using superimposed computer generated 3D products, Gaze tracking, and so on [22] .

MAGES STUDIO also worked with some prominent airlines to build hyper-realistic training modules for a wide variety of aircrafts. Such VR-enabled training sessions lead to massive cost savings, while collecting valuable training data that can improve further developments [23] .

EON Reality [24] is a multinational company and the world leader in VR/AR academic and industry training solutions with more than 20 locations worldwide. EON Reality has created the largest AR/VR training library with over 8000 applications and 40 million users around the world. EON Reality Singapore is the regional headquarters and R&D center in Asia with a focus on the local market for content creation, platform and application development. In 2019, EON Reality was awarded the top honors for best AR/VR solution in education at EduTECH Asia.

US$177.5 billion are wasted annually due to poor communication, reworks, and bad data management in the AEC industry [25] . As such, Virtual Design Reviews play a crucial role in the shift towards a fully 

"Build Twice: First Virtual, and then Real [26] " is a phrase by the Building Construction Authority (BCA) of Singapore to illustrate the essence of the VDC construction methodology. Building twice enables a project team to fully simulate design and construction in a virtual environment first, prior to actual execution on site. This means that at every stage from design to actual construction, virtual designs of the buildings will first have to be validated and approved before the construction phase can begin.

This is exactly where VR plays a critical role, allowing designers to be virtually immersed in the building before it is actually built. This way possible errors and mistakes can be ironed out as early as in the design or planning phases. VR can be further served as a new medium throughout various construction stages for collaboration between consultants during design reviews. VR will primarily be adopted in VDC to address constructability issues within a project by spotting potential conflicts virtually, prior to actual execution. The potential benefits would include reduced schedule variability, a smoother workflow and increased productivity overall.

Digital Construction and Digital Asset Delivery & Management are gaining importance as two major components within this overall framework for IDD. To facilitate this shift, it will be crucial to embrace cloud and digital technologies that can integrate stakeholders in the building life cycle management of any given project. As such, collaborative digital platforms are being developed that can aid building consultants in this new digital workflow.

One such platform for collaboration between construction professionals would be VRcollab LITE, a software that converts BIM for use in VR design reviews, building requirement approval and construction coordination. It is compatible with industry standard BIM formats including: ArchiCAD, REVIT, Rhino, Sketchup, Navisworks, and Obj. With VRcollab, AEC professionals can host coordination meetings in an interactive, immersive 1:1 scaled VR environment. In Figure 2 , two users stand in front of a green screen to illustrate what they can experience with VR headsets to coordinate a BIM design review in a VR environment.

The Covid-19 pandemic has affected countries globally. Many cities have served lockdown notices as an effort to flatten the infection curve and slow down the death rate. The Singapore government has introduced the "Circuit Breaker" for a period from April 7 th to June 1 st 2020. As of the time this article is prepared, we cannot say for certain the end date of the Circuit Breaker. What we do know is that the pandemic has changed how companies operate. Non-essential businesses have to be done from home.

Otherwise, the business must stop its operations until the Circuit Breaker period is over [27] .

Under the work-from-home scheme, project teams can work remotely with the VRcollab LITE platform.

Collaboration and coordination can be developed without the physical presence on-site, taking advantage of VR visualization. VRcollab's innovative solution enables project teams working from home to be immersed in the same virtual environment resembling a digital twin of the actual work environment;

making it more convenient for professionals to work without disruption in this Circuit Breaker period.

During the Stay Home Notice period, VRcollab has seen an increase in requests from potential clients on how they could use VR in their operations with VRcollab's collaboration and coordination solution. A survey was conducted with three VRcollab clients. The feedback is illustrated in Tables 1, 2 and 3 with a simple comparison on productivity, manpower, and cost changes using VR tools. It can be seen in Table 1 that with the help of VRcollab, a Surbana Jurong project team achieves an improvement of operational efficiency from 5 days of coordination to 1 day, and a reduction of their manpower from 4 to 2 staff members. However, the survey does not include operational expenses and sales revenues.

The results from BHCC Construction Pte. Ltd. is shown in Table 2 indicating an improvement in operational efficiency from 8 hours to 5 hours. In total, they moved from 5 days of coordination to 1 day, saving the team a total of 4 days.

The results from Hexacon Construction Pte. Ltd.

( 

The biggest problem of loading a BIM model into a VR system is the file size and the frame rate. Research shows that the human eye is not able to differentiate the virtual world and the real world only if the frame rate is higher than 90 fps [28] . But on the other hand, BIM files usually have a huge geometry size, which causes a big amount of draw calls and decreases the frame rate. VRcollab provides a technology which allows partially loading the file and rendering only the important geometry in front of the user. Moreover, we have integrated the latest Intel Ray Tracing framework Embree [29] in the VRcollab solution aiming to develop a faster physics system instead of the Unity PhysX system (Table 4 ).

A school model is exported directly from its Revit sample model. In Table 4 , we garner that for Unity's default physics engine, it has to synchronize with the rendering system; thus, it is impossible to evaluate the ray intersection on the separate threads. We use Embree as a native module in Unity to perform the ray intersection. Embree uses multi threads to build the acceleration structure and since there is no physics 

The "Merge" function with VRcollab allows multiple BIM that have been modeled on different software to be combined into one single model, facilitating an easy workflow ( Figure 4 ) for consultants.

In addition, the multi-user VR functionality aids in the seamless communication between groups whether in one physical location or remotely via the internet. This is further enhanced by VDC-oriented software features and automated document generation, allowing professionals to be effective and efficient within the VR environment [30] .

VR is already being massively adopted and utilized across multiple industries in Singapore, as the country moves towards a digital economy. The demand for VR technology will continue to rise in both the commercial and consumer markets. In the coming years, VR is expected to be widely used in every 

The ultimate display

AFIPS '68 (Fall, partI)

IMDA, Annexes A-2 Immersive Media And Advanced Interfaces Report

Oculus sold $5 million worth of Quest content in the first 2 weeks on sale

Home team turns to virtual reality to train crime scene investigators

Virtual reality shopping and artificial intelligence-5 Near-Term applications

Worldwide spending on augmented and virtual reality expected to reach $18.8 billion in 2020, according to IDC

Singapore identifies four frontier technology focus areas for digital economy

Singapore government exploring the use of virtual reality for school education and enhanced clinical training

The future of communicating with your audience is here and it's VR

Polytechnic students hold virtual graduation ceremonies

Case study: using virtual reality in coordination meetings

Covid-19 circuit breaker: Closure of workplace premises

Bombardier VR train visualization case study

Cost management in construction projects: rework and its effects

Hiverlab's official website

The use of virtual reality in Yacht design and visualization. International Naval Architecture and Maritime Symposium