Virtual reality

A person wearing a virtual reality headset

Virtual reality (VR) typically refers to computer technologies that use software to generate realistic images, sounds and other sensations that replicate a real environment (or create an imaginary setting), and simulate a user's physical presence in this environment, by enabling the user to interact with this space and any objects depicted therein using specialized display screens or projectors and other devices. VR has been defined as "...a realistic and immersive simulation of a three-dimensional environment, created using interactive software and hardware, and experienced or controlled by movement of the body"^[1] or as an "immersive, interactive experience generated by a computer".^[2] A person using virtual reality equipment is typically able to "look around" the artificial world, move about in it and interact with features or items that are depicted on a screen or in goggles. Virtual realities artificially create sensory experiences, which can include sight, touch, hearing, and, less commonly, smell. Most 2016-era virtual realities are displayed either on a computer monitor, a projector screen, or with a virtual reality headset (also called head-mounted display or HMD). HMDs typically take the form of head-mounted goggles with a screen in front of the eyes. Some simulations include additional sensory information and provide sounds through speakers or headphones. Virtual Reality actually brings the user into the digital world by cutting off outside stimuli. In this way user is solely focusing on the digital content.

Virtual reality environment can be captured using 360° stereoscopic spherical video and 360x360 surround sound from professional VR video cameras. The users can emerge in the virtual reality environment using head-mounted displays.

Some advanced haptic systems in the 2010s now include tactile information, generally known as force feedback in medical, video gaming and military training applications. Some VR systems used in video games can transmit vibrations and other sensations to the user via the game controller. Virtual reality also refers to remote communication environments which provide a virtual presence of users with through telepresence and telexistence or the use of a virtual artifact (VA), either through the use of standard input devices such as a keyboard and mouse, or through multimodal devices such as a wired glove or omnidirectional treadmills. The immersive environment can be similar to the real world in order to create a lifelike experience—for example, in simulations for pilot or combat training, which depict realistic images and sounds of the world, where the normal laws of physics apply (e.g., in flight simulators), or it can differ significantly from reality, such as in VR video games that take place in fantasy settings, where gamers can use fictional magic and telekinesis powers.

Etymology and terminology

Paramount for the sensation of immersion into virtual reality are a high frame rate (at least 95 fps), as well as a low latency. Furthermore, a pixel persistence lower than 3 ms is required, because if not, users will feel sick when moving their head around.

In 1938, Antonin Artaud described the illusory nature of characters and objects in the theatre as "la réalité virtuelle" in a collection of essays, Le Théâtre et son double. The English translation of this book, published in 1958 as The Theater and its Double,^[3] is the earliest published use of the term "virtual reality". The term "artificial reality", coined by Myron Krueger, has been in use since the 1970s. The term "virtual reality" was used in The Judas Mandala, a 1982 science fiction novel by Damien Broderick. The Oxford English Dictionary cites a 1987 article titled "Virtual reality",^[4] but the article is not about VR technology. "Virtual" has had the meaning "being something in essence or effect, though not actually or in fact" since the mid-1400s, "...probably via sense of "capable of producing a certain effect" (early 1400s)".^[5] The term "virtual" was used in the "computer sense of "not physically existing but made to appear by software" since 1959.^[5] The term "reality" has been used in English since the 1540s, to mean "quality of being real," from "French réalité and directly Medieval Latin realitatem (nominative realitas), from Late Latin realis".^[6]

Virtual reality is also called "virtual realities", "immersive multimedia", "artificial reality"^[7] or "computer-simulated reality". A dictionary definition for "cyberspace" states that this word is a synonym for "virtual reality".^[8]

Virtual reality shares some elements with "augmented reality" (or AR). AR is a type of virtual reality technology that blends what the user sees in their real surroundings with digital content generated by computer software. The additional software-generated images with the virtual scene typically enhance way the real surroundings look in some way. Some AR systems use a camera to capture the user's surroundings or some type of display screen which the user looks at (e.g., Microsoft’s HoloLens, Magic Leap).

History

Before the 1950s

The Sensorama was released in the 1950s.

View-Master, a stereoscopic visual simulator, was introduced in 1939.

The first references to the concept of virtual reality came from science fiction. Stanley G. Weinbaum's 1935 short story "Pygmalion's Spectacles"^[9] describes a goggle-based virtual reality system with holographic recording of fictional experiences, including smell and touch.

1950–1970

Morton Heilig wrote in the 1950s of an "Experience Theatre" that could encompass all the senses in an effective manner, thus drawing the viewer into the onscreen activity. He built a prototype of his vision dubbed the Sensorama in 1962, along with five short films to be displayed in it while engaging multiple senses (sight, sound, smell, and touch). Predating digital computing, the Sensorama was a mechanical device. Around the same time, Douglas Engelbart used computer screens as both input and output devices. In 1968, Ivan Sutherland, with the help of his student Bob Sproull, created what is widely considered to be the first virtual reality and augmented reality (AR) head-mounted display (HMD) system. It was primitive both in terms of user interface and realism, and the HMD to be worn by the user was so heavy that it had to be suspended from the ceiling. The graphics comprising the virtual environment were simple wire-frame model rooms. The formidable appearance of the device inspired its name, The Sword of Damocles.

1970–1990

Battlezone, an arcade video game from 1980, used 3D vector graphics to immerse the player in a VR world.(Atari).

Also notable among the earlier hypermedia and virtual reality systems was the Aspen Movie Map, which was created at MIT in 1978. The program was a crude virtual simulation of Aspen, Colorado in which users could wander the streets in one of three modes: summer, winter, and polygons. The first two were based on photographs—the researchers actually photographed every possible movement through the city's street grid in both seasons—and the third was a basic 3-D model of the city. Atari founded a research lab for virtual reality in 1982, but the lab was closed after two years due to Atari Shock (North American video game crash of 1983). However, its hired employees, such as Tom Zimmerman, Scott Fisher, Jaron Lanier and Brenda Laurel, kept their research and development on VR-related technologies. By the 1980s the term "virtual reality" was popularized by Jaron Lanier, one of the modern pioneers of the field. Lanier had founded the company VPL Research in 1985. VPL Research has developed several VR devices like the Data Glove, the Eye Phone, and the Audio Sphere. VPL licensed the Data Glove technology to Mattel, which used it to make an accessory known as the Power Glove. While the Power Glove was hard to use and not popular, at US$75, it was early affordable VR device.

During this time, virtual reality was not well known, though it did receive media coverage in the late 1980s. Most of its popularity came from marginal cultures, like cyberpunks, who viewed the technology as a potential means for social change, and the recreational drug subculture, who praised virtual reality not only as a new art form, but as an entirely new frontier.^[10] Some drug users consume drugs while using VR technologies.^[11] The concept of virtual reality was popularized in mass media by movies such as Brainstorm (1983) and The Lawnmower Man. The VR research boom of the 1990s was accompanied by the non-fiction book Virtual Reality (1991) by Howard Rheingold.^[12] The book served to demystify the subject, making it more accessible to researchers outside of the computer sphere and sci-fi enthusiasts.

Once the industry began to attract media coverage, some even compared the innovations in virtual reality to the Wright Brothers' pioneering invention of the airplane.^[13] In 1990, Jonathan Waldern, a VR Ph.D, demonstrates "Virtuality" at the Computer Graphics 90 exhibition staged at London's Alexandra Palace. This new system was an arcade machine that would use a virtual reality headset to immerse players. CyberEdge and PCVR, two VR industry magazines, started to publish in the early 1990s. However, most ideas about VR remained theoretical due to the limited computing power available at the time. The extremely high cost of the technology made it impossible for consumers to adopt. When the Internet became widely available, this became the technology focus for most people. The VR industry mainly provided VR devices for medical, flight simulation, automobile industry design, and military training purposes from 1970 to 1990.

1990–2000

A VPL Research DataSuit, a full-body outfit with sensors for measuring the movement of arms, legs, and trunk. Developed circa 1989. Displayed at the Nissho Iwai showroom in Tokyo

In 1991, Sega announced the Sega VR headset for arcade games and the Mega Drive console. It used LCD screens in the visor, stereo headphones, and inertial sensors that allowed the system to track and react to the movements of the user's head.^[14] In the same year, Virtuality launched and went on to become the first mass-produced, networked, multiplayer VR entertainment system. It was released in many countries, including a dedicated VR arcade at Embarcadero Center in San Francisco. Costing up to $73,000 per multi-pod Virtuality system, they featured headsets and exoskeleton gloves that gave one of the first "immersive" VR experiences.^[15] Antonio Medina, a MIT graduate and NASA scientist, designed a virtual reality system to "drive" Mars rovers from Earth in apparent real time despite the substantial delay of Mars-Earth-Mars signals. The system, termed "Computer-Simulated Teleoperation" as published by Rand, is an extension of virtual reality.^[16]

In 1991, Carolina Cruz-Neira, Daniel J. Sandin and Thomas A. DeFanti from the Electronic Visualization Laboratory created the first cubic immersive room, replacing goggles by a multi-projected environment where people can see their body and other people around. In that same year, Computer Gaming World predicted "Affordable VR by 1994".^[17] By 1994, Sega released the Sega VR-1 motion simulator arcade attraction,^[18][19] in SegaWorld amusement arcades. It was able to track head movement and featured 3D polygon graphics in stereoscopic 3D, powered by the Sega Model 1 arcade system board.^[20] Also in 1994 Apple released QuickTime VR, which, despite using the term "VR", was unable to represent virtual reality, and instead displayed 360 photographic panoramas.

A year later, the artist Maurice Benayoun created the first VR artwork connecting in real time 2 continents: the "Tunnel under the Atlantic" between the Pompidou Centre in Paris and the Museum of Contemporary Art in Montreal. The installation included dynamic real time 3d modeling, video chat, spatialized sound and AI content management. A non-VR system called the Virtual Boy was created by Nintendo and was released in Japan on July 21, 1995 and in North America on August 15, 1995.^[21] Also in 1995, a group in Seattle created public demonstrations of a "CAVE-like" 270 degree immersive projection room called the Virtual Environment Theater, produced by entrepreneurs Chet Dagit and Bob Jacobson.^[22] Then in 1996 the same system was shown in tradeshow exhibits sponsored by Netscape Communications, and championed by Jim Barksdale, for the first time showing VR connected to the Internet with World Wide Web content feeds embedded in VRML 3D virtual world models. Forte released the VFX1, a PC-powered virtual reality headset in 1995, which was supported by games including Descent, Star Wars: Dark Forces, System Shock and Quake. In 1999, entrepreneur Philip Rosedale formed Linden Lab with an initial focus on the development of hardware that would enable computer users to be fully immersed in a 360 degree virtual reality experience. In its earliest form, the company struggled to produce a commercial version of "The Rig," which was realized in prototype form as a clunky steel contraption with several computer monitors that users could wear on their shoulders.^[23] That vision soon morphed into the software-based, 3D virtual world Second Life.

A 2013 developer version of Oculus Rift from Oculus VR, a company Facebook acquired in 2014 for $2 billion

2000–present

The affordable and accessible Google Cardboard standard.

In 2001, SAS3 or SAS Cube became the first PC based cubic room, developed by Z-A Production (Maurice Benayoun, David Nahon), Barco, Clarté, installed in Laval France in April 2001. The SAS library gave birth to Virtools VRPack. By 2007, Google introduced Street View, a service that shows panoramic views of an increasing number of worldwide positions such as roads, indoor buildings and rural areas. It also features a stereoscopic 3D mode, introduced in 2010.^[24] In 2010, Palmer Luckey, who later went on to found Oculus VR, designed the first prototype of the Oculus Rift. This prototype, built on a shell of another virtual reality headset, displayed only 2-D images and was noticeably cumbersome to wear. However, it boasted a 90-degree field of vision that was previously unseen anywhere in the market at the time. This initial design would later serve as a basis from which the later designs came.^[25]

In 2013, Nintendo filed a patent for the concept of using VR technology to produce a more realistic 3D effect on a 2D television. A camera on the TV tracks the viewer's location relative to the TV, and if the viewer moves, everything on the screen reorients itself appropriately. "For example, if you were looking at a forest, you could shift your head to the right to discover someone standing behind a tree."^[26] In July 2013, Guild Software's Vendetta Online was widely reported as the first MMORPG to support the Oculus Rift,^[27][28] making it potentially the first persistent online world with native support for a consumer virtual reality headset. Since 2013, there have been several virtual reality devices that seek to enter the market to complement Oculus Rift to enhance the game experience. One, Virtuix Omni, is based on the ability to move in a three dimensional environment through an omnidirectional treadmill.

On March 25, 2014, Facebook purchased a company that makes virtual reality headsets, Oculus VR, for $2 billion.^[29] In that same month, Sony announced Project Morpheus (its code name for PlayStation VR), a virtual reality headset for the PlayStation 4 video game console.^[30] Google announces Cardboard, a do-it-yourself stereoscopic viewer for smartphones. The user places her smartphone in the cardboard holder, which she wears on her head. In 2015, the Kickstarter campaign for Gloveone, a pair of gloves providing motion tracking and haptic feedback, was successfully funded, with over $150,000 in contributions.^[31]

In February–March 2015, HTC partnered with Valve Corporation announced their virtual reality headset HTC Vive and controllers, along with their tracking technology called Lighthouse, which utilizes "base stations" mounted to the wall above the user's head in the corners of a room for positional tracking of the Vive headset and its motion controllers using infrared light.^{[32][33][34][35]} The company announced its plans to release the Vive to the public in April 2016 on December 8, 2015.^[36][37] Units began shipping on April 5, 2016.^[38]

In July 2015, OnePlus became the first company to launch a product using virtual reality.^[39] They used VR as the platform to launch their second flagship device the OnePlus 2, first viewable using an app on the Google Play Store,^[40] then on YouTube.^[41] The launch was viewable using OnePlus Cardboard, based on the Google's own Cardboard platform. The whole VR launch had a runtime of 33 minutes, and was viewable in all countries. Also in 2015, Jaunt, a startup company developing cameras and a cloud distribution platform, whose content will be accessible using an app, reached $100 million in funding from such sources as Disney and Madison Square Garden.^[42] On April 27, 2016, Mojang announced that Minecraft is now playable on the Gear VR.^[43] Minecraft is still being developed for the Oculus Rift headset but a separate version was released to the Oculus Store for use with the Gear VR. This version is similar to the Pocket Edition of Minecraft.

Use

Education and training

U.S. Navy personnel using a VR parachute training simulator.

Research has been done on learning in virtual reality, as its immersive qualities may enhance learning. VR is used by trainers to provide learners with a virtual environment where they can develop their skills without the real-world consequences of failing. Thomas A. Furness III was one of the first to develop the use of VR for military training when, in 1982, he presented the Air Force with his first working model of a virtual flight simulator he called the Visually Coupled Airborne Systems Simulator (VCASS). By the time he started his work on VCASS, aircraft were becoming increasingly complicated to handle and virtual reality provided a better solution to previous training methods. Furness attempted to incorporate his knowledge of human visual and auditory processing to create a virtual interface that was more intuitive to use. The second phase of his project, which he called the "Super Cockpit", was even more advanced, with high resolution graphics (for the time) and a responsive display. Furness is often credited as a pioneer in virtual reality for this research.^[10] VR plays an important role in combat training for the military. It allows the recruits to train under a controlled environment where they are to respond to different types of combat situations. A fully immersive virtual reality that uses head-mounted display (HMD), data suits, data glove, and VR weapon are used to train for combat. This setup allows the training's reset time to be cut down, and allows more repetition in a shorter amount of time. The fully immersive training environment allows the soldiers to train through a wide variety of terrains, situations and scenarios.^[44]

A headscreen-wearing soldier sits at a gunner station while learning in a Virtual Training Suite.

VR is also used in flight simulation for the Air Force where people are trained to be pilots. The simulator would sit on top of a hydraulic lift system that reacts to the user inputs and events. When the pilot steer the aircraft, the module would turn and tilt accordingly to provide haptic feedback. The flight simulator can range from a fully enclosed module to a series of computer monitors providing the pilot's point of view. The most important reasons on using simulators over learning with a real aircraft are the reduction of transference time between land training and real flight, the safety, economy and absence of pollution.^[45] By the same token, virtual driving simulations are used to train tank drivers on the basics before allowing them to operate the real vehicle.^[46] Finally, the same goes for truck driving simulators, in which Belgian firemen are for example trained to drive in a way that prevents as much damage as possible. As these drivers often have less experience than other truck drivers, virtual reality training allows them to compensate this. In the near future, similar projects are expected for all drivers of priority vehicles, including the police.^[47]

Medical personnel are able to train through VR to deal with a wider variety of injuries.^[48] An experiment was performed by sixteen surgical residents where eight of them went through laparoscopic cholecystectomy through VR training. They then came out 29% faster at gallbladder dissection than the controlled group.^[49] With the increased commercial availability of certified training programs for basic skills training in VR environments, students have the ability to familiarize themselves with necessary skills in a corrective and repetitive environment; VR is also proven to help students familiarize themselves with skills not specific to any particular procedure.^[50] VR application was used to train road crossing skills in children. It proved to be rather successful. However some students with autistic spectrum disorders after such training might be unable to distinguish virtual from real. As a result, they may attempt quite dangerous road crossings.^[51]

Video games

PlayStation VR headset used in video games

A person wearing haptic feedback devices, which enable her to feel elements in the virtual world.

The use of graphics, sound and input technology in video games can be incorporated into VR. Several Virtual Reality head mounted displays (HMD) were released for gaming during the early-mid 1990s. These included the Virtual Boy developed by Nintendo, the iGlasses developed by Virtual I-O, the Cybermaxx developed by Victormaxx and the VFX1 Headgear developed by Forte Technologies. Other modern examples of narrow VR for gaming include the Wii Remote, the Kinect, and the PlayStation Move/PlayStation Eye, all of which track and send motion input of the players to the game console somewhat accurately. Several companies were working on a new generation of VR headsets, which were released on March 28, 2016: Oculus Rift is a head-mounted display for gaming purposes developed by Oculus VR, an American technology company that was acquired for US$2 billion by Facebook in 2014. One of its rivals was named by Sony as PlayStation VR (codenamed Morpheus), which requires a PS4 instead of a PC to run. The PlayStation VR is significantly more limited than the Oculus Rift due to the fact that the PC can be replaced with more powerful components in the future. In 2015, Valve Corporation announced their partnership with HTC to make a VR headset capable of tracking the exact position of its user in a 4.5 by 4.5 meters area, the HTC Vive.^[52] All these virtual reality headsets are tethered headsets that use special lenses to magnify and stretch a 5.7-inch screen (in the case of Morpheus) across the field of vision. There are more gaming VR headsets in development, each with its own special abilities. StarVR offers a 210° field of view, whereas FOVE tracks the position of your eyes as an input method.^[53]

Entertainment

Virtual reality technologies are also widely used in entertainment and have reflected in virtual reality simulators (VR simulators/ VR amusements/ VR game simulators/ vr motion simulators).

Fine arts

David Em was the first fine artist to create navigable virtual worlds in the 1970s.^[54] His early work was done on mainframes at Information International, Inc., Jet Propulsion Laboratory, and California Institute of Technology. Jeffrey Shaw explored the potential of VR in fine arts with early works like Legible City (1989), Virtual Museum (1991), and Golden Calf (1994). Canadian artist Char Davies created immersive VR art pieces Osmose (1995) and Ephémère (1998). Maurice Benayoun's work introduced metaphorical, philosophical or political content, combining VR, network, generation and intelligent agents, in works like Is God Flat? (1994), "Is the Devil Curved?" (1995), The Tunnel under the Atlantic (1995), and World Skin, a Photo Safari in the Land of War (1997). Other pioneering artists working in VR have include Knowbotic Research, Rebecca Allen and Perry Hoberman.^[55]

Engineering

The use of 3D computer-aided design (CAD) data was limited by 2D monitors and paper printouts until the mid-to-late 1990s, when video projectors, 3D tracking, and computer technology enabled a renaissance in the use 3D CAD data in virtual reality environments. With the use of active shutter glasses and multi-surface projection units immersive engineering was made possible by companies like VRcom and IC.IDO. Virtual reality has been used in automotive, aerospace, and ground transportation original equipment manufacturers (OEMs) in their product engineering and manufacturing engineering . Virtual reality adds more dimensions to virtual prototyping, product building, assembly, service, performance use-cases. This enables engineers from different disciplines to view their design as its final product. Engineers can view the virtual bridge, building or other structure from any angle. As well, some computer models allow engineers to test their structure's resistance to winds, weight, and other elements. Immersive VR engineering systems enable engineers, management and investors to see virtual prototypes prior to the availability of any physical prototypes.

Heritage and archaeology

The first use of a VR presentation in a heritage application was in 1994, when a museum visitor interpretation provided an interactive "walk-through" of a 3D reconstruction of Dudley Castle in England as it was in 1550. This consisted of a computer controlled laserdisc-based system designed by British-based engineer Colin Johnson. The system was featured in a conference held by the British Museum in November 1994, and in the subsequent technical paper, Imaging the Past – Electronic Imaging and Computer Graphics in Museums and Archaeology.^[56] Virtual reality enables heritage sites to be recreated extremely accurately, so that the recreations can be published in various media.^[57] The original sites are often inaccessible to the public or, due to the poor state of their preservation, hard to picture.^[58] This technology can be used to develop virtual replicas of caves, natural environment, old towns, monuments, sculptures and archaeological elements.^[59]

Architectural design

A visitor at Mozilla Berlin Hackshibition trying Oculus Rift virtual reality experience on Firefox.

One of the first recorded uses of virtual reality in architecture was in the late 1980s when the University of North Carolina modeled its Sitterman Hall, home of its computer science department, in a virtual environment.^[13] Several companies, including IrisVR and Floored, Inc., provide software or services that allow architectural design firms and various clients in the real estate industry to tour virtual models of proposed building designs. IrisVR currently provides software that allows users to convert design files created in CAD programs like SketchUp and Revit into files viewable with an Oculus Rift, HTC Vive, or a smartphone "in one click," without the need for complex tiered workflows or knowledge of game engines such as Unity3D.^[60] Floored, meanwhile, manually constructs and refines Rift-viewable 3D models in-house from either CAD files for un-built designs or physical scans of already built, brick-and-mortar buildings, and provides clients with access to its own viewing software, which can be used with either an Oculus Rift or a standard 2D web browser, afterward.^[61]

VR software products like these can provide a number of benefits to architects and their clients. During the design process, architects can use VR to experience the designs they are working on before they are built. Seeing a design in VR can give architect a correct sense of scale and proportion.^[62] Having an interactive VR model also eliminates the need to make physical miniatures to demonstrate a design to clients or the public. Later on, after a building is constructed, developers and owners can create a VR model of a space that allows potential buyers or tenants to tour a space in VR, even if real-life circumstances make a physical tour unfeasible. For instance, if the owner of an apartment building has a VR model of a space while the building is under construction, she can begin showing and renting the units before they are even ready to be occupied. Furthermore, this sort of showing can be conducted over any distance, as long as the potential customer has access to a VR setup (or, even, with the help of Google Cardboard or a similar phone-based VR headset, nothing but a smartphone.)

Urban design

A land development plan using Prefurbia, a 4th generation design system.

In 2010, 3D virtual reality was beginning to be used for urban regeneration, planning and transportation projects.^[63] In 2007, development began on a virtual reality software which took design coordinate geometry used by land surveyors and civil engineers and incorporated precision spatial information created automatically by the lines and curves typically shown on subdivision plats and land surveying plans. These precise spatial areas cross referenced color and texture to an item list. The item list contained a set of controls for 3D rendering, such as water reflective surfaces or building height. The land surface in software to create a contour map uses a digital terrain model (DTM). By 2010, prototype software was developed for LandMentor, a technology to automate the process leading from design to virtualization. The first beta users in 2011 were able drape the design or survey data over the digital terrain to create data structures that were passed into a video game engine. The engine was able to create a virtual interactive world. The software was improved to implement 3D models from other free or commercially sold software to create a more realistic virtual reality.

A streetscape with homes, showing architectural shaping and blending

Therapy

The primary use of VR in a therapeutic role is its application to various forms of exposure therapy, including phobia treatments.

Theme parks

Since 2015, virtual reality has been installed onto a number of roller coasters, including Galactica at Alton Towers, The New Revolution at Six Flags Magic Mountain and Alpenexpress at Europapark, amongst others. The Void is a virtual reality theme park in Pleasant Grove, Utah that has attractions where, by using virtual reality and other new technologies that haven't yet hit the market, you can play the game as if you where inside it. An illusion created by more than one of our senses. In this park, you can see, smell and even touch what is happening in the game.

Concerts

Assembled Google Cardboard VR

In Oslo Spektrum on May the 3rd 2016, Norwegian pop band a-ha cleared away their normal stage-production to give room for a very different concert performance in collaboration with Void, a Norwegian computational design studio working in the intersection between design, architecture, art and technology. The collaboration resulted in a unique one-of-a-kind concert with advanced scenography using 360 virtual reality technology. It used movement sensors that reacted to the band members' movements, voices and instruments. 3D cameras, 20000 lines of codes, 1000 square meters of projection film and massive projectors was set up into a visual show that made the Oslo Spektrum arena in Oslo, Norway into a light installation and visual experience that unfolded live for the audience instead of a pre programmed sequence. The stereoscopic VR-experience was made available for Android users directly through a YouTube app and also made available for iPhone users and other platforms.^[64][65][66]

Retail

Lowe's, IKEA and Wayfair and other retailers have developed systems that allow their products to be seen in virtual reality, to give consumers a better idea of how the product will fit into their home, or to allow the consumer to get a better look at the product from home.^[67] Consumers looking at digital photos of the products can "turn" the product around virtually, and see it from the side or the back. This enables customers to get a better sense of how a product looks and about its features, than with the typical single picture used in traditional paper catalogues. The retail travel industry such as Cruise About and Flight Centre have been adopting VR to enable customer in their stores to view cruise cabins, tourism content, and hotel rooms prior to booking.

Charity

Non-profit organisations such as Amnesty International, UNICEF, and World Wide Fund for Nature (WWF) have started using virtual reality to bring potential supporters closer to their work, effectively bringing distant social, political and environmental issues and projects to members of the public in immersive ways not possible with traditional media. Panoramic 360 views of conflict in Syria^[68] and face to face encounters with CGI tigers in Nepal^[69] have been used in experiential activations and shared online to both educate and gain financial support for such charitable work.

Exercise and fitness

Certain companies are using VR to target the fitness industry by using gamification concepts from video games to distract from the tedium of exercise.^[70]

Film

Many companies, including GoPro, Nokia, Samsung, Ricoh and Nikon, develop omnidirectional cameras, also known as 360-degree cameras or VR cameras, that have the ability to record in all directions.^[71] These cameras are used to create images and videos that can be viewed in VR. (See VR photography.) Films produced for VR permit the audience to view the entire environment in every scene, creating an interactive viewing experience. Production companies, such as Fox Searchlight Pictures and Skybound, utilize VR cameras to produce films that are interactive in VR. Fox Searchlight, Oculus and Samsung Gear VR collaborated on a project titled "Wild – The Experience", starring Reese Witherspoon. The VR film was presented at the Consumer Electronics Show as well as the Sundance Film Festival in January 2015.^[72] On December 8, 2015, the production company Skybound announced their VR thriller titled "Gone". In collaboration with the VR production company WEVR, and Samsung Gear VR, the 360-degree video series was released on January 20, 2016.^[73][74]

Media

Media companies such as Paramount Pictures, and Disney have applied VR into marketing campaigns creating interactive forms of media. In October 2014 Paramount Pictures, in collaboration with the media production company Framestore, created a VR experience utilizing the Oculus DK2. The experience was dubbed a "time sensitive adventure in space" that took place in a portion of the Endurance space ship from the film "Interstellar." The experience was available to the public at limited AMC theater locations.^[75][76] In May 2016, Disney released a VR experience titled Disney Movies VR on Valve Corporation's Steam software, free for download. The experience allows users to interact with the characters and worlds from the Disney, Marvel, and Lucasfilm universes.^[77]

Pornography

Pornographic studios such as Naughty America, BaDoinkVR and Kink have applied VR into their products since late 2015 or early 2016. The clips and videos are shot from an angle that resembles POV-style porn.^[78][79]

Marketing

Virtual Reality has the potential to completely replace many forms of digital marketing.^[80] Marketing strategies in small and middle sized enterprises, ever more frequently include virtual reality in their ad concepts, POS material and budgets. Virtual Reality presents a unique opportunity for advertisers to reach a completely immersed audience.^[81]

Sports viewing

In September 2016, Agon announced that the upcoming World Chess Championship match between Magnus Carlsen and Sergey Karjakin, scheduled for that November, would be "the first in any sport to be broadcast in 360-degree virtual reality."^[82]

Fox Sports unveiled Fox Sports VR, a series of virtual reality broadcasts consisting mainly of Fox College Football broadcasts, in September 2016. The telecasts (which use roughly 180 degrees of rotation) were made available through smartphone apps and head-mounted displays, with TV Everywhere authentication required. The first VR telecast, which featured Oklahoma hosting Ohio State, took place September 17.^[83][84]

In fiction

Many science fiction books and films have imagined characters being "trapped in virtual reality" or entering into virtual reality. A comprehensive and specific fictional model for virtual reality was published in 1935 in the short story "Pygmalion's Spectacles"^[9] by Stanley G. Weinbaum. A more modern work to use this idea was Daniel F. Galouye's novel Simulacron-3, which was made into a German teleplay titled Welt am Draht ("World on a Wire") in 1973. Other science fiction books have promoted the idea of virtual reality as a partial, but not total, substitution for the misery of reality, or have touted it as a method for creating virtual worlds in which one may escape from Earth. Stanisław Lem's 1961 story "I (Profesor Corcoran)", translated in English as "Further Reminiscences of Ijon Tichy I",^[85] dealt with a scientist who created a number of computer-simulated people living in a virtual world. Lem further explored the implications of what he termed "phantomatics" in his nonfictional 1964 treatise Summa Technologiae. The Piers Anthony novel Killobyte follows the story of a paralyzed cop trapped in a virtual reality game by a hacker, whom he must stop to save a fellow trapped player slowly succumbing to insulin shock.

A number of other popular fictional works use the concept of virtual reality. These include William Gibson's 1984 Neuromancer, which defined the concept of cyberspace, and his 1994 Virtual Light, where a presentation viewable in VR-like goggles was the MacGuffin. Other examples are Neal Stephenson's Snow Crash, in which he made extensive reference to the term avatar to describe one's representation in a virtual world, and Rudy Rucker's The Hacker and the Ants, in which programmer Jerzy Rugby uses VR for robot design and testing. The Otherland series of 4 novels by Tad Williams, published from 1996 to 2001 and set in the 2070s, shows a world where the Internet has become accessible via virtual reality. The Doctor Who serial "The Deadly Assassin", first broadcast in 1976, introduced a dream-like computer-generated reality, known as the Matrix. British BBC2 sci-fi series Red Dwarf featured a virtual reality game titled "Better Than Life", in which the main characters had spent many years connected. Saban's syndicated superhero television series VR Troopers also made use of the concept. The holodeck featured in Star Trek: The Next Generation is one of the best known examples of virtual reality in popular culture, including the ability for users to interactively modify scenarios in real time with a natural language interface. The depiction differs from others in the use of a physical room rather than a neural interface or headset.

The .hack multimedia franchise is based on a virtual reality MMORPG dubbed "The World". The French animated series Code Lyoko is based on the virtual world of Lyoko and the Internet. In 2009, British digital radio station BBC Radio 7 broadcast Planet B, a science-fiction drama set in a virtual world. Planet B was the largest ever commission for an original drama programme.^[86] The 2012 series Sword Art Online involves the concept of a virtual reality MMORPG of the same name, with the possibility of dying in real life when a player dies in the game. Also, in its 2014 sequel, Sword Art Online II, the idea of bringing a virtual character into the real world via mobile cameras is posed; this concept is used to allow a bedridden individual to attend public school for the first time.Accel World (2012) expands the concept of virtual reality using the game Brain Burst, a game which allows players to gain and receive points to keep accelerating; accelerating is when an individual's brain perceives the images around them 1000 times faster, heightening their sense of awareness.

In October 2016, television series Halcyon was released as a "virtual reality series", where some episodes are broadcast on conventional television, some as VR content for interfaces like Oculus Rift. The show, itself, is a crime drama following the world's first "VR Crimes Unit" in 2048.

Motion pictures

World Skin (1997), Maurice Benayoun's virtual reality interactive installation

• Rainer Werner Fassbinder's 1973 film Welt am Draht, based on Daniel F. Galouye's novel Simulacron-3, shows a virtual reality simulation inside another virtual reality simulation
• In 1983, the Natalie Wood / Christopher Walken film Brainstorm revolved around the production, use, and misuse of a VR device.
• Total Recall, directed by Paul Verhoeven and based on the Philip K. Dick story "We Can Remember It for You Wholesale"
• A VR-like system, used to record and play back dreams, figures centrally in Wim Wenders' 1991 film Until the End of the World.
• The 1992 film The Lawnmower Man tells the tale of a research scientist who uses a VR system to jumpstart the mental and physical development of his mentally handicapped gardener.
• The 1993 film Arcade is centered around a new virtual reality game (from which the film gets its name) that actively traps those who play it inside its world.
• The 1995 film Strange Days is a science-fiction thriller about a fictional virtual reality trend in which users buy illegal VR recordings of criminal offences recorded from the offender's point of view (POV).
• The 1995 film Johnny Mnemonic has the main character Johnny (played by Keanu Reeves) use virtual reality goggles and brain–computer interfaces to access the Internet and extract encrypted information in his own brain.
• The 1995 film Virtuosity has Russell Crowe as a virtual reality serial killer name SID 6.7 (Sadistic, Intelligent and Dangerous) who is used in a simulation to train real-world police officer, but manages to escape into the real world.
• The 1999 film The Thirteenth Floor is an adaptation of Daniel F. Galouye's novel Simulacron-3, and tells about two virtual reality simulations, one in another.
• In 1999, The Matrix and later sequels explored the possibility that our world is actually a vast virtual reality (or more precisely, simulated reality) created by artificially intelligent machines.
• eXistenZ (1999), by David Cronenberg, in which level switches occur so seamlessly and numerously that at the end of the movie it is difficult to tell whether the main characters are back in "reality".
• In the film Avatar, the humans are hooked up via advanced technologies with avatars, enabling the avatars to remotely perform the actions of the humans.
• Surrogates (2009) is based on a brain–computer interface that allows people to control realistic humanoid robots, giving them full sensory feedback.
• The 2010 science fiction thriller film Inception is about a professional thief who steals information by infiltrating the subconscious. He creates artificial thoughts that are so realistic that once they are implanted in a person's mind, the person thinks these are his own thoughts.^[87]

Concerns and challenges

There are certain health and safety considerations of virtual reality. For example, a number of unwanted symptoms have been caused by prolonged use of virtual reality,^[88] and these may have slowed proliferation of the technology. Most virtual reality systems come with consumer warnings. Virtual reality sickness (also known as cybersickness) occurs when a person's exposure to a virtual environment causes symptoms that are similar to motion sickness symptoms.^[89] The most common symptoms are general discomfort, headache, stomach awareness, nausea, vomiting, pallor, sweating, fatigue, drowsiness, disorientation, and apathy.^[90] Other symptoms include postural instability and retching.^[90] Virtual reality sickness is different from motion sickness in that it can be caused by the visually-induced perception of self-motion; real self-motion is not needed.^[89] It is also different from simulator sickness; non-virtual reality simulator sickness tends to be characterized by oculomotor disturbances, whereas virtual reality sickness tends to be characterized by disorientation.^[91]

In addition, there are social, conceptual, and philosophical considerations and implications associated with the use of virtual reality. What the phrase "virtual reality" means or refers to can be ambiguous. In the book The Metaphysics of Virtual Reality by Michael R. Heim, seven different concepts of virtual reality are identified: simulation, interaction, artificiality, immersion, telepresence, full-body immersion, and network communication. There has been an increase in interest in the potential social impact of new technologies, such as virtual reality. In the book Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution, Blascovich and Bailenson review the literature on the psychology and sociology behind life in virtual reality. Mychilo S. Cline's book Power, Madness, and Immortality: The Future of Virtual Reality, argues that virtual reality will lead to a number of important changes in human life and activity.^[92] He argues that virtual reality will be integrated into daily life and activity, and will be used in various human ways. Another such speculation has been written up on how to reach ultimate happiness via virtual reality.^[93] He also argues that techniques will be developed to influence human behavior, interpersonal communication, and cognition.^[94] As we spend more and more time in virtual space, there would be a gradual "migration to virtual space", resulting in important changes in economics, worldview, and culture.^[95] Philosophical implications of VR are discussed in books, including Philip Zhai's Get Real: A Philosophical Adventure in Virtual Reality (1998) and Digital Sensations: Space, Identity and Embodiment in Virtual Reality (1999), written by Ken Hillis.

Virtual reality technology faces a number of challenges, most of which involve motion sickness and technical matters. Users might become disoriented in a purely virtual environment, causing balance issues; computer latency might affect the simulation, providing a less-than-satisfactory end-user experience; the complicated nature of head-mounted displays and input systems such as specialized gloves and boots may require specialized training to operate, and navigating the non-virtual environment (if the user is not confined to a limited area) might prove dangerous without external sensory information. In January 2014, Michael Abrash gave a talk on VR at Steam Dev Days.^[96] He listed all the requirements necessary to establish presence and concluded that a great VR system will be available in 2015 or soon after. While the visual aspect of VR is close to being solved, he stated that there are other areas of VR that need solutions, such as 3D audio, haptics, body tracking, and input. However, 3D audio effects exist in games and simulate the head-related transfer function of the listener (especially using headphones). Examples include Environmental Audio Extensions (EAX), DirectSound and OpenAL. VR audio developer Varun Nair points out that from a design perspective, sound for VR is still very much an open book. Many of the game audio design principles, especially those related to FPS games, crumble in virtual reality. He encourages more sound designers to get involved in virtual reality audio to experiment and push VR audio forward.^[97] There have been rising concerns that with the advent of virtual reality, some users may experience virtual reality addiction.^[98]

Pioneers and notables

Commercial industries

The companies working in the virtual reality sector fall broadly into three categories of involvement: hardware (making headsets and input devices specific to VR), software (producing software for interfacing with the hardware or for delivering content to users) and content creation (producing content, whether interactive or passive storylines, games, and artificial worlds, for consumption and exploration with VR hardware).

See also

Notes

References

General references

• Choi, SangSu, Kiwook Jung, and Sang Do Noh. "Virtual reality applications in manufacturing industries: Past research, present findings, and future directions." Concurrent Engineering (2015): 1063293X14568814.

Inline citations

• Kulkarni, S.D.; Minor, M.A.; Deaver, M.W.; Pardyjak, E.R.; Hollerbach, J.M.Design, Sensing, and Control of a Scaled Wind Tunnel for Atmospheric Display, Mechatronics, IEEE/ASME Transactions on, vol.17, no.4, pp. 635–645, Aug. 2012
• Blascovich, J Bailenson, J. Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution, Harper Collins, 2011.
• TechCast Article Series, Mateo Fernandez, Metaverse
• TechCast Article Series, Aaron Druck, When will Virtual Reality become reality?
• Brooks Jr., F. P. (1999). "What's Real About Virtual Reality?", IEEE Computer Graphics And Applications, 19(6), 16
• Burdea, G. and P. Coffet (2003). Virtual Reality Technology, Second Edition. Wiley-IEEE Press.
• Genovese, Paolo Vincenzo (2005). Dalla Decostruzione alla Cyber-Architettura e oltre. L'uso del computer nella progettazione degli spazi non-euclidei. Liguori Editore, Napoli. In Italian.
• Goslin, M, and Morie, J. F., (1996). "Virtopia" Emotional experiences in Virtual Environments", Leonardo, vol. 29, no. 2, pp. 95–100.
• Oliver Grau, (2003) Virtual Art: From Illusion to Immersion (Leonardo Book Series). Cambridge/Massachusetts: MIT-Press.
• Hayward V, Astley OR, Cruz-Hernandez M, Grant D, Robles-De-La-Torre G. Haptic interfaces and devices. Sensor Review 24(1), pp. 16–29 (2004).
• Hillis, Ken (1999). Digital Sensations: Space, Identity and Embodiment in Virtual Reality. University of Minnesota Press, Minneapolis, Minnesota.
• Kalawsky, R. S. (1993). The Science of Virtual Reality and Virtual Environments: A Technical, Scientific and Engineering Reference on Virtual Environments, Addison-Wesley, Wokingham, England ; Reading, Massachusetts
• Kelly, K., A. Heilbrun and B. Stacks (1989). "Virtual Reality; an Interview with Jaron Lanier", Whole Earth Review, Fall 1989, no. 64, pp. 108(12)
• Klein. D, D. Rensink, H. Freimuth, G.J. Monkman, S. Egersdörfer, H. Böse, & M. Baumann — Modelling the Response of a Tactile Array using an Electrorheological Fluids – Journal of Physics D: Applied Physics, vol 37, no. 5, pp794–803, 2004
• Klein. D, H. Freimuth, G.J. Monkman, S. Egersdörfer, A. Meier, H. Böse M. Baumann, H. Ermert & O.T. Bruhns — Electrorheological Tactile Elements. Mechatronics – Vol 15, No 7, pp883–897 – Pergamon, September 2005.
• Krueger, Myron (1991). Artificial Reality II, Addison-Wesley, Reading, Massachusetts
• Lanier, Jaron, and F. Biocca (1992). "An Insider's View of the Future of Virtual Reality." Journal of Communication, 42(4), 150
• Monkman. G.J. ‑ An Electrorheological Tactile Display ‑ Presence (Journal of Teleoperators and Virtual Environments) ‑ Vol. 1, issue 2, pp. 219–228, MIT Press, July 1992.
• Monkman. G.J. - 3D Tactile Image Display – Sensor Review – Vol 13, issue 2, pp. 27–31, MCB University Press, April 1993.
• Joseph Nechvatal, Immersive Ideals / Critical Distances. LAP Lambert Academic Publishing. 2009
• Rheingold, Howard (1992). Virtual Reality, Simon & Schuster, New York, N.Y.
• Robinett, Warren (1994). "Interactivity and Individual Viewpoint in Shared Virtual worlds: The Big Screen vs. Networked Personal Displays." Computer Graphics, 28(2), 127
• Robles-De-La-Torre G. The Importance of the Sense of Touch in Virtual and Real Environments. IEEE Multimedia 13(3), Special issue on Haptic User * Interfaces for Multimedia Systems, pp. 24–30 (2006).
• Roudavski, S. (2010). Virtual Environments as Techno-Social Performances: Virtual West Cambridge Case-Study, in CAADRIA2010: New Frontiers, the 15th International Conference on Computer Aided Architectural Design Research in Asia, ed. by Bharat Dave, Andrew I-kang Li, Ning Gu and Hyoung-June Park, pp. 477–486
• Mel Slater and Martin Usoh (1993). "The Influence of a Virtual Body on Presence in Immersive Virtual Environments" Virtual Reality International 93, Proceedings of the Third Annual Conference on Virtual Reality, London, April 1993, pages 34–42. Meckler, 1993
• Stanney, K. M. ed. (2002). Handbook of Virtual Environments: Design, Implementation, and Applications. Lawrence Erlbaum Associates, Inc., Mahwah, New Jersey
• Sutherland, Ivan (1965). "The Ultimate Display". Proceedings of IFIP 65, vol 2, pp. 506–508
• Warwick, K., Gray, J. and Roberts, D. eds. (1993). Virtual Reality in Engineering, Peter Peregrinus.
• Zhai, Philip. (1998). Get Real: A Philosophical adventure in Virtual Reality, Rowman & Littlefield Publishers, New York and Oxford.

External links

Wikimedia Commons has media related to Virtual reality.

External video

Virtual Reality, Computer Chronicles (1992)

• Isaac, Joseph (2016). "Step into a new world - Virtual Reality (VR)". Retrieved 2 July 2016.  Basic Concepts of Virtual Reality along with Research Challenges explained in simple words.
• Mixed Reality Scale – Milgram and Kishino's (1994) Virtuality Continuum paraphrase with examples.
• Drummond, Katie (2014). "The Rise and Fall and Rise of Virtual Reality". The Verge. Retrieved 15 November 2014.  Interviews on the history and future of virtual reality by leaders in the field.
• "Virtual Reality- Oculus rift video example". 
• "New Trends In Virtual Reality".