Virtual reality is, the projection upon the five senses artificial stimuli. This can be used to create illusions (imaginary worlds) that can be simulated on a computer. Various technologies, especially computer games that utilize VR will incrementally reshape how we view society.
"The ultimate dream is to merge the real world and the virtual world into a totally seamless experience" -- PhotoSynth project
Development of simulation, rendering, VR input and output technologies will have wider implications than just better virtual environments. We can define three main modes of combining reality with virtual reality:
- See simulated world and "be" in that simulated world - "vanilla" virtual reality
- Stay in real world, but see simulated objects - <a data-rte-meta="%7B%22type%22%3A%22internal%22%2C%22text%22%3A%22augmented%20reality%22%2C%22link%22%3A%22augmented%20reality%22%2C%22wasblank%22%3Atrue%2C%22noforce%22%3Atrue%2C%22wikitext%22%3A%22%5B%5Baugmented%20reality%5D%5D%22%7D" data-rte-instance="78-9047640514f0eaa5565389" href="/wiki/Augmented_reality" title="Augmented reality">augmented reality</a>
- See information about the real world, presented via computer - location based services, GIS. This information can also be used by robots for navigation in the real world.
The <a data-rte-meta="%7B%22type%22%3A%22external%22%2C%22text%22%3A%22Mirror%20World%22%2C%22link%22%3A%22http%3A%5C%2F%5C%2Fwww.leanbackvids.com%5C%2Fvideoblog%5C%2Fseattle%5C%2Fmirror-world%5C%2F%22%2C%22linktype%22%3A%22text%22%2C%22wasblank%22%3Afalse%2C%22wikitext%22%3A%22%5Bhttp%3A%5C%2F%5C%2Fwww.leanbackvids.com%5C%2Fvideoblog%5C%2Fseattle%5C%2Fmirror-world%5C%2F%20Mirror%20World%5D%22%7D" data-rte-instance="78-9047640514f0eaa5565389" href="http://www.leanbackvids.com/videoblog/seattle/mirror-world/" class="external text" rel="nofollow">Mirror World</a> video (30Mb, Quicktime) provides an interesting glimpse into the future connections between virtual and real world. Another <a data-rte-meta="%7B%22type%22%3A%22external%22%2C%22text%22%3A%22demo%20Toshiba%22%2C%22link%22%3A%22http%3A%5C%2F%5C%2Fwww.xb360info.com%5C%2FToshiba-Cell-Demo.avi%22%2C%22linktype%22%3A%22text%22%2C%22wasblank%22%3Afalse%2C%22wikitext%22%3A%22%5Bhttp%3A%5C%2F%5C%2Fwww.xb360info.com%5C%2FToshiba-Cell-Demo.avi%20demo%20Toshiba%5D%22%7D" data-rte-instance="78-9047640514f0eaa5565389" href="http://www.xb360info.com/Toshiba-Cell-Demo.avi" class="external text" rel="nofollow">demo Toshiba</a> shows how our selves can be transferred into the VR as avatars.
Scale and evolution Edit
Virtual reality started with single-player worlds simulated on a local machine (first 3D games and research projects before that). That is, computer games. The next step (late 1990s) was to have multiplayer worlds, where several participants could interact with limited realism. Another important development were persistent worlds - various MMORPGs and "general-purpose" virtual worlds such as ActiveWorlds, Second Life, and There. These persistent worlds are running on clusters of servers (sometimes distributed) and usually allow creation of custom content and programming by users. More than ten million people play MMORPGs as of 2005 and about 100 thousand "play" in general purpose worlds. Overall more than 100 million people play 3D computer and video games online (45 million in 2002 ).
The next step (2010-2015) is going to be development of more open systems, where content can be moved across platforms and where separate worlds can be linked (for example a room in a virtual building can be simulated on a private server using different simulation software, but would still be accessible for the people walking in the virtual city).  Open source may play a role there.  Eventually virtual reality worlds will integrate into a global Metaverse running on a distributed grid.
The step after that will be the integration of these worlds with input/output technologies, such as VR goggles and brain-computer interfaces. By then most of the people will spend a significant part of their lives in virtual reality (playing, communicating, working, having sex). Eventually, uploading will make feasible a full migration into virtual reality, while robotic bodies will make the reverse possible.
Content acquisition Edit
To bridge the gap between reality and virtual reality we need methods to quickly (not slowly and manually ) convert objects from physical reality into digital models and back. This will have much wider implications than just more realistic games, this is going to gradually change what we consider reality.
Some technologies already exist: laser scanners and 3d printers for small objects. Some crude methods already exist to quickly generate 3d models of larger real world scenes (using image processing and LIDAR) - urban landscapes      and indoor environments .
It is already feasible and cost-effective to acquire photographic data for Yellow Pages   using the "drive and shoot" model. Hi-resolution satellite images of urban areas are being incorporated into MSN Virtual Earth . Google is quietly doing similar stuff , and may do much more in the future   
Using a combination of these approaches 3D models of cities will soon (est. 2007-2009) be built cheaply and quickly. To create a realistic virtual environment one would only need to clean up the raw data a bit, combine the air photos for rooftops and large buildings with ground level images for details, add virtual pedestrians and traffic on streets.
Photosynth is an upcoming technology from Microsoft  (videos, live demo, etc.) to recreate 3D environments from unstructured collections of photographs. In essense, it can take hundreds of photos of the Eiffel Tower from Flickr and automatically create a detailed 3D model.
Current realism of computer games Edit
As of 2007 we are on the threshold of realism in computer games. It is finally possible to simulate certain aspects of reality in real time and with sufficient precision to declare it an accurate simulation overall.
For example, the Forza Motorsport racing simulation for Xbox is physically realistic. It is mostly on par with reality, even though it's not indistinguishable yet. To achieve this, programmers from Microsoft Game Studios take into account between 3000 and 10000 variables and simulate all aspects of driving, running the simulation at 240 ticks per second. For Race Against Reality Popular Science asked a veteran gamer and a professional race driver to extensively test drive both real cars and their virtual prototypes. The conclusion was that the game simulation is accurate.
Similar level of realism is available for the flight simulators, again from Microsoft . Some simulators are so realistic that pilots are allowed to log the virtual hours just like the real ones.
However, these simulations are not completely realistic yet. There are still things that can be improved though before we have perfect VR.
- Graphics aren't perfect yet. One of the bigger problems is lighting and shadowing. To make realistic materials technologies such as RealReflect need to be developed.
- Sound - there is still no good programmatic sound generation. It's all samples, mostly.
- Global physics - it's possible to simulate several objects (cars, planes) very accurately, but an all-encompassing simulation is still too complex for the tech we have.
- Simulation of acceleration, tactile contact and everything else related to physically "being there".
- AI to make the world come alive
The shader model (introduced in 2002-2005) made possible to move graphics a step up from poligonal textured environments to much more realistic worlds. Games introduced in 2005 simulate realistically such superfluous details as raindrop splashes, smoke clouds (Call of Duty 2), etc. Water shaders and 3D textures further enhance the realism.
Still, we have already entered the realm of virtual reality. In some aspects, although not in all, virtual environments are already as good as real ones.
The Interface Edit
As of 2009 vision is the only area that is completely realistic in terms that it is indistinguishable from real life on a limited scale.
- Currently external stimulation is possible. Large VR gaming stations are being developed . Alternatively a user can wear glasses, headphones, virtual reality gloves. Ultimately this should lead to high-quality retinal projectors (for vision).
- This video demonstrates how a Tera-scale computer could analyze images from multiple cameras in the home to capture body motions in 3D without any controller, special clothing, or blue screen in the background. The virtual character that mirrors the person's movements has been rendered using ray tracing techniques to display the scene more realistically - note the multiple reflections and shadows in the background. The ray tracing engine calculates the paths of individual light rays realistically using the laws of physics. This scene took many hours to generate on a powerful server, but future servers and PCs with Tera-scale processors will be able to do this in real time.
- Progress is being made into direct neural connections. The work is being done mostly in cochlear and retinal implants. Other senses can be controlled too, such as the vestibular system , .
- Ideally the interface would be a direct brain-computer link. First it will be a connection to the cortex, allowing the computer to "read thoughts" and send information directly to the mind. Eventually all brain will become random-access memory, with nanodevices able to control each and every neuron.
- Pressure suits that create a sensation on the skin, so that when for example an in-game character is shot in his shoulder, the player will feel a sensation right there.
Completeness and complexity of simulationEdit
Currently most games (or professional simulations) take into account only a few aspects of reality. A car racing game has a detailed simulation of the engine, tires, tracktion, drag, etc., but "pedestrians" are glued to the ground, all other objects, e.g. planes, are moving on a predetermined path, etc. A real time strategy or tycoon game simulates the social dynamics and resource processing to some extent, but ignores the the physics of individual characters moving around.
But the big trend is that the engines all games use become more and more similar. Nowadays a strategy and a shooter game can use the same graphics engine, the same physics engine (such as Havoc 2) and look and feel rather similar (compare it with Dune 2 vs. Doom 2). John Carmack believes that universal engines will emerge around 2010-2015 and he will probably program only two more generations of custom game engines.
Of course, as long as content creation and programming are expensive, the games will avoid simulating parts unnecessary for the core gameplay. But the inevitable emergence of a common engine base will make it possible to integrate different games in one world and eventually it will be done. A crude example of that is the Second Life game where the complexity is not limited, at least in principle. There are also more and more games that use completeness as a selling point, such as GTA series and upcoming Spore from Will Wright.
The increased completeness will eventually make the virtual world real. In that virtual reality a "player" will be able to race, shoot, socialise, control armies, play with "physically real" objects and do a very large subset of what is possible in reality.
Uses of virtual reality Edit
- entertainment, emerging from FPS games on one end and interactive attractions at Disneyland  on the other.
- social interaction, emerging from MMORPG and from first feeble attempts at online virtual conferences.
Current adoption Edit
Reuters, Sun, IBM, Toyota, Sony BMG, CNet, Adidas, American Apparel and Starwood Hotels are among the companies that (as of 2006) operate in the Second Life virtual reality.
Social issues Edit
Computer and video games are relatively non-controversial (bar some violent games). Virtual reality hardware, while clumsy and awkward, is accepted too. While full-scale VR a la Matrix, if implemented today, would be scary to most people, gradual development will probably be accepted easily. For example, Sony has discussed future neural interfaces several times.
- A World of Warcraft World - a good description of the MMORPG-related trends for the VR. Of course, it suffers horribly from the Single factor problem.
In the long run, VR may lead to Marriage obsolescence.
Technological development Edit
- 2010-2015: video-realistic graphics based on general-purpose stable rendering systems.
- 2015-2020: integrated persistent worlds.
- 2015-2020: global physics with unlimited world complexity and simulation of most physical aspects.
- 2015-2020: sufficiently good non-human and domain specific human AI.
- 2015-2025: programmatic sound. Most aspects of reality can be simulated sufficiently well.
- 2015-2025: realistic simulations of all senses (through brain-computer interface).
- 2030+ : good human-level artificial intelligence.
- 2045+ : uploading and life in virtual reality.
Japanese NISTEP forecast, 2001 Edit
- 2010: Widespread use of electronic travel pamphlets and product catalogs that use virtual reality.
- 2012: Emergence of electronic media that stimulate the pleasure center in the brain, causing a social problem similar to narcotic drugs. (this isn't VR per se, but similar technologies will be used)
- 2015: Widespread use of multimedia-based virtual leisure, leading to a decline in the development of ecosystem-threatening resorts.
- 2015: Sales from on-line shopping through a digital network (shopping through virtual malls) account for more than 50% of total sales by retail shops.
The use of VR in the period covered by NISTEP forecast (2010-2015) will probably include video-realistic virtual worlds with limited physical and AI realism delivered through light, comfortable high-quality VR goggles and possibly some primitive neural interfaces (may be for motor control or mood enhancement). BTW, this will be the PlayStation 5 era providing that a Gaming Depression doesn't occur within the next five or ten years.
By 2025-2030 both the simulation and interface technologies will likely advance to a stage sufficient for a perfect Matrix-like simulation indistinguishable from reality, but the virtual avatar will still be controlled by the actual human brain. While the Matrix scenario of naked immobile humans immersed in a nutrient medium and immersed in a virtual reality permanently is possible, it is likely that most people will still spend much of their time in physical reality.
See also Edit
- 3D scene generation:  and  - more links and some discussion.
- The Metaverse goes open-source, MetaFilter
- Types of VR systems
- VRoot.org: Virtual Reality News/Resources edited by and for the VR Community
- Virtual reality, Wikipedia - some links
- The Top Eleven Reasons VR has not yet become commonplace - by Jaron Lanier
- A World of Warcraft World - 10 Ways MMORPGs Will Change the Future
- The Day You Discard Your Body: Understanding the Future of Humanity - by Marshall Brain
- Virtual Reality - Austin Evans
- SETP/CICPv2 - Open source specification effort of future virtual environment protocol
- The Future of Virtual Reality Technologies - TheNanoAge