Jump to content

Virtual reality headset: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
Reverting vandalism by 86.96.9.98 (talk)
Reverting vandalism again by 86.96.9.98 (talk)
Tag: Non-autoconfirmed user rapidly reverting edits
Line 1: Line 1:
{{Use dmy dates|date=March 2016}}{{Update|date=June 2016}}[[File:Oculus Rift - Developer Version - Back and Control Box.jpg|thumb|The Oculus Rift development kit headset, showing the stereoscopic lens along with the control box.]]
{{Use dmy dates|date=March 2016}}{{Update|date=June 2016}}[[File:Oculus Rift - Developer Version - Back and Control Box.jpg|thumb|The Oculus Rift development kit headset, showing the stereoscopic lens along with the control box.]]
A '''virtual reality headset''' is a head-mounted device that provides [[virtual reality]] for the wearer. VR headsets are widely used with [[computer game]]s but they are also used in other applications, including simulators and trainers. They comprise a [[stereoscopic]] [[head-mounted display]] (providing separate images for each eye), stereo sound, and head motion tracking sensors<ref>{{cite web |url=http://www.polygon.com/2016/1/15/10772026/virtual-reality-guide-oculus-google-cardboard-gear-vr |author=Ben Kuchera |date=15 January 2016 |title=The complete guide to virtual reality in 2016 (so far) |work=Polygon }}</ref> (which may include [[gyroscope]]s, [[accelerometer]]s, [[structured light]] systems,<ref>{{cite web |url=https://www.theverge.com/a/best-vr-headset-oculus-rift-samsung-gear-htc-vive-virtual-reality |author=Adi Robertson |date= |title=The ultimate VR headset buyer’s guide |publisher=Vox Media |work=TheVerge.com }}</ref> etc.). Some VR headsets also have [[eye tracking]] sensors<ref>{{cite web |url=http://www.pocket-lint.com/news/133835-forget-head-tracking-on-oculus-rift-fove-vr-headset-can-track-your-eyes |author=Stuart Miles |date=19 May 2015 |title=Forget head tracking on Oculus Rift, Fove VR headset can track your eyes |work=Pocket-lint }}</ref> and [[gaming controller]]s.
A '''virtual reality headset''' is a head-mounted device that provides [[virtual reality]] for the wearer. VR headsets are widely used with [[computer game]]s but they are also used in other applications, including simulators and trainers. They comprise a [[stereoscopic]] [[head-mounted display]] (providing separate images for each eye), stereo sound, and head motion tracking sensors<ref>{{cite web |url=http://www.polygon.com/2016/1/15/10772026/virtual-reality-guide-oculus-google-cardboard-gear-vr |author=Ben Kuchera |date=15 January 2016 |title=The complete guide to virtual reality in 2016 (so far) |work=Polygon }}</ref> (which may include [[gyroscope]]s, [[accelerometer]]s, [[structured light]] systems,<ref>{{cite web |url=https://www.theverge.com/a/best-vr-headset-oculus-rift-samsung-gear-htc-vive-virtual-reality |author=Adi Robertson |date= |title=The ultimate VR headset buyer’s guide |publisher=Vox Media |work=TheVerge.com }}</ref> etc.). Some VR headsets also have [[eye tracking]] sensors<ref>{{cite web |url=http://www.pocket-lint.com/news/133835-forget-head-tracking-on-oculus-rift-fove-vr-headset-can-track-your-eyes |author=Stuart Miles |date=19 May 2015 |title=Forget head tracking on Oculus Rift, Fove VR headset can track your eyes |work=Pocket-lint }}</ref> and [[gaming controller]]s.

== History ==
[[File:Forte_VFX1_Headgear.jpg|thumb|The Forte VFX1 headset from 1994.]]
An early VR headset, the [[VFX1 Headgear|Forte VFX1]], was announced at [[Consumer Electronics Show|CES]] in 1994. The VFX-1 has stereoscopic displays, 3-axis head-tracking, and stereo headphones.<ref>{{cite news |author=Nathan Cochrane |date=1994 |title=VFX-1 VIRTUAL REALITY HELMET by Forte |url=http://www.ibiblio.org/GameBytes/issue21/flooks/vfx1.html |work=Game Bytes Magazine }}</ref> Sony, another pioneer, released the [[Glasstron]] in 1997, which has an optional positional sensor, allowing the wearer to view the surroundings, with the perspective moving as his head moves, giving a deep sense of immersion. These VR headsets gave [[MechWarrior 2: 31st Century Combat|MechWarrior 2]] players a new visual perspective of seeing the battlefield from inside the cockpit of their craft. However, these early headsets failed commercially due to their limited technology<ref name=rift-kickstarter>{{cite web |url=http://www.bbc.com/news/technology-19085967 |date=1 August 2012 |title=Oculus Rift virtual reality headset gets Kickstarter cash |work=BBC News }}</ref><ref name=oculus-history>{{cite web |url=https://techcrunch.com/2014/03/26/a-brief-history-of-oculus/ |author=Greg Kumparak |date=26 March 2014 |title=A Brief History Of Oculus |work=TechCrunch }}</ref> and were described by [[John Carmack]] as like "looking through toilet paper tubes".<ref>{{cite web |url=http://www.ign.com/articles/2012/08/04/the-future-of-gaming-in-virtual-reality |date=3 August 2012 |author=Charles Onyett |title=The Future of Gaming in Virtual Reality |work=IGN }}</ref>

In 2012, a [[crowdfunding]] campaign began for a VR headset known as [[Oculus Rift]]; the project was led by several prominent video game developers, including John Carmack<ref name=rift-kickstarter /> who later became the company's [[Chief technology officer|CTO]].<ref>{{cite web |url=https://techcrunch.com/2013/11/22/dooms-john-carmack-leaves-id-software-to-focus-on-the-oculus-virtual-reality-headset/ |author=Alex Wilhelm |date=22 November 2013 |title=Doom’s John Carmack Leaves id Software To Focus On The Oculus Virtual Reality Headset |work=TechCrunch }}</ref> In March 2014, the project's parent company [[Oculus VR]] was acquired by [[Facebook]] for [[United States dollar|US]]$2 billion.<ref name="The Verge Facebook">{{Cite web|url = https://www.theverge.com/2014/3/25/5547456/facebook-buying-oculus-for-2-billion/in/3631187|title = Facebook buying Oculus VR for $2 billion|archiveurl = |deadurl = |archivedate = |date = March 25, 2014|accessdate = March 26, 2014|website = [[The Verge]]|last = Welch|first = Chris}}</ref> The final consumer-oriented release of Oculus Rift began shipping on 28 March 2016.<ref name="verge-oculusdelay">{{cite web|title=Oculus apologizes for shipping delays, will waive shipping fees for all orders to date|url=https://www.theverge.com/2016/4/2/11353358/oculus-rift-shipping-delays-free-shipping-promise|website=The Verge|accessdate=30 July 2016}}</ref>

In March 2014, Sony demonstrated a prototype headset for [[PlayStation 4]],<ref>{{cite news |url=http://www.polygon.com/2014/3/18/5524058/playstation-vr-ps4-virtual-reality |author=Michael McWhertor |date=18 March 2014 |title=Sony announces Project Morpheus, a virtual reality headset coming to PlayStation 4 |work=Polygon }}</ref> which was later named [[PlayStation VR]].<ref>{{cite news |url=https://www.engadget.com/2015/09/15/project-morpheus-is-now-playstation-vr/ |author=Aaron Souppouris |date=15 September 2015 |title=Sony's Project Morpheus is now 'PlayStation VR' |work=Engadget }}</ref> In 2014, [[Valve Corporation]] demonstrated some headset prototypes,<ref name=verge-valvevr>{{cite web |url=https://www.theverge.com/2014/6/3/5775220/valve-vr-headset-pictures-concept-features |author=Tom Warren |date=3 June 2014 |title=Valve's VR headset revealed with Oculus-like features |work=The Verge }}</ref> which lead to a partnership with [[HTC]] to produce the [[HTC Vive|Vive]], which focuses on "room scale" VR environments that users can naturally navigate within and interact with.<ref name=verge-vive>{{cite web |url=https://www.theverge.com/2015/3/1/8127445/htc-vive-valve-vr-headset |authors=Dante D'Orazio, Vlad Savov |date=1 March 2015 |title=Valve's VR headset is called the Vive and it's made by HTC |work=The Verge }}</ref> The Vive was released in April 2016<ref>{{cite web |url=https://www.theverge.com/2015/12/8/9873840/htc-vive-headset-delay-april-2016/ |author=Adi Robertson |date=8 December 2015 |title=HTC Vive VR headset delayed until April |work=The Verge }}</ref> and PlayStation VR in October 2016.<ref name="sony-psvr">{{cite web | url=https://www.sony.com/en_us/SCA/company-news/press-releases/sony-computer-entertainment-america-inc/2016/playstationvr-launches-october-2016-available-glob.html |title=PlayStation VR Launches October 2016|publisher=Sony|access-date=March 15, 2016}}</ref>

[[File:Samsung Gear VR.jpg|thumb|right|[[Samsung Gear VR]], a VR headset designed exclusively for use with Samsung Galaxy smartphones.]]

Virtual reality headsets and viewers have also been designed for [[smartphone]]s. Unlike headsets with integrated displays, these units are essentially enclosures which a smartphone can be inserted into. VR content is viewed from the screen of the device itself through lenses acting as a [[stereoscope]], rather than using dedicated internal displays. Google released a series of specifications and associated DIY kits for virtual reality viewers known as [[Google Cardboard]]; these viewers are capable of being constructed using low-cost materials, such as cardboard (hence the naming).

[[Samsung Electronics]] parterned with Oculus VR to co-develop the [[Samsung Gear VR]] (which is only compatible with recent [[Samsung Galaxy]] devices), while [[LG Electronics]] developed a headset with dedicated displays for its [[LG G5]] smartphone known as LG 360 VR.<ref name="verge-reinvention">{{cite web|title=LG's G5 is a radical reinvention of the flagship Android smartphone|url=https://www.theverge.com/2016/2/21/11077616/lg-g5-announced-specs-release-date-price-mwc-2016|website=The Verge|accessdate=21 February 2016}}</ref><ref>{{Cite web|title = IFA 2014: Samsung Galaxy Note 4, Note Edge, Gear VR and Gear S hands-on|url = http://www.gsmarena.com/samsung_ifa_2014-review-1126.php|website = GSMArena.com|accessdate = 2015-11-24}}</ref><ref name="wired-youtubevr">{{cite web|title=You Can Now Watch and Upload 360-Degree Videos on YouTube|url=https://www.wired.com/2015/03/youtube-360-degree-video/|website=Wired|accessdate=12 July 2016}}</ref><ref name="pocketlint-headsets">{{cite web|title=Best VR headsets to buy in 2016, whatever your budget|url=http://www.pocket-lint.com/news/132945-best-vr-headsets-to-buy-in-2016-whatever-your-budget|website=Pocket-lint|accessdate=12 July 2016}}</ref>

Asian hardware manufacturers like Xion and Kolke have developed inexpensive virtual reality headsets. In late April 2017, the Chinese company [[Tencent]] announced it was preparing to launch its virtual reality headset that year.<ref name=ft-vr>{{cite news |last=Bradshaw |first=Tim |date=April 30, 2017 |title=Tencent poised to launch virtual reality headset |url=https://www.ft.com/content/71644274-2add-11e7-bc4b-5528796fe35c | work=[[Financial Times]]|access-date=April 30, 2017}}</ref>

== Constraints ==

=== Latency requirements ===
Virtual reality headsets have significantly higher requirements for [[latency (engineering)|latency]]&mdash;the time it takes from a change in input to have a visual effect&mdash;than ordinary video games.<ref>{{cite web |url=http://www.roadtovr.com/john-carmack-talks-virtual-reality-latency-mitigation-strategies/ |author=Ben Lang |date=24 February 2013 |title=John Carmack Talks Virtual Reality Latency Mitigation Strategies |work=Road to VR }}</ref> If the system is too sluggish to react to head movement, then it can cause the user to experience [[virtual reality sickness]], a kind of motion sickness.<ref name=vr-motion-sickness>{{cite web |url=http://www.news.com.au/technology/gadgets/wearables/for-virtual-reality-creators-motion-sickness-a-real-issue/news-story/a0496dfdaa1a7b079b7fe7ffeda83217 |title=Virtual reality developers struggle with motion sickness |date=21 March 2016 |work=news.com.au }}</ref> According to a Valve engineer, the ideal latency would be 7-15 [[millisecond]]s.<ref>{{cite web |url=https://arstechnica.com/gaming/2013/01/how-fast-does-virtual-reality-have-to-be-to-look-like-actual-reality/ |author=Kyle Orland |date=4 January 2013 |title=How fast does "virtual reality" have to be to look like "actual reality"? |work=Ars Technica }}</ref> A major component of this latency is the [[refresh rate]] of the display,<ref name=vr-motion-sickness /> which has driven the adoption of displays with a refresh rate from 90&nbsp;Hz (Oculus Rift and HTC Vive) to 120&nbsp;Hz (PlayStation VR).<ref name=bbc-morpheus>{{cite web |url=http://bbc.co.uk/news/technology-31723030 |author=Leo Kelion |date=4 March 2015 |title=Sony's Morpheus virtual reality helmet set for 2016 launch |work=BBC News }}</ref>

The [[graphics processing unit]] (GPU) also needs to be more powerful to render frames more frequently. Oculus cited the limited processing power of [[Xbox One]] and PlayStation 4 as the reason why they are targeting the [[PC gaming]] market with their first devices.<ref>{{cite web |url=http://www.gamespot.com/articles/xbox-one-ps4-too-limited-for-oculus-rift-says-creator/1100-6416153/ |author=Eddie Makuch |date=13 November 2013 |title=Xbox One, PS4 "too limited" for Oculus Rift, says creator |work=GameSpot }}</ref>

==== Asynchronous reprojection/time warp ====
A common way to reduce the perceived latency<ref name=pcgamer-atw>{{cite web |url=http://www.pcgamer.com/why-the-asynchronous-timewarp-added-to-oculus-rift-matters/ |author=Matt Porter |date=28 March 2016 |title=Why the 'asynchronous timewarp' added to Oculus Rift matters |work=PC Gamer }}</ref> or compensate for a lower [[frame rate]],<ref name=vrfocus-psvr>{{cite web |url=https://www.vrfocus.com/2016/03/playstation-vr-price-release-date-revealed/ |author=Jamie Feltham |date=15 March 2016 |title=PlayStation VR Price and Release Date Revealed |work=VRFocus }}</ref> is to take an (older) rendered frame and morph it according to the most recent head tracking data just before presenting the image on the screens. This is called asynchronous reprojection<ref name="gamedebate">{{cite web|last1=S|first1=Jon|title=The Tech Behind PlayStation VR And How It Delivers 120 Hz On Console|url=http://www.game-debate.com/news/19667/the-tech-behind-playstation-vr-and-how-it-delivers-120-hz-on-console|website=Game-Debate|publisher=Game-Debate.com|accessdate=18 May 2016|archiveurl=https://web.archive.org/web/20160518141251/http://www.game-debate.com/news/19667/the-tech-behind-playstation-vr-and-how-it-delivers-120-hz-on-console|archivedate=18 May 2016 |dead-url=no|date=March 19, 2016}}</ref> or "asynchronous time warp" in [[Oculus VR|Oculus]] jargon.<ref>{{cite web |url=http://www.tomshardware.com/reviews/virtual-reality-basics,4220.html |author=Niel Schneider |date=12 October 2015 |title=Virtual Reality Basics |work=Tom's Hardware }}</ref>

PlayStation VR synthesizes "in-between frames" in such manner, so games that render at 60 fps natively result in 120 updates per second.<ref name=bbc-morpheus /><ref name=vrfocus-psvr /> SteamVR (HTC Vive) will also use "interleaved reprojection" for games that cannot keep up with its 90&nbsp;Hz refresh rate, dropping down to 45 fps.<ref>{{cite web |url=https://steamcommunity.com/app/358720/discussions/0/385429254937377076/ |author=Aaron Leiby |date=26 March 2016 |title=Interleaved Reprojection now enabled for all applications by default |work=SteamVR Developer Hardware forums }}</ref>

The simplest technique is applying only [[projective transformation]] to the images for each eye (simulating [[rotation]] of the eye). The downsides are that this approach cannot take into account the [[translation (geometry)|translation]] (changes in position) of the head. And the rotation can only happen around the axis of the eyeball, instead of the [[neck]], which is the true axis for head rotation. When applied multiple times to a single frame, this causes "positional judder", because position is not updated with every frame.<ref name=pcgamer-atw /><ref name=makeuseof>{{cite web |url=http://www.makeuseof.com/tag/can-virtual-reality-cut-cord/ |author=Andre Infante |date=21 April 2015 |title=Can Virtual Reality Cut the Cord? |work=MakeUseOf }}</ref><ref name=oculus-atw>{{cite web |url=https://developer.oculus.com/blog/asynchronous-timewarp-examined/ |author=Michael Antonov |date=3 March 2015 |title=Asynchronous Timewarp Examined |work=Oculus developer blog }}</ref>

A more complex technique is positional time warp, which uses pixel depth information from the [[Z-buffer]] to morph the scene into a different [[perspective (visual)|perspective]]. This produces other artifacts because it has no information about faces that are hidden due to occlusion<ref name=makeuseof /> and cannot compensate for position-dependent effects like [[reflection (computer graphics)|reflection]]s and [[specular lighting]]. While it gets rid of the positional judder, judder still presents itself in animations, as timewarped frames are effectively frozen.<ref name=oculus-atw /> Support for positional time warp was added to the Oculus SDK in May 2015.<ref>{{cite web |url=http://www.roadtovr.com/visualizing-latest-features-found-oculus-sdk-v0-6-0-0/2/ |author=Scott Hayden |date=19 May 2015 |title=Visualizing the Latest Features Found in Oculus SDK v0.6.0.0 |work=Road to VR }}</ref>

=== Resolution and display quality ===
Because virtual reality headsets stretch a single display across a wide [[field of view]] (up to 110° for some devices according to manufacturers), the magnification factor makes flaws in display technology much more apparent. One issue is the so-called [[screen-door effect]], where the gaps between rows and columns of [[pixel]]s become visible, kind of like looking through a [[screen door]].<ref>{{cite web |url=http://tay.kinja.com/screen-door-effect-playstationvr-supposedly-has-none-1767379066 |title=Screen-Door Effect: PlayStationVR Supposedly Has "None", Probably Doesn't Matter |date=27 March 2016 |work=Talk Amongst Yourselves (Kinja) }}</ref> This was especially noticeable in earlier prototypes and development kits,<ref name=oculus-history /> which had lower [[display resolution|resolution]]s than the retail versions.

=== Lenses ===
[[File:Sample screen capture of Oculus rift development kit 2 screen buffer.jpg|thumb|Image captured from an Oculus Rift DK2, showing compensation for lens distortion and chromatic aberration.]]
The [[lens (optics)|lenses]] of the headset are responsible for mapping the up-close display to a wide field of view,<ref name=intel-hmd>{{cite web |url=http://www.roadtovr.com/intel-claims-can-improve-image-quality-hmds-daniel-pohl-tells-us/ |author=Paul James |date=21 October 2013 |title=Intel Claims It Can Improve Image Quality for HMDs — Daniel Pohl Tells Us How |work=Road to VR }}</ref><ref>{{cite web |url=http://www.roadtovr.com/wearality-150-degree-lenses-are-a-balancing-act-not-a-breakthrough/ |author=Ben Lang |date=13 May 2015 |title=Wearality’s 150 Degree Lenses Are a Balancing Act, Not a Breakthrough |work=Road to VR }}</ref> while also providing a more comfortable distant point of [[focus (optics)|focus]]. One challenge with this is providing consistency of focus: because eyes are free to turn within the headset, it's important to avoid having to refocus to prevent [[eye strain]].<ref>{{cite web |url=http://uploadvr.com/palmer-luckey-talks-advantages-rifts-custom-lenses/ |author=Matthew Terndrup |date=6 October 2015 |title=Palmer Luckey talks advantages of the Rift's custom lenses |work=UploadVR }}</ref>

The lenses introduce [[Distortion (optics)|distortion]] and [[chromatic aberration]], which are corrected in [[software]].<ref name=intel-hmd />

== Uses in various fields ==

=== Medical training ===

Virtual reality headsets are being currently used as a means to train medical students for [[surgery]]. It allows them to perform essential procedures in a virtual, controlled environment. Students perform surgeries on virtual patients, which allows them to acquire the skills needed to perform surgeries on real patients.<ref>{{Cite web|url=http://www.vrs.org.uk/virtual-reality-healthcare/advantages.html|title=Advantages of virtual reality in medicine - Virtual Reality|website=Virtual Reality|language=en-GB|access-date=2016-04-12}}</ref> It also allows the students to revisit the surgeries from the perspective of the lead [[surgeon]].<ref name=":0">{{Cite web|url=https://medium.com/@Goetz/virtual-surgery-gets-real-221beeac65ea#.qi68j56q2|title=Virtual surgery gets real: What the Oculus Rift could mean for the future of medicine|last=Rousseau|first=Rémi|date=2014-08-13|website=Medium|access-date=2016-04-12}}</ref>

Traditionally, students had to participate in surgeries and often they would miss essential parts. Now, with the use of VR headsets, students can watch surgical procedures from the perspective of the lead surgeon without missing essential parts. Students can also pause, rewind, and fast forward surgeries. They also can perfect their techniques in a real-time simulation in a risk free environment.<ref name=":0" />

== See also ==
*[[Comparison of virtual reality headsets]]

== References ==
{{Reflist|30em}}

{{Mixed reality}}
{{Game controllers}}

[[Category:Computer peripherals]]
[[Category:Virtual reality headsets| ]]

Revision as of 14:10, 23 September 2017

The Oculus Rift development kit headset, showing the stereoscopic lens along with the control box.

A virtual reality headset is a head-mounted device that provides virtual reality for the wearer. VR headsets are widely used with computer games but they are also used in other applications, including simulators and trainers. They comprise a stereoscopic head-mounted display (providing separate images for each eye), stereo sound, and head motion tracking sensors[1] (which may include gyroscopes, accelerometers, structured light systems,[2] etc.). Some VR headsets also have eye tracking sensors[3] and gaming controllers.

History

The Forte VFX1 headset from 1994.

An early VR headset, the Forte VFX1, was announced at CES in 1994. The VFX-1 has stereoscopic displays, 3-axis head-tracking, and stereo headphones.[4] Sony, another pioneer, released the Glasstron in 1997, which has an optional positional sensor, allowing the wearer to view the surroundings, with the perspective moving as his head moves, giving a deep sense of immersion. These VR headsets gave MechWarrior 2 players a new visual perspective of seeing the battlefield from inside the cockpit of their craft. However, these early headsets failed commercially due to their limited technology[5][6] and were described by John Carmack as like "looking through toilet paper tubes".[7]

In 2012, a crowdfunding campaign began for a VR headset known as Oculus Rift; the project was led by several prominent video game developers, including John Carmack[5] who later became the company's CTO.[8] In March 2014, the project's parent company Oculus VR was acquired by Facebook for US$2 billion.[9] The final consumer-oriented release of Oculus Rift began shipping on 28 March 2016.[10]

In March 2014, Sony demonstrated a prototype headset for PlayStation 4,[11] which was later named PlayStation VR.[12] In 2014, Valve Corporation demonstrated some headset prototypes,[13] which lead to a partnership with HTC to produce the Vive, which focuses on "room scale" VR environments that users can naturally navigate within and interact with.[14] The Vive was released in April 2016[15] and PlayStation VR in October 2016.[16]

Samsung Gear VR, a VR headset designed exclusively for use with Samsung Galaxy smartphones.

Virtual reality headsets and viewers have also been designed for smartphones. Unlike headsets with integrated displays, these units are essentially enclosures which a smartphone can be inserted into. VR content is viewed from the screen of the device itself through lenses acting as a stereoscope, rather than using dedicated internal displays. Google released a series of specifications and associated DIY kits for virtual reality viewers known as Google Cardboard; these viewers are capable of being constructed using low-cost materials, such as cardboard (hence the naming).

Samsung Electronics parterned with Oculus VR to co-develop the Samsung Gear VR (which is only compatible with recent Samsung Galaxy devices), while LG Electronics developed a headset with dedicated displays for its LG G5 smartphone known as LG 360 VR.[17][18][19][20]

Asian hardware manufacturers like Xion and Kolke have developed inexpensive virtual reality headsets. In late April 2017, the Chinese company Tencent announced it was preparing to launch its virtual reality headset that year.[21]

Constraints

Latency requirements

Virtual reality headsets have significantly higher requirements for latency—the time it takes from a change in input to have a visual effect—than ordinary video games.[22] If the system is too sluggish to react to head movement, then it can cause the user to experience virtual reality sickness, a kind of motion sickness.[23] According to a Valve engineer, the ideal latency would be 7-15 milliseconds.[24] A major component of this latency is the refresh rate of the display,[23] which has driven the adoption of displays with a refresh rate from 90 Hz (Oculus Rift and HTC Vive) to 120 Hz (PlayStation VR).[25]

The graphics processing unit (GPU) also needs to be more powerful to render frames more frequently. Oculus cited the limited processing power of Xbox One and PlayStation 4 as the reason why they are targeting the PC gaming market with their first devices.[26]

Asynchronous reprojection/time warp

A common way to reduce the perceived latency[27] or compensate for a lower frame rate,[28] is to take an (older) rendered frame and morph it according to the most recent head tracking data just before presenting the image on the screens. This is called asynchronous reprojection[29] or "asynchronous time warp" in Oculus jargon.[30]

PlayStation VR synthesizes "in-between frames" in such manner, so games that render at 60 fps natively result in 120 updates per second.[25][28] SteamVR (HTC Vive) will also use "interleaved reprojection" for games that cannot keep up with its 90 Hz refresh rate, dropping down to 45 fps.[31]

The simplest technique is applying only projective transformation to the images for each eye (simulating rotation of the eye). The downsides are that this approach cannot take into account the translation (changes in position) of the head. And the rotation can only happen around the axis of the eyeball, instead of the neck, which is the true axis for head rotation. When applied multiple times to a single frame, this causes "positional judder", because position is not updated with every frame.[27][32][33]

A more complex technique is positional time warp, which uses pixel depth information from the Z-buffer to morph the scene into a different perspective. This produces other artifacts because it has no information about faces that are hidden due to occlusion[32] and cannot compensate for position-dependent effects like reflections and specular lighting. While it gets rid of the positional judder, judder still presents itself in animations, as timewarped frames are effectively frozen.[33] Support for positional time warp was added to the Oculus SDK in May 2015.[34]

Resolution and display quality

Because virtual reality headsets stretch a single display across a wide field of view (up to 110° for some devices according to manufacturers), the magnification factor makes flaws in display technology much more apparent. One issue is the so-called screen-door effect, where the gaps between rows and columns of pixels become visible, kind of like looking through a screen door.[35] This was especially noticeable in earlier prototypes and development kits,[6] which had lower resolutions than the retail versions.

Lenses

Image captured from an Oculus Rift DK2, showing compensation for lens distortion and chromatic aberration.

The lenses of the headset are responsible for mapping the up-close display to a wide field of view,[36][37] while also providing a more comfortable distant point of focus. One challenge with this is providing consistency of focus: because eyes are free to turn within the headset, it's important to avoid having to refocus to prevent eye strain.[38]

The lenses introduce distortion and chromatic aberration, which are corrected in software.[36]

Uses in various fields

Medical training

Virtual reality headsets are being currently used as a means to train medical students for surgery. It allows them to perform essential procedures in a virtual, controlled environment. Students perform surgeries on virtual patients, which allows them to acquire the skills needed to perform surgeries on real patients.[39] It also allows the students to revisit the surgeries from the perspective of the lead surgeon.[40]

Traditionally, students had to participate in surgeries and often they would miss essential parts. Now, with the use of VR headsets, students can watch surgical procedures from the perspective of the lead surgeon without missing essential parts. Students can also pause, rewind, and fast forward surgeries. They also can perfect their techniques in a real-time simulation in a risk free environment.[40]

See also

References

  1. ^ Ben Kuchera (15 January 2016). "The complete guide to virtual reality in 2016 (so far)". Polygon.
  2. ^ Adi Robertson. "The ultimate VR headset buyer's guide". TheVerge.com. Vox Media.
  3. ^ Stuart Miles (19 May 2015). "Forget head tracking on Oculus Rift, Fove VR headset can track your eyes". Pocket-lint.
  4. ^ Nathan Cochrane (1994). "VFX-1 VIRTUAL REALITY HELMET by Forte". Game Bytes Magazine.
  5. ^ a b "Oculus Rift virtual reality headset gets Kickstarter cash". BBC News. 1 August 2012.
  6. ^ a b Greg Kumparak (26 March 2014). "A Brief History Of Oculus". TechCrunch.
  7. ^ Charles Onyett (3 August 2012). "The Future of Gaming in Virtual Reality". IGN.
  8. ^ Alex Wilhelm (22 November 2013). "Doom's John Carmack Leaves id Software To Focus On The Oculus Virtual Reality Headset". TechCrunch.
  9. ^ Welch, Chris (25 March 2014). "Facebook buying Oculus VR for $2 billion". The Verge. Retrieved 26 March 2014. {{cite web}}: Cite has empty unknown parameter: |deadurl= (help)
  10. ^ "Oculus apologizes for shipping delays, will waive shipping fees for all orders to date". The Verge. Retrieved 30 July 2016.
  11. ^ Michael McWhertor (18 March 2014). "Sony announces Project Morpheus, a virtual reality headset coming to PlayStation 4". Polygon.
  12. ^ Aaron Souppouris (15 September 2015). "Sony's Project Morpheus is now 'PlayStation VR'". Engadget.
  13. ^ Tom Warren (3 June 2014). "Valve's VR headset revealed with Oculus-like features". The Verge.
  14. ^ "Valve's VR headset is called the Vive and it's made by HTC". The Verge. 1 March 2015. {{cite web}}: Cite uses deprecated parameter |authors= (help)
  15. ^ Adi Robertson (8 December 2015). "HTC Vive VR headset delayed until April". The Verge.
  16. ^ "PlayStation VR Launches October 2016". Sony. Retrieved 15 March 2016.
  17. ^ "LG's G5 is a radical reinvention of the flagship Android smartphone". The Verge. Retrieved 21 February 2016.
  18. ^ "IFA 2014: Samsung Galaxy Note 4, Note Edge, Gear VR and Gear S hands-on". GSMArena.com. Retrieved 24 November 2015.
  19. ^ "You Can Now Watch and Upload 360-Degree Videos on YouTube". Wired. Retrieved 12 July 2016.
  20. ^ "Best VR headsets to buy in 2016, whatever your budget". Pocket-lint. Retrieved 12 July 2016.
  21. ^ Bradshaw, Tim (30 April 2017). "Tencent poised to launch virtual reality headset". Financial Times. Retrieved 30 April 2017.
  22. ^ Ben Lang (24 February 2013). "John Carmack Talks Virtual Reality Latency Mitigation Strategies". Road to VR.
  23. ^ a b "Virtual reality developers struggle with motion sickness". news.com.au. 21 March 2016.
  24. ^ Kyle Orland (4 January 2013). "How fast does "virtual reality" have to be to look like "actual reality"?". Ars Technica.
  25. ^ a b Leo Kelion (4 March 2015). "Sony's Morpheus virtual reality helmet set for 2016 launch". BBC News.
  26. ^ Eddie Makuch (13 November 2013). "Xbox One, PS4 "too limited" for Oculus Rift, says creator". GameSpot.
  27. ^ a b Matt Porter (28 March 2016). "Why the 'asynchronous timewarp' added to Oculus Rift matters". PC Gamer.
  28. ^ a b Jamie Feltham (15 March 2016). "PlayStation VR Price and Release Date Revealed". VRFocus.
  29. ^ S, Jon (19 March 2016). "The Tech Behind PlayStation VR And How It Delivers 120 Hz On Console". Game-Debate. Game-Debate.com. Archived from the original on 18 May 2016. Retrieved 18 May 2016. {{cite web}}: Unknown parameter |dead-url= ignored (|url-status= suggested) (help)
  30. ^ Niel Schneider (12 October 2015). "Virtual Reality Basics". Tom's Hardware.
  31. ^ Aaron Leiby (26 March 2016). "Interleaved Reprojection now enabled for all applications by default". SteamVR Developer Hardware forums.
  32. ^ a b Andre Infante (21 April 2015). "Can Virtual Reality Cut the Cord?". MakeUseOf.
  33. ^ a b Michael Antonov (3 March 2015). "Asynchronous Timewarp Examined". Oculus developer blog.
  34. ^ Scott Hayden (19 May 2015). "Visualizing the Latest Features Found in Oculus SDK v0.6.0.0". Road to VR.
  35. ^ "Screen-Door Effect: PlayStationVR Supposedly Has "None", Probably Doesn't Matter". Talk Amongst Yourselves (Kinja). 27 March 2016.
  36. ^ a b Paul James (21 October 2013). "Intel Claims It Can Improve Image Quality for HMDs — Daniel Pohl Tells Us How". Road to VR.
  37. ^ Ben Lang (13 May 2015). "Wearality's 150 Degree Lenses Are a Balancing Act, Not a Breakthrough". Road to VR.
  38. ^ Matthew Terndrup (6 October 2015). "Palmer Luckey talks advantages of the Rift's custom lenses". UploadVR.
  39. ^ "Advantages of virtual reality in medicine - Virtual Reality". Virtual Reality. Retrieved 12 April 2016.
  40. ^ a b Rousseau, Rémi (13 August 2014). "Virtual surgery gets real: What the Oculus Rift could mean for the future of medicine". Medium. Retrieved 12 April 2016.