[Aside from the main point about rethinking the Z-axis in designing presence experiences in VR, this report from DeveloperTech contains the noteworthy point made by an AMD VP that the ultimate goal is making the virtual indistinguishable from real life; a contrasting view is presented in an excerpt from a Medium contributor that follows below. –Matthew]
[Image: Source: pysnnoticias.com]
AMD: VR requires creators to ‘rethink the Z’
By Ryan Daws
13 April 2017
VR is coming of age, but it will suffer unless creators ‘rethink the Z’ and don’t let content of the past define content of the future.
That was the message of AMD Corporate Vice President Roy Taylor in the opening keynote of VR World Congress. “Our understanding of virtual reality is seen through the prism of our current understanding, and our understanding is going to develop,” observes Taylor. Pioneering studies into how time distorts while in VR, and how pain can be decreased using virtual reality, could have a major impact on how content is developed for a wide range of use cases. “We are at the beginning, and we’re going to see some wonderful changes start to happen.”
BAFTA (British Academy of Film and Television Arts) produced a sizzle reel highlighting the best of VR across various categories; each displaying how far the industry has advanced and the incredible content we’re beginning to see with deeper levels of immersion and engagement than ever before.
“As great as that content is, one of the challenges we have is we need to ‘rethink the Z’,” says Taylor. “We’ve been looking for 120 years through a window and we’re starting to experiment [;] for the first time we’ve stepped through that window into the other side – but we’re looking at it through the prism of our current knowledge and experience.”
It’s observed that early movies appeared like plays because we understood theatre, and the first VR now appears like movies because we understand film. Likening it to the ‘X, Y, Z’ axis on a graph, we’re able to go forward in ‘Z depth’ Taylor says, “in ways we’re yet to fully understand.”
An example is provided of Case Western Reserve University who are using HoloLens to observe the human body. In VR we don’t just have the ability to look at organs, how the blood works, and that kind of thing… but we have the ability to look at how cells work. We can go into subatomic detail forward into the body, or backwards out into the universe. “This scale, to go from subatomic to universal size, and yet we’re only operating in this [X, Y] part here, we’re only using part of the Z,” explains Taylor. “We need to think how far in we can go, and how far out we can go.”
Technology is advancing at such a rate – driven by demand and fierce competition – that Taylor recommends creators don’t target what computers are able to render today, but what they’ll be able to achieve by the time your project hits the market. He says, it’s easier to scale things down to reach performance targets later than it is to scale them up.
Getting to photorealism in VR is the next step, while ‘full presence’ is the ultimate goal where it’s indistinguishable between real life and virtual. Achieving that today is out of reach as it would take 1000 TFLOPS of performance.
Movement has proven a problem so far in virtual reality as most people don’t have the room to run about without causing damage or hurting themselves, or don’t have the money for expensive and bulky equipment like the Virtuix Omni self-contained treadmill. But movement is one of the most important aspects to feel natural for any sense of realism.
One company Taylor is excited about is Servios and their ‘Fluid Locomotion’ technology which is being demonstrated in their Sprint Vector game. The idea is using natural hand movements, such as running, to propel yourself forward within a virtual environment. “You can leap, you can walk, you can run, you can duck, you can roll, and I can tell you if you’ve not tried it, it’s completely intuitive,” comments Taylor.
VR is exciting, but it’s going to take a different approach to creating immersive content now we’ve stepped “through the window” if we’re going to make the most of it. As Taylor says, we need to ‘rethink the Z’.
—–
[An excerpt from Medium; other items in the post are interesting and important too… –ML]
Notes from VRWC 2017
By Verity McIntosh, Enthusiastic exponent of a place where artists, technologists, academics, magicians and robots come out to play. Studio Producer @PMStudioUK
Apr 15, 2017
The race to realism is a red herring. There was a lot of chat about the potential (and for some the danger) of developing our processing and rendering capabilities, such that we cannot differentiate between actual, and virtual reality. As Roy Taylor from AMD put it:
“To get to photo realism is the next big step, to get to full presence is where we need to get afterwards, when actual life will be indistinguishable from virtual reality”.
Certainly this idea is driving the development of ever-faster, and more powerful technology, but is simulcra really all that we want from this emergent form? I appreciated Hrvoje Benko from Microsoft Research’s take on this:
Clare Reddington @clarered
“Insisting on as real as possible VR and AR leads to suboptimal experiences” @hrvojebenko #VRWC17
Instead, Hrvoje illustrated ways in which human perception can be better understood and manipulated to create extraordinary, confounding and sometimes magical experiences in VR, AR and MR (virtual, augmented and mixed reality). Their body warping and world warping demos (below) are pretty exciting:
[4:32 minute video “Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences” available via YouTube]
Hrvoje also introduced the RoomAlive toolkit. RoomAlive uses a multi-kinect, multi projector projection mapping system to create the illusion of augmented reality objects appearing in the real world, without the use of a headset. The toolkit is open source and available here if you fancy having a go.