“Fall in Love VR” creates “a sense of real intimacy”

[I’m just back from the IBC2017 Conference, where I gave a talk, got a glimpse of new technologies and had a series of valuable and enjoyable conversations about presence; great thanks to long-time presence advocate and producer of the IBC technical sessions Nick Lodge (info; video).

The story below from Fast Company describes a VR project that raises a series of intriguing questions about presence without ever using the term; if only Horton and Wohl, who originated the term parasocial interaction, could see “Fall in Love VR.” The original version of the story includes a second image and a 0:29 minute video; follow the link to the project’s website for more information and a 1:21 minute video. –Matthew]

How Virtual Reality Could Help You Fall In Love

“Fall in Love VR,” for the Oculus Rift, shows how integrating natural-language processing in virtual reality can create a sense of real intimacy.

By Daniel Terdiman
September 19, 2017

In 2015, The New York Times caused quite a stir by publishing “The 36 Questions That Lead To Love,” based on work by the psychologist Arthur Aron. The main idea was that people would have to be incredibly vulnerable to ask and answer such questions—and doing so could quickly build intimacy.

“The most interesting thing from the research,” said Kevin Cornish, the director of Fall in Love VR, “is this premise that the thing that creates human bonds is not the words we say to each other, but the act of conversation.”

In Cornish’s new virtual reality project, released today for the Oculus Rift, users confront the question of whether it’s possible to experience intimacy with an avatar by sitting across from one of five photo-realistic actors and, one by one, asking many of Aron’s questions off prompt cards. Out loud.

The speaking-out-loud bit is key, as the potential love interests, looking adorable, yet vulnerable, respond only when the specific questions are asked. Ask or say anything else and they just sit there looking expectant.

That’s because Fall in Love VR, from Tool of North America, uses natural language processing –becoming among the first to utilize the technology in an interactive VR project–to make users feel like they’re truly having an intimate conversation. Cornish said he got the idea when working on a VR film with Taylor Swift. “There was one moment where [Swift] looks into the camera,” he recalls, “and it feels like she’s looking at you and talking to you. There’s a connection that you can get in VR and not any other medium.”

Added Cornish, “The idea is taking all the advancement in natural language processing and pairing that with an intimate conversational experience to give a sense of what it’s going to be like when we’re having conversations in virtual reality. It’s like that moment in [the film] Her, when there’s that question of how many people are you talking to, and how scalable is it [to have an AI say the words and have them repeated again and again to other users]….I only have to have that conversation once. It’s kind of like the VR equivalent of what CC meant for email.”

In short, the idea behind Fall in Love VR was to give users a conversational experience where the joy comes from the simple act of having the conversation.

ONE-WAY CONVERSATION

When you first sit down across from your potential digital love interest–you can choose from two women or three men–he or she asks, innocuously, if you’d like to go first.

Although that gives the initial impression that this will be a two-way conversation, it really isn’t. The entire experience is built around you asking the avatar questions, and them answering. In the early stages of production, Cornish explained, the idea had been that the avatars would ask you questions as well, but that was quickly rejected because in testing, Tool found it put people on the spot, which left them feeling uncomfortable. The decision was made to limit the functionality to asking questions of the avatars and having them respond. So those interactions have to be as realistic as possible.

To Cornish, the goal was building what amounts to a high-quality, embodied chatbot with a real personality.

“So much of a personality is based on a face,” he said, “It’s that idea of pairing natural-language and machine learning with the personality and the warmth and eye contact that come with having a photo-realistic human face.”

The experience of sitting down across from one of the avatars is oddly normal. I found myself across from Grace van Dien, a 20-year-old actress who’s starred in the Netflix show Greenhouse Academy, and starting to ask her questions about her life. I wasn’t sure what to expect. But sure enough, Grace’s answers seemed heartfelt, honest, and most of all, vulnerable.

I can’t say exactly how I responded, but Cornish has watched a lot of people go through Fall in Love VR and says that often, their mannerisms–smiling, getting a little nervous–reflect what they would normally do if they were sitting across from someone having a get-to-know-you conversation. “They look down to read the question [off the card], then look up, make eye contact, and then ask the question,” he said. “It’s kind of this little mannerism that people do in the real world that you wouldn’t do if you were just interacting with a computer.”

Cornish is also fond of one bit of feedback he’s heard on multiple occasions: “We hear, ‘my wife would be jealous of this,’ or ‘my boyfriend would be jealous.’ It’s such an interesting thing in making a film that that’s the reaction….It really comes from the eye contact and the naturalness of” the interaction.

For Facebook-owned Oculus, which helped with the film’s production, Fall in Love VR was an opportunity to see how natural interactions in virtual reality can be.

“Can you create intimacy in VR that feels human,” asked Yelena Rachitsky, Oculus’s executive producer for experiences. “Can you create something that feels like a connection?”

One important thing she learned, Rachitsky said, was that the more time you spent watching the film, the more you feel connected to the actors. And that probably can’t work if the actors had been computer-generated. Instead, it was vital that the film utilize real people integrated into VR in such a way that it feel like you’re sitting across from a normal person.

Over time, Cornish said, he sees Fall in Love VR as a stepping-stone to further projects that take advantage of the ability of virtual reality to put users face-to-face with realistic avatars.

That’s led to a range of proposals for new ways to utilize the basic interaction engine Tool built. Among them, said Cornish, have been virtual retail environments offering concierge service, or sales training opportunities. There’s also the potential for using the system to give celebrities a way to interact with their fans.

“There is such a natural interaction with conversation,” Rachitsky said. “It’s definitely paving [the way to] what else we can be doing that feels intuitive and natural.”

This entry was posted in Presence in the News. Bookmark the permalink. Trackbacks are closed, but you can post a comment.

One Comment

  1. Kayla Smith
    Posted September 21, 2017 at 9:37 am | Permalink

    I have a hard time deciphering how I feel about VR love and connection devices. On one hand, there are people who may benefit from the conversation, the feeling of being one-on-one, as real life conversation or connection can be scary and difficult. Although, on the other hand, isn’t our immersion and connection to technology what makes us easier to withdraw from one-on-one conversation with real people?

    Just examining our use of phones and how it has changed our way or communicating is altering so it only makes sense (to me), that VR is another extension of this disconnection from human-connection, and increasing our sense that technology can in-fact, replace interaction all together.

    I can see pros for people who need connection, who struggle to have it in real life, but I also don’t think we can be ignorant to the fact in the end, it’s not real. Perhaps a device like this could be used as a sort or therapy to help people over-come their own social boundaries.

Post a Comment

Your email is never published nor shared. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

*
*

  • Find Researchers

    Use the links below to find researchers listed alphabetically by the first letter of their last name.

    A | B | C | D | E | F| G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z

css.php