[The promise of presence: Scientists, doctors and patients walking through a cancer cell, or blood vessel or other part of the body, is likely to have a variety of positive impacts; this story is from Mashable, where it features more images. –Matthew]
[Image: A new project will let scientists step inside a cancer cell. Credit: UNSW.]
Scientists can now explore cells in virtual reality
By Ariel Bogle, Australia
August 16, 2016
After generations of peering into a microscope to examine cells, scientists could simply stroll straight through one.
Calling his project the “stuff of science fiction,” director of the 3D Visualisation Aesthetics Lab at the University of New South Wales (UNSW), John McGhee is letting people come face-to-face with a breast cancer cell.
Using data pulled from a high-resolution electron-microscope at the University of Queensland, the expert in CGI has recreated the cancer cell in virtual reality.
McGhee told Mashable Australia his team uses Unity, the development platform for video games, to build a 3D mesh of the cell adding texture, colour, light and any effects.
Putting on a HTC Vive VR headset, scientists can essentially step into the petri dish and observe nanoparticle drugs being absorbed. They also use hand controllers to navigate the experience.
For the moment, the experience is used primarily for educational purposes.
“Once you immerse in a headset, it’s going to really help you to get your head around complicated processes versus if you just see something on a screen,” he explained. “It’s really allowing you to walk through data in a new way.”
Using the Oculus Rift VR headset, another of McGhee’s projects focuses on the potential use of virtual reality in the rehabilitation of stroke patients.
Steven Faux, director of rehabilitation at St Vincent’s Hospital Sydney, has been working with McGhee for almost three years.
To create the experience, the medical team takes a patient’s MRI or CT scan, determines the mechanism of the stroke they suffered, then a neuroradiologist removes any extraneous parts of the image. At that point, they give the data to McGhee, who turns it into a virtual tour of the patient’s own blood vessels.
“We walk through the blood vessel with the patient and we recreate the stroke,” Faux told Mashable Australia. “If it was a slow closing off the blood vessels, we show that … if it was a clot that came from the heart and blocked a major blood vessel leading to the brain, we show that.”
“It looks like something from the Raiders of the Lost Ark,” he added.
Faux said the impact on patients is often remarkable. For many, it’s the first time they’ve truly understood what happened to them.
For those who have suffered from a stroke, the incident can often leave them confused and cognitively impaired. Occasionally, they lose the ability to understand written or spoken language. Once they’re on the path to recovery, the use of McGhee’s experience can enhance their motivation to engage in rehabilitation.
“We’ve shown it to about four or five [patients] and we’ve had dramatic responses with some of them,” he said. “We showed an 18-year-old man who had suffered a brain haemorrhage while playing football. He was a bit shellshocked by it.
“He was shocked by how violent and damaging [the stroke] was.”
Faux said the technology could have many applications, including for practitioner training and preventative health, but suggested it was difficult to obtain funding for such research.
In the years to come, McGhee also hopes to discover if 3D visualisations could have an impact on the discovery process by letting scientists see their data in an entirely new light.
He’s also working on building the passing of time into the experience, as it’s currently static. He hopes to create a virtual world where scientists can watch how cancer cells move through the body.
“Lots of data is collected on scanners, but it often doesn’t see the light of day,” he said. “How do we get it out there and put it on engaging platforms?”