Optimizing presence: Realistic child robot Hal cries and bleeds on med students

[The creators of a new child robot for training medical students have purposely adjusted the level of presence it evokes for its users by making it as realistic as possible in function but not maximally realistic in appearance. Note the comments in the story from Wired about breaks in presence (without using that term) and the observation that even plain rubber dummies can evoke intense responses. For much more information including images and videos, see the Gaumard website, and see NBC Bay Area for a 3:48 minute video news report and a 9:33 minute 360 video. –Matthew]

This Hyper-Real Robot Will Cry and Bleed On Med Students

Matt Simon
September 6, 2018

Hal the robot boy is convulsing. His head shakes back and forth so rapidly, it looks like he’s vibrating. His eyelids droop over his blue eyes and his mouth is ajar. He makes no sound, other than the faint whirs of his motors.

Hal was built to suffer. He is a medical training robot, the sort of invention that emerges when one of the most stressful jobs on Earth tumbles into the uncanny valley. No longer must nurses train on lifeless mannequins. Hal can shed tears, bleed, and urinate. If you shine a light in his eyes, his pupils shrink. You can wirelessly control him to go into anaphylactic shock or cardiac arrest. You can hook him up to real hospital machines, and even jolt him with a defibrillator. Hal—which is just now coming onto the market—is so realistic, and these scenarios so emotionally charged, that the instructors who run him in medical simulations have to be careful not to push things too far and upset trainees.

“I’ve seen several nurses be like, ‘Whoa it moves!’” says Marc Berg, medical director at the Revive Initiative for Resuscitation Excellence at Stanford. “I think that’s kind of similar to the idea that if you’ve driven a car for 20 years and then you got a brand new car, you’re kind of amazed initially.”

The company behind this $48,000 robot boy is Gaumard Scientific, which has been developing medical simulators since the 1940s, beginning with synthetic skeletons and anatomical figures. Now, though, the company’s tech has become much more interactive with Hal’s extended family of humanoid robots. Victoria is a robotic woman who gives birth to a baby robot. And Super Tory is a newborn that can help nurses learn to watch for signs of illness in real babies.

Inside Hal, a combo mechanical-pneumatic system makes him breathe, and a cartridge in his leg allows him to exhale CO2. Hydraulic systems provide fake blood and tears. Servo motors tug on his face, helping him to look angry or scared, among other emotions. He even speaks, with a repertoire that includes shouting for his mother and telling you not touch him. If you like, you can even speak through the robot, with a system that turns your voice into that of a 5-year-old.

One of the reasons for building Hal was to train medical workers on how to approach children, who may not be forthcoming about their symptoms. “They can often do that by facial expression,” says James Archetto, Gaumard’s vice president. To get the expressions right, the company’s engineers worked with pediatricians to fine-tune how an angry or happy child’s face really moves—muscles contracting here, brows furrowing there.

To avoid a faceplant into the uncanny valley, Hal’s designers decided not to give him blemishes or freckles—he has to convince trainees he’s real enough to be an effective tool, but not so real that he becomes a distraction.

What Hal does have, though, is a functioning nose and mouth. “In certain situations such as anaphylaxis, his tongue will swell, his throat will swell,” says Archetto. Medical trainees can even cut a small slit in his throat to practice inserting a tracheal tube to re-establish an airway.

Students can also hook him up to an EKG to monitor his “heart.” He has a pulse too, which they can monitor with a blood pressure cuff. An instructor can manipulate these vital signs using a tablet, stringing certain symptoms together to simulate, say, cardiac arrest. “For so many years, the mannequins were really just rubber human likenesses with basically no interactivity at all,” says Berg. “They’re finally increasing exponentially in their realism.”

During an old-school simulation on a rubber dummy, the trainees would have to check with the instructors to get critical readings. They would answer back from another room through a microphone called the Voice of God: “You do not feel a pulse.” Which tended to ruin the magic of it all and pull participants out of the simulation. Hal, on the other hand, automatically gives trainees a mountain of readings, thus keeping the wizardry alive.

The concern, though, is that Hal’s magic might seem too real, distressing participants during a tense scenario. Even when training on plain rubber dummies, folks can crack. “We can amp the stress level up so high for the participants that people will cry, essentially have to drop out of the scenario,” says Berg. “I do think there’s a good potential that we’ll see more of that emotional type response when the mannequin is so realistic.”

As with any simulation technology, be it virtual reality or other advanced mannequins like a rather more gory dummy with realistic internal organs, the robot is a tool, not a teacher. In the end, machines can’t teach us about the often overwhelming emotions and stress in medicine—our fellow humans can.

“Maybe one day machines will be so sophisticated they’ll be able to interpret our emotions and replicate our emotions,” says Lillian Su, medical director for simulation at the Heart Center of Lucile Packard Children’s Hospital. “But until then, we as the humans have to control that part and know how to use the machine so we can train people in that kind of environment.”

“I think that’s going to add an emotional layer, a challenge that we as educators have to be prepared for,” Su adds.

Welcome to the uncanny valley, future physicians.

This entry was posted in Presence in the News. Bookmark the permalink. Trackbacks are closed, but you can post a comment.

Post a Comment

Your email is never published nor shared. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

*
*

  • Find Researchers

    Use the links below to find researchers listed alphabetically by the first letter of their last name.

    A | B | C | D | E | F| G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z