KTH researchers develop interactive, social robot
Researchers from KTH Royal Institute of Technology have developed what they describe as an interactive robotic head that takes its name from the fur hat it wears. With a computer-generated, animated face that is rear-projected on a 3D mask, Furhat functions as a testing platform for various interactive technologies such as speech synthesis, speech recognition and eye-tracking. The robot can conduct conversations with multiple people, turning its head and looking each person straight in the eye, while moving its animated lips in synch with its words.
Samer Al Moubayed, one of the KTH researchers behind the development of Furhat, said the project represents the third generation of spoken dialogue systems that has been in development at KTH's department for speech, music and hearing during the last 15 years.
The social robot, Furhat, converses with PhD student Catharine Oertel. (Photo: David Callahan).
The Furhat team aims to develop its technology for commercial use, with the help of funding from Sweden's Vinnova, a government agency that supports innovation projects. The team behind the development of Furhat also includes: Jonas Beskow, Joakim Gustafson and Gabriel Skantze.
"Furhat is becoming a popular research platform for scientists around the world who study human interaction with machines," Al Moubayed noted. "It's very simple, it's potentially very cheap to make, and people want to use it in their own research areas."
Furhat also has attracted attention from researchers at Microsoft and Disney. "They have been following the development of Furhat for a long time," indicated Al Moubayed, who presented the hardware and software behind Furhat at Microsoft's and Disney's research labs.
Al Moubayed added that Furhat has potential as an interactive user interface for a variety of applications. In schools, it could be used to conduct knowledge games with children. In assisted living centers, it could share information and chat with people.
Perched on a stand atop a bureau in Al Moubayed's office, Furhat greets a visitor and asks their name. It then addresses Al Moubayed, and after a couple more questions, asks if the visitor has any questions for Furhat. During a pause in the exchange, the robot offers to tell a joke.
Part of what sets Furhat apart from other interactive robots is its ability to make not only conversation, but eye contact-an important element of communication.
"You want an interface that fulfils or reaches a critical quality that people can interact with in a natural way, otherwise the interaction you get is not natural anymore, and does not resemble how people interact with each other."
Furhat's ability to turn its face to multiple people in a conversation is enabled by face-tracking software. But its ability to make eye contact is achieved through projection. Unlike a 2D image, which can appear to be looking at everybody in the room at once, a phenomenon known as the "Mona Lisa effect," Furhat appears to shift its gaze because the face is projected onto 3D-printed model of a human face.
"When we first experimented with this, the effect was strong immediately," Al Moubayed noted. "You could bond with, or relate to, the face.
"It is an avatar that can really be present in the physical environment."
Such technologies are being explored as a potential therapeutic tool for children with autism and other disorders that affect social interaction, he said. The technology can also be used for telepresence applications in which 3D replicas of people's faces become the screens that we look at when conducting a video conference call.
"There are many different types of interest that drive this work," he stated. "And we're just starting to explore its potential."