Mixed Reality Integrated Environment

Image

Our system explores how Mixed Reality can be used for human-robot interaction.

Read the paper

JAMES E. YOUNG and Ehud Sharlin. Sharing Spaces with Robots: an Integrated Environment for Human-Robot Interaction. In Proceedings of the 1st International Symposium on Intelligent Environments, 2006. ISIE ’06, Cambridge, UK, April 5–7, 2006, pages 103–110, Cambridge, UK, April 2006. Microsoft Research Ltd., Microsoft Research Ltd. Press.

When interacting with co-located people, robots are generally limited to their on-body communication methods or to communicating through networked PC devices. Using mixed reality, robots can expand their display space and interact with users using rich, interactive graphics. Furthermore, robots are able to asynchronously communicate with these methods, as they can leave mixed reality 'thought crumbs' behind as information to users; information that is still there even after a robot leaves a space. This paper is an exploration of how these technologies can be used.

Full quality video:

System in Use