Enabling Peripheral Vision on Smartphones during Active Use

 

 

Mobile devices are endowed with significant sensing capabilities. However, their ability to 'see' their surroundings, during active use, is limited. We propose Surround-See, a self-contained smartphone equipped with an omni-directional camera that enables peripheral vision around the device to augment daily mobile tasks. SurroundSee provides mobile devices with a field-of-view collinear to the device screen. This capability facilitates novel mobile tasks such as, pointing at objects in the environment to interact with content, operating the mobile device at a physical distance and allowing the device to detect user activity, even when the user is not holding it.

 

Research Methods & Data Analysis:

Focus Group, Video Prototype

Affinity Analysis

 

Video:

 

 

Publication:

Xing-Dong Yang, Khalad Hasan, Neil Bruce, Pourang Irani. 2013. Surround-See: Enabling Peripheral Vision on Smartphones during Active Use. In Proceedings of the 26th Symposium on User Interface Software and Technology (UIST 2013). St. Andrews, UK. ACM. 291-300.

 

Related Files:

 

Programming Language and Environment:

Java, OpenCV4Java, LibSVM, Eclipse, and Android

 

 

Related Projects