Share Email Print

Proceedings Paper

Multimodal sensing-based camera applications
Author(s): Miguel Bordallo López; Jari Hannuksela; J. Olli Silvén; Markku Vehviläinen
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The increased sensing and computing capabilities of mobile devices can provide for enhanced mobile user experience. Integrating the data from different sensors offers a way to improve application performance in camera-based applications. A key advantage of using cameras as an input modality is that it enables recognizing the context. Therefore, computer vision has been traditionally utilized in user interfaces to observe and automatically detect the user actions. The imaging applications can also make use of various sensors for improving the interactivity and the robustness of the system. In this context, two applications fusing the sensor data with the results obtained from video analysis have been implemented on a Nokia Nseries mobile device. The first solution is a real-time user interface that can be used for browsing large images. The solution enables the display to be controlled by the motion of the user's hand using the built-in sensors as complementary information. The second application is a real-time panorama builder that uses the device's accelerometers to improve the overall quality, providing also instructions during the capture. The experiments show that fusing the sensor data improves camera-based applications especially when the conditions are not optimal for approaches using camera data alone.

Paper Details

Date Published: 17 February 2011
PDF: 9 pages
Proc. SPIE 7881, Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V, 788103 (17 February 2011); doi: 10.1117/12.871934
Show Author Affiliations
Miguel Bordallo López, Univ. of Oulu (Finland)
Jari Hannuksela, Univ. of Oulu (Finland)
J. Olli Silvén, Univ. of Oulu (Finland)
Markku Vehviläinen, Nokia Research Ctr. (Finland)

Published in SPIE Proceedings Vol. 7881:
Multimedia on Mobile Devices 2011; and Multimedia Content Access: Algorithms and Systems V
David Akopian; Cees G. M. Snoek; Nicu Sebe; Reiner Creutzburg; Lyndon Kennedy, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?