Share Email Print

Proceedings Paper

The Rosetta phone: a hand-held device for automatic translation of signs in natural images
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

When traveling in a region where the local language is not written using the Roman alphabet, translating written text (e.g., documents, road signs, or placards) is a particularly difficult problem since the text cannot be easily entered into a translation device or searched using a dictionary. To address this problem, we are developing the "Rosetta Phone," a handheld device (e.g., PDA or mobile telephone) capable of acquiring a picture of the text, identifying the text within the image, and producing both an audible and a visual English interpretation of the text. We started with English, as a developement language, for which we achieved close to 100% accuracy in identifying and reading text. We then modified the system to be able to read and translate words written using the Arabic character set. We currently achieve approximately 95% accuracy in reading words from a small directory of town names.

Paper Details

Date Published: 28 February 2008
PDF: 11 pages
Proc. SPIE 6821, Multimedia on Mobile Devices 2008, 68210E (28 February 2008); doi: 10.1117/12.766648
Show Author Affiliations
Syed Ali Raza Jafri, Purdue Univ. (United States)
Aravind K. Mikkilineni, Purdue Univ. (United States)
Mireille Boutin, Purdue Univ. (United States)
Edward J. Delp, Purdue Univ. (United States)

Published in SPIE Proceedings Vol. 6821:
Multimedia on Mobile Devices 2008
Reiner Creutzburg; Jarmo H. Takala, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?