Image translation

From Wikipedia, the free encyclopedia
Jump to: navigation, search

Image translation is a term related to machine translation services for mobile devices (mobile translation). Image translation refers to an additional service provided by mobile translation applications where the user can take a photo of some printed text (menu list, road sign, document etc.), apply optical character recognition (OCR) technology to it to extract any text contained in the image, and then have this text translated into a language of their choice.


While machine translation made available for mobile users (mobile translation) is a notable advance in multilingual communication eliminating the need for an intermediary translator/interpreter, translating foreign texts still poses a problem to the user as they cannot be expected to be able to type the foreign text they wish to translate and understand. Manually entering the foreign text may prove to be a difficulty especially in cases where an unfamiliar alphabet is used, e. g. Cyrillic, Chinese, Japanese etc. for an English speaker or any speaker of a Latin-based language.

The possibility to use one's mobile device's camera to capture and extract printed text is also known as mobile OCR and was first introduced in Japanese manufactured mobile telephones in 2004. Using the handheld's camera one could take a picture of (a line of) text and have it extracted (digitalized) for further manipulation such as storing the information in their contacts list, as a web page address (URL) or text to use in an SMS/email message etc.

Presently, mobile devices having a camera resolution of 2 megapixels or above with an auto-focus ability, often feature the text scanner service. Taking the text scanning facility one step further, image translation emerged, giving users the ability to capture text with their mobile phone's camera, extract the text, and have it translated in their own language.


The development of the image translation service springs from the advances in OCR technology (miniaturization and reduction of memory resources consumed) enabling text scanning on mobile telephones.

Among the first to announce mobile software capable of “reading” text using the mobile device's camera is International Wireless Inc. who in February 2003 released their “CheckPoint” and “WebPoint” applications. “CheckPoint” reads critical symbolic information on checks and is aimed at reducing losses that mobile merchants suffer from “bounced” checks by scanning the MICR number on the bottom of a check, while “WebPoint” enables the visual recognition and decoding of printed URL's, which are then opened by the device's web browser.[1]

The first commercial release of a mobile text scanner, however, took place in December 2004 when Vodafone and Sharp began selling the 902SH mobile which was the first to feature a 2 megapixel digital camera with optical zoom. Among the device's various multimedia features was the built-in text/bar code/QR code scanner. The text scanner function could handle up to 60 alphabetical characters simultaneously. The scanned text could be then sent as an email or SMS message, added as a dictionary entry or, in the case of scanned URLs, opened via the device's web browser. All subsequent Sharp mobiles feature the text scanner functionality.[2]

In September 2005, NEC Corporation and the Nara Institute of Science and Technology in Japan (NAIST) announced new software capable of transforming cameraphones into text scanners. The application differs substantially from similarly equipped mobile telephones in Japan (able to scan businesscards and small bits of text and use OCR to convert that to editable text or to URL addresses) by it ability to scan a whole page. The two companies, however, said they would not release the software commercially before the end of 2008.[3]

Combining the text scanner function with machine translation technology was first made by US company RantNetwork who in July 2007 started selling the Communilator, a machine translation application for mobile devices featuring the Image Translation functionality. Using the built-in camera, the mobile user could take a picture of some printed text, apply OCR to recognize the text and then translate it into any one of over 25 language available.[4]

In April 2008 Nokia showcased their Shoot-to-Translate application for the N73 model which is capable of taking a picture using the device's camera, extracting the text and then translating it. The application only offers Chinese to English translation, and does not handle large segments of text. Nokia said they are in the process of developing their Multiscanner product which, besides scanning text and business cards, would be able to translate between 52 languages.[5]

Again in April 2008, Korean company Unichal Inc. released their handheld Dixau text scanner capable of scanning and recognizing English text and then translating it into Korean using online translation tools such as Wikipedia or Google Translate. The device is connected to a PC or a laptop via the USB port.[6]

In February 2009, Bulgarian company Interlecta presented at the Mobile World Congress in Barcelona their mobile translator including image recognition and speech synthesis. The application handles all European languages along with Chinese, Japanese and Korean. The software connects to a server over the Internet to accomplish the image recognition and the translation.[7]

Currently, image translation is offered by the following companies:

  • RantNetwork's Communilator
  • Ta With You's T-Image[8]
  • Interlecta [9]


  1. ^ "International Wireless, Inc. Reads Personal Checks with Cell Phones. - Free Online Library". Retrieved 2012-02-24. 
  2. ^ "The Sharp 902 - Europe's First 3G Mobile with 2 Megapixel Digital Camera". UMTS Forum. Retrieved 2012-02-24. 
  3. ^ "Camera phones will be high-precision scanners - tech - 14 September 2005". New Scientist. Retrieved 2012-02-24. 
  4. ^ "RantNetwork Tm: PressRelease". Retrieved 2012-02-24. 
  5. ^ [1] Archived April 12, 2009, at the Wayback Machine.
  6. ^ "1-Click Dictionary Dixau - News - Dixau text scanner" (in Korean). Retrieved 2012-02-24. 
  7. ^ "Translation Software with Speech for BlackBerry". Archived from the original on January 13, 2010. Retrieved April 28, 2017. 
  8. ^ [2] Archived February 26, 2009, at the Wayback Machine.
  9. ^ "Products | Interlecta™". Retrieved 2012-02-24.