Jump to content

Tatoeba: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
Trying to make it sound less like an advertisement.
Line 46: Line 46:
==Usage==
==Usage==
Parallel text corpora such as Tatoeba are used for a variety of [[natural language processing]] tasks such as [[machine translation]]. The Tatoeba data has been used as data for [[Treebank|treebanking]] Japanese <ref>Francis Bond, 栗林 孝行 [Takayuki Kuribayashi], 橋本 力 [Hashimoto Chikara] (2008)
Parallel text corpora such as Tatoeba are used for a variety of [[natural language processing]] tasks such as [[machine translation]]. The Tatoeba data has been used as data for [[Treebank|treebanking]] Japanese <ref>Francis Bond, 栗林 孝行 [Takayuki Kuribayashi], 橋本 力 [Hashimoto Chikara] (2008)
HPSGに基づくフリーな日本語ツリー バンクの構築 [A free Japanese Treebank based on HPSG]. In 14th Annual Meeting of The Association for Natural Language Processing, Tokyo.</ref> and statistical machine translation <ref> Eric Nichols, Francis Bond, Darren Scott Appling and Yuji Matsumoto (2010) Paraphrasing Training Data for Statistical Machine Translation. Journal of Natural Language Processing, 17(3), pages 101-122.</ref>, as well as its use in the [[WWWJDIC]] English-Japanese dictionary.
HPSGに基づくフリーな日本語ツリー バンクの構築 [A free Japanese Treebank based on HPSG]. In 14th Annual Meeting of The Association for Natural Language Processing, Tokyo.</ref> and statistical machine translation <ref> Eric Nichols, Francis Bond, Darren Scott Appling and Yuji Matsumoto (2010) Paraphrasing Training Data for Statistical Machine Translation. Journal of Natural Language Processing, 17(3), pages 101-122.</ref>, as well as the [[WWWJDIC]] English-Japanese dictionary.


==References==
==References==

Revision as of 20:29, 20 March 2011

Tatoeba.org
Type of site
Open collaborative multilingual sentence dictionary
Available in15 languages; content in 87 languages
OwnerTrang Ho
Created byTrang Ho
URLhttp://tatoeba.org/
CommercialNo
RegistrationOptional

Tatoeba.org is a free online database of example sentences geared towards foreign language learners. Its name comes from the Japanese term "tatoeba" (例えば tatoeba), meaning "for example". Unlike other online dictionaries, which focus on words, Tatoeba focuses on complete sentences, their grammatical properties, and translating them into other languages. Anyone can sign up and contribute, regardless of linguistics background or second language proficiency. Tatoeba was founded by Trang Ho in 2006 and was initially hosted on Sourceforge under the project name "multilangdict"[1]. She maintains and administrates the project with Allan Simon, who joined the project in 2009[2]. Tatoeba is hosted and supported by the Free Software Foundation France[3].

Content

As of March 2011, Tatoeba's corpus has 780,000 sentences in 87 languages. A list of how many sentences there are in each language can be found on Tatoeba's language statistics page. The interface is available in 15 different languages.

Tatoeba is also the current home of the Tanaka Corpus, a once public-domain series of about 150,000 English-Japanese sentence pairs compiled by Hyogo University professor Yasuhito Tanaka first released in 2001, and where it is undergoing its latest revisions [4][5].

Interface

Users, even non-registered ones, can search for words in any language to retrieve a list of sentences using that word. Each sentence in the Tatoeba database are displayed next to its translations in other languages; direct and indirect translations are differentiated. Sentences are tagged for content such as subject matter, dialect, or vulgarity; they also each have individual comment threads to facilitate feedback and corrections from other users and cultural notes. Almost 10,000 sentences in 8 languages currently have audio readings. Sentences can also be browsed by language, tag, or audio.

Registered users can add new sentences or translate or proofread existing ones, even if their target language is not their native tongue. Translations are linked to the original sentence automatically. Users can freely edit their own sentences, "adopt" and correct sentences without an owner, and comment on others' sentences. Trusted users, a rank above new users, can tag, untag, link, and unlink sentences.

Database structure

A simplified diagram of Tatoeba's underlying data structure.

Tatoeba's basic data structure is a series of nodes and links. Each sentence is a node; each link bridges two or more sentences with the same meaning[6].

License

The entire Tatoeba database is published under a Creative Commons Attribution 2.0 license[7], freeing it for academic and other use.

Acclaim

Tatoeba received a grant from Mozilla Drumbeat in December 2010[8][9].

Usage

Parallel text corpora such as Tatoeba are used for a variety of natural language processing tasks such as machine translation. The Tatoeba data has been used as data for treebanking Japanese [10] and statistical machine translation [11], as well as the WWWJDIC English-Japanese dictionary.

References

  1. ^ "Trang's dictionary project". sourceforge.net.
  2. ^ "Tatoeba.org, base de données de phrases d'exemple". linuxfr.org (in French). July 17th, 2010. Retrieved March 20, 2011. {{cite web}}: Check date values in: |date= (help)
  3. ^ "Tatoeba, un dictionnaire de langues pour phrases d'exemples". fsffrance.org (in French). Paris: FSF France. February 24, 2011. Retrieved March 20, 2011. {{cite web}}: Unknown parameter |trans_title= ignored (|trans-title= suggested) (help)
  4. ^ "Tanaka Corpus". EDRDG Wiki. Electronic Dictionary Research and Development Group. February 3, 2011. Retrieved March 20, 2011.
  5. ^ Breen, Jim (March 2, 2011). "WWWJDIC - Information". WWWJDIC. Monash University. Retrieved March 20, 2011.
  6. ^ Ho, Trang (February 23, 2010). "How to be a good contributor in Tatoeba". Tatoeba Project Blog. Retrieved March 20, 2011.
  7. ^ "Terms of use". Tatoeba.org. Retrieved March 20, 2011.
  8. ^ Ho, Trang (January 17, 2011). "Grant from Mozilla Drumbeat". Tatoeba Project Blog. Retrieved March 20, 2011.
  9. ^ Moltke, Henrik (December 30, 2010). "Best Drumbeat Projects: Tatoeba – a free and open database of sentences". Yoyodyne.cc. Retrieved March 20, 2011. ...the Mozilla Foundation wants to encourage and help the Tatoeba project by giving it a USD 2.5K Mozilla Drumbeat Grant.
  10. ^ Francis Bond, 栗林 孝行 [Takayuki Kuribayashi], 橋本 力 [Hashimoto Chikara] (2008) HPSGに基づくフリーな日本語ツリー バンクの構築 [A free Japanese Treebank based on HPSG]. In 14th Annual Meeting of The Association for Natural Language Processing, Tokyo.
  11. ^ Eric Nichols, Francis Bond, Darren Scott Appling and Yuji Matsumoto (2010) Paraphrasing Training Data for Statistical Machine Translation. Journal of Natural Language Processing, 17(3), pages 101-122.

{{{inline}}}