Arabic Letter Frequency

From Wikipedia, the free encyclopedia
Jump to: navigation, search

What gets counted in input Arabic text?[edit]

Chiefly, the Arabic alphabet consists of 28 primary letters, these are letters 1 to 28 in Table 1. However, when scripting in Arabic, the eight modified letters listed in positions 29 to 36 in the same table are used just the same. If these 8 modified forms are lumped back into the primary list based on shape or phonetic similarity, the outcome then is as shown in Table 2. For accurate frequency analysis, each of the 36 letters of Table 1 gets its frequency counted independently. The ordering of the alphabet shown in the tables is more logical than is used by the Unicode standard.

Figure 1: Arabic characters that can be produced using the Arabic Letter Keyboard Intellark.
Table 1: The Arabic alphabet. Letters 1 to 28 are the primary letters. Letters 29 to 36 are the modified letters.
Table 2: The Arabic alphabet, with modified letters lumped onto their primary forms.

Although the full set of Arabic characters includes about ten diacritics as shown in the Figure 1, frequency analysis of Arabic characters is only concerned with computing the frequency of alphabet letters shown in Table 2.

Sources with over five million letters[edit]

The following famous Arabic sources are used to generate an acceptable amount of data on which frequency statistics are conducted.

  • The first seven volumes of the series البداية والنهاية (The Beginning and The End)[1] of Ibn Kathir. All together, these seven volumes fill up 2,855 pages, containing 1,096,047 words, containing 4,326,031 letters.
  • The book of الرحيق المختوم (The Sealed Nectar: the life of Prophet Mohammad PBBU)[2] of Almubarakfuri. The book is spread over 284 pages, containing 134,662 words, containing 553,740 letters.
  • The book of تحفة العروسين (The Masterpiece of the Brides)[3] for Al-shuri. The book is spread over 239 pages, containing 66,550 words, containing 242,361 letters.

Collectively, these sources add up to 3,378 pages, generating 1,297,259 words, or, 5,122,132 letters. The following two figures show the letter frequency distribution for the counted letters; Figure 2 shows a histogram data sorted on Unicode value. Figure 3 shows a histogram data sorted on frequency.

Figure 2: Arabic letter frequency distribution, sorted according Unicode value. Figure 3: Arabic letter frequency distribution, sorted according frequency of letters.

Qur'an letter and word frequency statistics[edit]

Using the Qur'an as data source for Arabic letter frequency generation, the frequency distribution of letters is much in line with what's reported and exhibited in the Figures 2 and 3 above.[4] The following list highlights statistics particular to one of the most common print editions (the recitation of Hafs through Asim) also available online.

  • Number of letters is 330,709
  • Number of words without repetition is 14,870
  • Number of words in the entire Quran is 77,797
  • Number of verses is 6,236
  • The average word length in the Quran is 330,709 ÷ 77,797 = 4.25

A detailed study of letter and word frequency analysis of the entire book of Qur'an is provided by Intellaren Articles.[5]

References[edit]

  1. ^ Ibn Kathir, Ismail (1???). The beginning and the End (in Arabic). Retrieved 23 January 2011. 
  2. ^ Almubarakfuri, Safiyyurrahman (19??). The Sealed Nectar. Retrieved 24 January 2011. 
  3. ^ Ash-shuri, Majdi (19??). Masterpiece of the Bride. Retrieved 24 January 2011. 
  4. ^ Madi, Mohsen (2010). "Comparative frequency analysis of Arabic Texts". Intellaren Articles. Retrieved 24 January 2011. 
  5. ^ Madi, Mohsen (2010). "Quran Suras Statistics". Intellaren Articles. Retrieved 16 January 2011. 

External links[edit]