Basic Linguistic Resources and Baselines for Bhojpuri, Magahi and Maithili for Natural Language Processing
Table 8. Word Length Analysis in terms of characters (where * indicates the number of sentences of each of the languages is made equal to Maithili)
['[BOLD] Language', '[BOLD] Min', '[BOLD] Max', '[BOLD] Max*', '[BOLD] Mean', '[BOLD] Mean*', '[BOLD] Median', '[BOLD] Median*', '[BOLD] Std. Dev.', '[BOLD] Std. Dev.*']
Word length Yet another parameter that can be used to compare languages based on basic quantitative measures is the word length. Since the postposition marker or case marker (vibhakti) behaves differently in these languages, affecting the word lengths because sometimes it attaches to the previous word as a morphological suffix, while other times it is a separate word, word length analysis can give some more evidence in support of or against some existing linguistic knowledge. Also, word length has been an important factor in readability metrics (Kincaid et al. From the table, the earlier observations about morphological complexity are again strengthened. While the minimum has to be one for all languages, all the other four statistics (maximum, mean, median and standard deviation) have values in the same order as earlier, i.e., highest for Maithili among the three Purvanchal languages and lower for Bhojpuri and Magahi. Hindi has the highest values for the same reasons stated earlier. The figure provides even more evidence for this. It also perhaps shows the typological distance of Maithili from the other two Purvanchal languages, with Hindi being a special case due to relatively high standardization and academic usage.