Basic Linguistic Resources and Baselines for Bhojpuri, Magahi and Maithili for Natural Language Processing
Table 3. The top ten most frequent words for the three languages in decreasing order of their frequency (Freq) with their Relative frequency (RF) and Cumulative Coverage (CC) values specified, compared with Hindi
['[BOLD] Bhojpuri [ke]', '[BOLD] Freq 49700', '[BOLD] RF 0.070', '[BOLD] CC 0.070', '[BOLD] Maithili [aCi]', '[BOLD] Freq 7359', '[BOLD] RF 0.027', '[BOLD] CC 0.027', '[BOLD] Magahi [ke]', '[BOLD] Freq 29977', '[BOLD] RF 0.070', '[BOLD] CC 0.070', '[BOLD] Hindi [ke]', '[BOLD] Freq 102401', '[BOLD] RF 0.0351', '[BOLD] CC 0.0351']
This table shows the top ten most frequent tokens in the three languages in decreasing order of their frequencies (or RF). A high value of CC indicates that the probability of occurrence regarding both rank and frequency is high. The token [ke] exhibits the highest frequency in both these languages. Further, the CC of the word [ke] is higher in Magahi (0.850) in comparison to the Bhojpuri (0.070). Besides, this word does not exist in this list of the Maithili language, indicating that there is a closer association between Magahi and Bhojpuri. Similar to [ke], [meM], [se], and [ki] are on the equally high frequent ranks in the Bhojpuri and Magahi. The CCs are again found to be higher in Magahi (1.135, 1.564, 2.277) than Bhojpuri (0.091, 0.128, 0.182). Thus, since genetically related languages possess certain similarly frequent words by order and rank, the four tokens considered above strengthen an assertion that Bhojpuri and Magahi are genetically related languages.