A Large Scale Corpus of Gulf Arabic
Table 6: Results on evaluation of our Gold annotation against the output of MADAMIRA in both modes: MSA and EGY
['[BOLD] Feature', '[BOLD] MADAMIRA-MSA', '[BOLD] MADAMIRA-EGY']
We evaluated using the accuracy measure for word orthography, morphemic tokenization, POS, CATiB POS and lemma against the output of both models of MADAMIRA: MSA and EGY. These numbers allow us to assess the basic quality of the these tools on GA. As expected, MADAMIRA-EGY outperforms MADAMIRA-MSA between 4 and 13% absolute on different metrics, confirming that it is better to use it as a baseline. This is similar to results reported by \newcitejarrar2014building on Palestinian Arabic.