Harnessing Code Switching to Transcend the Linguistic Barrier
Table 6: Confusion matrix of token-level performance evaluation of ^L\emphpolyglot on 300 annotated comments from Dhe∪D\emphen.
['[EMPTY]', '[EMPTY]', 'Predicted Label  [ITALIC] neutral', 'Predicted Label  [ITALIC] en', 'Predicted Label  [ITALIC] he']
On a data set of 300 comments with gold standard token-level annotation, we found that ^L\emphpolyglot performs token-level language detection with considerable accuracy.