Finnish Language Modeling with Deep Transformer Models
TABLE IV: BERT Test performance
['Model', 'Pseudo perplexity']
The pseudo-perplexity values of left-marked are lower when compared to left-right-marked signifying that it is more confident.