Testing Pre-trained Transformer Models for Lithuanian News Clustering
TABLE I: Difficulty of the most popular NLP evaluation datasets
['[BOLD] Dataset  [BOLD] Name', '[BOLD] Dataset  [BOLD] Year', '[BOLD] Score  [BOLD] Initial', '[BOLD] Score  [BOLD] Current', '[BOLD] Score  [BOLD] Human', '[BOLD] Score  [BOLD] Type']
Currently every top scoring model is of Transformer architecture. These datasets were among the most popular to evaluate new Transformer models and showed the effectiveness of this new architecture.