Data Ordering Patterns for Neural Machine Translation: An Empirical Study
Table 2: Comparing performance of data ordering patterns based on sorted perplexity and BLEU score from 2 different pre-trained models. Here PPL, Asc and Desc refer to perplexity, ascending order and descending order respectively. Epochs refers to number of epochs required for convergence.
['Pre-Trained Model', 'Data Pattern', 'Epochs', 'BLEU']
We evaluate the performance of the data ordering sorted based on perplexity and BLEU score from 2 different pre-trained models and show empirically that a smaller trained model is able to provide comparable performance gains to a larger trained model for these 2 data ordering strategies.