Assessing the Bilingual Knowledge Learned by Neural Machine Translation Models
Table 2: Results of NMT models of different capacities.
['[BOLD] Model', '[BOLD] NMT  [ITALIC] #Para', '[BOLD] NMT  [ITALIC] BLEU', '[BOLD] Phrase Table  [ITALIC] Size', '[BOLD] Phrase Table  [ITALIC] BLEU']
We vary the layer dimensionality of Transformer, and obtain three model variants: Small (256), Base (512), and Big (1024). However, the extracted phrase table is only marginally increased.