BP-Transformer: Modelling Long-Range Context via Binary Partitioning
Table 7: BLEU score on newstest 2014
['Model', 'BLEU']
In the setting of k=2 and k=4, BPT outperforms Vanilla Transformer with the same number of parameters and a sparse attention pattern.