A Shared Task on Bandit Learning for Machine Translation
Table 3: Cumulative rewards over the full training sequence. Only completely finished submission are shown.
['[EMPTY]', '[BOLD] model', '[BOLD] cumulative']
Of the non-oracle systems, good results are obtained by static SMT and BNMT system, while the best performance is obtained by the UMD-domain adaptation system which is also basically a static system. This result is followed closely by the online bandit learner BNMT-EL which is based on an NMT baseline and optimizes the EL objective. It outperforms the BNMT-static baseline. Cumulative rewards could not be computed for all submitted systems since some training runs could not be fully finished.