One Model to Learn Both: Zero Pronoun Prediction and Translation
Table 5: Translation results when transforming the contextual representation to decoder of different models. Incorporating discourse-level context does not always lead to improvement of translation performance.
['[BOLD] Model', '[BOLD] BLEU', '\\bigtriangleup']
However, this integration mechanism does not work well in “Baseline + ZP-Annotation” and our “Joint” models, which decreasing by -0.12 and -1.38 BLEU points, respectively. One potential problem with this strategy is that the propagation path is longer: {\bf C}\rightarrow{\bf h}^{dec}\rightarrow{\bf h}^{rec}\rightarrow{\bf zp}, which may suffer from the vanishing effect. This also confirms our hypothesis that discourse-level context benefits ZP prediction more than ZP translation. Therefore, we incorporate the discourse-level context into reconstructor instead of the decoder.