Learning to generate one-sentence biographies from Wikidata
Table 3: bleu scores for each hypothesis against the Wikipedia reference
['[EMPTY]', 'dev', 'test']
Scores are similar across dev and test, indicating that the samples are of comparable difficulty. We evaluate significance using bootstrapped resampling with 1,000 samples. Each system result lies outside the 95% confidence intervals of other systems. base has reasonable scores at 21, with s2s higher at around 32, indicating that the model is at least able to generate closer text than the baseline. s2s+ae scores higher still at around 41, roughly double the baseline scores, indicating that the autoencoder is indeed able to constrain the model to generate better text.