Generating Sentences by Editing Prototypes
Table 1: Perplexity of NeuralEditor with the two VAE parameters κ outperform all methods on Yelp and all non-ensemble methods on BillionWord.
['Model', 'Perplexity (Yelp)', 'Perplexity (BillionWord)']
To evaluate NeuralEditor’s perplexity, we use linear smoothing with NLM to account for rare sentences not within our Jaccard distance threshold. We find NeuralEditor improves perplexity over NLM and KN5. On Yelp, we surpass even the best ensemble of NLM and KN5, while on BillionWord we nearly match their performance. Comparing with the synonym substitution model, we find both models have high plausibility, since synonym substitution maintains most of the words, but low grammaticality compared to both NeuralEditor and the NLM.