What Level of Quality can Neural Machine Translation Attain on Literary Text?
Table 6: TTR, average sentence length and 4-gram overlap for the source side of the 12 novels that make up the test set. The highest TTR and average sentence length as well as the lowest n-gram overlap values are shown in bold.
['[BOLD] Novel', '[BOLD] TTR', '[BOLD] avg. sentence', '[BOLD] Overlap']
We can clearly observe an outlier in the data for all the three variables reported. Ulysses has the highest TTR by far at 0.276 and is also the novel with the lowest overlap by a wide margin (0.216). As for sentence length, the value for Sunset Park (32.434) is over 10 points higher than the value for any other novel.