Compositional Sentence Representation from Character within Large Context Text
Table 3: Reconstruction performance of the RNN Encoder-Decoder on words in the vocabulary and out-of-vocabulary (OOV). The length column presents the mean and the standard deviation (in parentheses) of character length of words for which complete reconstruction failed.
['Model', 'In Vocabulary CPER (%)', 'In Vocabulary WRFR (%)', 'In Vocabulary Length', 'Out of Vocabulary CPER (%)', 'Out of Vocabulary WRFR (%)', 'Out of Vocabulary Length']
Overall, the model almost perfectly reconstructs character sequences of training data, and even generalizes well for the unseen words. The large size model outperforms the small size model. Almost all cases in which reconstruction failed involved sequences longer than 12 characters on average.