Reconstruction of Word Embeddings from Sub-Word Parameters
Table 1: Effect of reconstruction on word similarity: the teacher word embeddings obtain score 0.50.
['metric', 'number of reconstruction epochs 0', 'number of reconstruction epochs 10', 'number of reconstruction epochs 20', 'number of reconstruction epochs 30', 'number of reconstruction epochs 50']
The teacher word embeddings obtain 0.5. The sub-word model improves performance from the initial score of 0.03 up to 0.16.