[
Table 12: Transfer learning test results for the HBMP model on a number of SentEval downstream sentence embedding evaluation tasks. InferSent and SkipThought results as reported by Conneau et al. (2017). To remain consistent with other work using SentEval, we report the accuracies as they are provided by the SentEval library.
['[BOLD] Task', '[BOLD] InferSent', '[BOLD] SkipThought', '[BOLD] 600D HBMP', '[BOLD] 1200D HBMP']
We used the SentEval library with the default settings recommended on their website, with a logistic regression classifier, Adam optimizer with learning rate of 0.001, batch size of 64 and epoch size of 4. Our 1200D model outperforms the InferSent model on 7 out of 10 tasks. The model achieves higher score on 8 out of 9 tasks reported for SkipThought, having equal score on the SUBJ dataset. No MRPC results have been reported for SkipThought.