[
Table 5: Model performance by F-score, comparing HBMP to InferSent (Conneau et al. 2017) (our implementation).
['[EMPTY]', 'SNLI  [BOLD] HBMP', 'SNLI  [BOLD] InferSent', 'MultiNLI-m  [BOLD] HBMP', 'MultiNLI-m  [BOLD] InferSent', 'MultiNLI-mm  [BOLD] HBMP', 'MultiNLI-mm  [BOLD] InferSent', 'SciTail  [BOLD] HBMP', 'SciTail  [BOLD] InferSent']
This analysis shows that our model leads to a significant improvement over the outcome of the non-hierarchical model from previous work in almost all categories on all the three benchmarks. The only exception is the entailment score on SciTail, which is slightly below the performance of InferSent.