Learning Semantic Textual Similarity from Conversations
Table 4: Pearson’s r of the proposed models on the STS Benchmark with a breakdown by category.
['[EMPTY]', 'dev all', 'dev captions', 'dev forums', 'dev news', 'test all', 'test captions', 'test forums', 'test news']
To better understand the differences between the proposed models, we compare the Reddit and Reddit+SNLI models in more detail, by breaking down the evaluation of STS Benchmark into different categories. In the test set, there are 625, 500, and 254 sentences pairs for image-captions, news and forums, respectively.