P-SIF: Document Embeddings Using Partition Averaging
Table 13: STS 2012 MSRVid example where the P-SIF scores were closer to the ground truth, whereas SIF scores were more away from the ground truth
['sentence1', 'sentence2', 'GT', 'NGT', 'SIF [ITALIC] sc', 'P-SIF [ITALIC] sc', 'SIF [ITALIC] err', 'P-SIF [ITALIC] err', 'Diff [ITALIC] err', 'Rel [ITALIC] err']
MSRvid dataset where SIF assigns a similarity score closer to the ground truth than P-SIF. GT: represents the given ground truth similarity score in a range of 0-5. NGT : represents the normalized ground truth similarity score. NGT is obtained by dividing the GT score by 5 so that it is in a range of 0-1. SIFsc : represents the SIF embedding similarity score in a range of 0-1. P-SIFsc: represents the P-SIF embedding similarity score in a range of 0-5. SIFerr: represents absolute error ∥SIFsc−NGT∥ between normalized ground truth similarity score and the SIF embedding similarity score. P-SIFerr: represents the absolute error ∥\textscP−SIFsc−NGT∥ between the ground truth similarity score and the P-SIF embedding similarity score. Differr: represents absolute difference between SIFerr and P-SIFerr. Examples where P-SIF performs better Differr = Examples where SIF performs better Differr = Relerr: represents relative difference between SIFerr and P-SIFerr.