From Paraphrase Database to Compositional Paraphrase Model and Back
Table 7: Average absolute error of addition and RNN models on different ranges of gold scores.
['Score Range', '+', 'RNN']
The RNN performs better (has lower average absolute error) for less similar pairs. Vector addition only does better on the most similar pairs. This is presumably because the most positive pairs have high word overlap and so can be represented effectively with a simpler model.