Paraphrase Thought: Sentence Embedding Module ImitatingHuman Language Recognition
Table 6: Experimental results for the STS Benchmark task
['[BOLD] Model', '[BOLD] Pearson']
We conducted the experiment in the same manner as for InferSent. For two sentence vectors u and v, the component-wise product u⋅v and the absolute difference |u−v| are computed and concatenated to be used as an input. As the target, the human rated similarity score y is transformed as follows. Let rT=[1,...,5] denote a vector that takes integer values between 1 and 5. The target y is transformed to the distribution d using the equation below: di=⎧⎨⎩y−⌊y⌋,if i=⌊y⌋+1,⌊y⌋+1,if i=⌊y⌋,0otherwise. (13) Finally, we trained a logistic regression model that predicts the transformed target d from the sentence pair representations of the training dataset.