Multi-Perspective Inferrer:Reasoning Sentences Relationship from Holistic Perspective
Table 3: Ablation studies of auxiliary loss on MultiNLI development sets.
['[BOLD] Auxiliary Loss', '[BOLD] SMPI', '[BOLD] IMPI']
It reveals that our auxiliary loss ensures that the representation of each perspective is associated with the corresponding relationship. acc=1|L|⋅NN∑n=1∑l∈L1(p(l|vnl)==l). (25) The auxiliary loss improves the performance of the MPIs. Results in the second line are the performance of two MPIs with the introduced supervision loss, which achieve the best accuracy. After removing the auxiliary loss, we find the performance of both two MPIs degrade to 78.7/78.4 and 78.6/78.4, which means the guided loss ensures the representation of each perspective.