Consistent CCG Parsing over Multiple Sentences for Improved Logical Reasoning
Table 2: RTE results using ccg2lambda on JSeM
['[BOLD] Method', '[BOLD] Accuracy', '[BOLD] Precision', '[BOLD] Recall']
The RTE performance for Japanese language has improved consistently across all the scores when we add an MRF. However all the scores with depccg (with or without MRF) lag behind the scores reported in Mineshima et al. We hypothesize that this is due to the fact that the previous work created the semantic templates for this language by analyzing parse outputs by Jigg and this resulted in a kind of “overfitting” in the templates.