Improving Natural Language Inference Using External Knowledgein the Science Questions Domain
Table 3: Results using match-LSTM+GconAttn with different knowledge sources on SciTail dev set.
['Knowledge Sources', 'Accuracy']
The types of relationships between concepts in DBpedia are factual and derived from Wikipedia. Based on qualitative analysis of these relationships, we found that they may not be suitable for NLI datasets, and specifically SciTail. On the other hand, we found that, ConceptNet with its 40 relationships expressing common sense knowledge may be more suitable. In order to quantitatively select the right knowledge source, we determined the impact of the each knowledge graph on SciTail. We created the Concepts Only graph from each of the available external knowledge sources, and evaluated them using our match-LSTM+GconAttn model on the dev set of SciTail.