Exploring the Combination of Contextual Word Embeddings and Knowledge Graph Embeddings
Table 7: Results of the relation prediction experiment
['[BOLD] Model', '[BOLD] MRR', '[BOLD] Precision (MAP@k=1)']
Again, this is in line with our starting hypothesis Contrary to our initial hypothesis however, the performance of the concatenated representation performs poorer than contextual word embeddings in the same task – the MRR for the former is 1.2 percentage points below that of the latter. One factor for the poorer result of the concatenated representation is that it may carry duplicated information that is found in both the KG and contextual word embeddings.