Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning
Table 7: Zero-shot evaluation by following Davison et al. (2019).
['[BOLD] Method', '[BOLD] F1 Score']
To explore whether GLM can indeed learn the structured information from raw text, we conduct a zero-shot evaluation on CKBC by following Davison et al. For fair comparison, we re-train the GLM (BERT-large) on a new corpus in which all raw texts containing the CKBC testing pairs are discarded. Our augmented pre-trained language model significantly outperforms its baseline, which demonstrates our model’s capability of retaining structured information in a language model.