Exploring Heterogeneous Information Networks via Pre-Training
TABLE VIII: Ablation analysis over transformer encoders.
['Model', 'LR AUC', 'LR F1', 'SS AUC', 'MC MIC-F1', 'MC MAC-F1', 'NC NMI', 'NC ARI']
We could observe that CNN, LSTM and attention mechanism based models achieve comparable results on four tasks. However, PF-HIN consistently outperforms all the traditional deep neural network models, which further proves that our bi-directional transformer encoders’ advancement on mining the information behind a HIN.