Prior Knowledge Driven Label Embedding for Slot Filling in Natural Language Understanding
TABLE VI: Slot F1 scores on DSTC3 test set without the training data of DSTC2, but with different pre-trained language models.
['[BOLD] Method', 'pre. word emb.', 'ELMo', 'BERT']
However, it is orthogonal to the investigation of label embeddings. The reason may be that ELMo could get better generalization for the dataset by using char-based word embeddings.