Learning Meta-Embeddings by Using Ensembles of Embedding Sets
Table 4: POS tagging results on six target domains. “baselines” lists representative systems for this task, including FLORS. “+indiv / +meta”: FLORS with individual embedding set / meta-embeddings. Bold means higher than “baselines” and “+indiv”.
['[EMPTY]', '[EMPTY]', 'newsgroups ALL', 'newsgroups OOV', 'reviews ALL', 'reviews OOV', 'weblogs ALL', 'weblogs OOV', 'answers ALL', 'answers OOV', 'emails ALL', 'emails OOV', 'wsj ALL', 'wsj OOV']
Following conclusions can be drawn. (i) Not all individual embedding sets are beneficial in this task; e.g., HLBL embeddings make FLORS perform worse in 11 out of 12 cases. (ii) (iii) Meta-embeddings generally help more than the individual embedding sets, except for SVD (which only performs better in 3 out of 12 cases).