Improving Semantic Parsing for Task Oriented Dialog
Table 6: LM re-ranking with ELMo.
['Method', 'Accuracy']
Based on the analysis in the previous section, we combine the methods to seek further gains. We first try the ELMo + Ensemble combination. We use the average ELMo strategy and experiment with the three ensemble strategies. The combined gain confirms that the ensemble and ELMo work almost orthogonally and the combination results in about 28% error reduction compared to the base parser. We also experiment with adding the LM SVM re-ranking to the ELMo-enabled model. We observe that combined with ELMo, the LM re-ranking of the top beams still keeps most of its gains compared to the case without ELMo.