Explaining Question Answering Models through Text Generation
Table 10: Results of End2End compared to our model (with GS and ST variants) on hypernym extraction.
['Model', 'Accuracy']
We report results on the synthetic hypernym extraction task with and without the Gumbel-softmax trick and the ST estimator. We observe that the ST estimator is crucial even on such a simple task, which aligns with prior observations havrylov2017emergence that ST helps overcome the discrepancy between training time and test time. GS improved results without ST, but had little effect with ST.