Simple and Effective Semi-Supervised Question Answering
Table 3: 5-fold cross-validation results on BioASQ Task 5b. ∗Our SL experiments showed better performance than what was reported in (Wiese et al., 2017).
['Method', 'Factoid MRR', 'List F1']
we again see a significant improvement when pretraining with the cloze questions over the supervised baseline. The improvement is smaller than what we observe with SQuAD and TriviaQA datasets – we believe this is because questions are generally more difficult in BioASQ. Wiese et al. Here, we show a much larger improvement by pretraining on cloze questions constructed in an unsupervised manner from the same domain.