Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering
Table 3: Comparison of distant supervision hypotheses using MML-Pos objectives on TriviaQA and NarrativeQA dev sets.
['Objective', 'Infer', 'TriviaQA F1', 'TriviaQA EM', 'NarrativeQA Rouge-L']
In this subsection, we compare probability space and distant supervision assumptions. The performance of models with both Max and Sum inference is shown. We report F1 and Exact Match (EM) scores for TriviaQA, and Rouge-L scores for NarrativeQA.