Semantic Parsing to Probabilistic Programs for Situated Question Answering
Table 3: Accuracy of P3 when trained and evaluated with labeled logical forms, food webs, or both.
['Model', 'Accuracy', 'Δ']
Our third experiment analyses sources of error by training and evaluating P3 while providing the gold logical form, food web, or both as input. The final entry shows the maximum accuracy possible given our domain theory and answer selection. The larger accuracy improvement with gold food webs suggests that the execution model is responsible for more error than semantic parsing, though both components contribute.