Studio Ousia’s Quiz Bowl Question Answering System
Table 2: Results for Neural Type Predictor.
['Model Name', 'Metric', 'Sent 1', 'Sent 1–2', 'Sent 1–3', 'Full']
The coarse-grained model performed very accurately; the accuracies exceeded 95% for incomplete questions and 98% for full questions. The fine-grained model also achieved good results; its Precision@1 scores were comparable to the accuracies of the coarse-grained model. However, the model suffered when it came to predicting all the fine-grained entity types, resulting in the relatively degraded performance in its accuracy and its F1 score.