Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss
Table 5: Performances on naturalness.
['Model', 'Naturalness']
Human evaluation is important for generated questions. Following \newciteN18-1020, we sample 100 questions from each system, and then two annotators measure the naturalness by a score of 0-5. The Kappa coefficient for inter-annotator is 0.629, and p-value for all scores is less than 0.005.