Dialogue Learning With Human-in-the-Loop
Table 5: Fully Supervised (Imitation Learning) Results on Human Questions
['Train data size', '1k', '5k', '10k', '20k', '60k']
For comparison purposes, we also ran a supervised (imitation learning) MemN2N on different sized training sets of turker authored questions with gold annotated labels (so, there are no numerical rewards or textual feedback, this is a pure supervised setting). They indicate that RBI+FP and even FP alone get close to the performance of fully supervised learning.