Continuously Learning Neural Dialogue Management
Table 1: Model performance based on F-measure.
['[BOLD] Output', 'DiaAct', 'Query', 'Offer']
We can clearly see that the model accurately determines the type of reply (DiaAct) and generally provides the right information (Offer). The hypothesised reason for the lower accuracy of Query is that the SL training data contains robust ASR results and thus the system examples contain more offers and less queries. This can be mitigated with a larger dataset covering more diverse situations, or improved via an RL approach.