Memory-augmented Dialogue Management for Task-oriented Dialogue Systems
Table 9. Prediction accuracy on the departure city and arrive city slots. The number in bracket is the accuracy at the session level, and that without bracket at the turn level.
['Metrics', 'Departure-City', 'Arrive-City']
To verify the model’s ability to combine context information in slot filling, we further analyzed the prediction accuracy on the Departure_City slot and the Arrive_City slot. The results drop dramatically when removing the slot-value memory (RNN and MAD-EM). For MEM, although its accuracy is higher than that of RNN and MAD-EM, it’s still much lower than our proposed model. This is because that 1) the city number is too large for MEM to predict, and 2) MEM fails to identify which slot the value belongs to.