An End-to-end Approach for Handling Unknown Slot Values in Dialogue State Tracking
Table 4: Accuracy of predicting regular and OOV food and location parameters in bAbI (Task 5) API calls w/ (p=0.1) and w/o (p=0) targeted dropout.
['[EMPTY]', '[BOLD] Regular Test p=0', '[BOLD] Regular Test p=0.1', '[BOLD] OOV Test p=0', '[BOLD] OOV Test p=0.1']
While the dataset is quite artificial and in most cases we can achieve perfect accuracy on the regular test set, the OOV parameter values are not nearly as easy to predict. The targeted dropout however, allows us to bridge the accuracy gap entirely.