Guessing What’s Plausible But Remembering What’s True: Accurate Neural Reasoning for Question-Answering
Table 3: Recall of set-follow operation with joint training vs. single task.
['[EMPTY]', 'k=1', 'k=10', 'k=100', 'k=1000']
We also report here the maximum recall obtainable by retrieving k results. Joint training improves performance at all values of k, and brings performance close to the theoretical optimum. The benefits of joint training are most likely due to the fact that the requirement of coherency for embeddings is shared by all operations.