Sentence Embedding Alignment for Lifelong Relation Extraction
Table 2: This table shows the accuracy on the whole test data (”Whole” column), and average accuracy on all observed tasks (”Avg” column) after the last time step. The average performance of 5 runs are listed here and the best result on each dataset is marked in bold.
['Method', 'FewRel Whole', 'FewRel Avg', 'SimpleQuestions Whole', 'SimpleQuestions Avg']
S6SS2SSS0Px2 Results on FewRel and SimpleQuestions We run each experiment 5 times independently by shuffling sequence of tasks, and the average performance is reported. From the results, we can see that EWC and GEM are better than the Origin baseline on both two datasets, which indicates that they are able to reduce the catastrophic forgetting problem. However, our EA-EMR perform significantly better than these previous state-of-the-arts. The proposed EMR method itself achieves better results than all baselines on both datasets. The ablation study shows that both the selection and the alignment modules help on both tasks.