Speaker-change Aware CRF for Dialogue Act Classification
Table 4: Average accuracy (%) of our model vs. base model on the 10 DAs best and worst predicted by our model (resp. representing 20% and 40% of all annotations).
['[EMPTY]', 'Ours', 'Vanilla', 'Diff.']
Relative differences. Thus, when it improves performance, our model does so with a greater margin than when it decreases performance. This fact is hidden when simply looking at the global accuracy over the 42 DA labels, because the 10 best DAs for our model only correspond to 20.2% of all annotations, whereas the 10 worst account for almost 40% of all annotations.