WiSeBE: Window-based Sentence Boundary Evaluation
Table 4: Independent multi-reference evaluation
['Transcript', 'System', '[ITALIC] ref1 P', '[ITALIC] ref1 R', '[ITALIC] ref1 F1', '[ITALIC] ref2 P', '[ITALIC] ref2 R', '[ITALIC] ref2 F1', '[ITALIC] ref3 P', '[ITALIC] ref3 R', '[ITALIC] ref3 F1', '[ITALIC] mean P', '[ITALIC] mean R', '[ITALIC] mean F1']
If we focus on F1 scores, performance of both systems varies depending of the reference. For ref1, S1 was better in 5 occasions with respect of S2; S1 was better in 2 occasions only for ref2; S1 overperformed S2 in 3 occasions concerning ref3 and in 4 occasions for mean (bold).