Toward Fast and Accurate Neural Discourse Segmentation
Table 3: Performance of our model over different attention window size
['Window Size', '1', '5', '10', '∞']
We propose to restrict the self-attention within a neighborhood instead of the whole sequence. However, a proper restriction window is helpful for the attention mechanism to take better effect.