Taking a Stance on Fake News: Towards Automatic Disinformation Assessment via Deep Bidirectional Transformer Language Models for Stance Detection
Table 4: Effect of maximum sequence length of RoBERTa model on weighted accuracy and classification accuracy.
['Maximum Number of Tokens', '[ITALIC] Accw', 'Acc']
We find an increase in accuracy with a longer maximum sequence length, as more context is provided to the model. We cannot increase the length of the input sequence beyond 512 tokens without training the RoBERTa model from scratch, which is not feasible for us.