Detecting Perceived Emotions in Hurricane Disasters
Table 8: Hyperparameters for the baseline modeling experiments (§5).
['[EMPTY]', 'Logistic Reg.', 'Word CNN', 'Char CNN', 'GRU', 'BERT', 'RoBERTa']
For our pre-trained models (e.g., BERT and RoBERTa), we use the default dropout rate (0.1) on the self-attention layers, but do not use additional dropout on the top linear layer. Furthermore, we use gradient accumulation to enable training with larger mini-batches.