Applying a Pre-trained Language Model to Spanish Twitter Humor Prediction
Table 1: LM Training Parameters
['Param', 'LM', 'Fine-Tune LM']
For all networks we applied a dropout multiplier which scales the dropout used throughout the network. We used the Adam optimizer with weight decay as indicated in the table.