Real or Fake? Learning to Discriminate Machine from Human Generated Text
Table 10: Hyper-parameter values used in our scoring functions.
['[EMPTY]', 'max lr', 'bsz (per GPU)', 'GPUs', 'fp16', 'warmup steps', 'max steps']
Training is stopped after processing 2.5M samples without any improvement on the validation set. We use data-parallel synchronous multi-GPU training with up to 8 nodes, each with 8 Nvidia V100 GPUs.