Cloze-driven Pretraining of Self-attention Networks
Table 4: Penn Treebank Constituency Parsing results. Test result was evaluated on parameter set with the best dev F1.
['[BOLD] Model', '[BOLD] dev F1', '[BOLD] test F1']
Here, fine tuning is required to achieve gains over the previous state of the art, which used ELMo embeddings.