Direct Output Connection for a High-Rank Language Model
Table 11: Bracketing F1 scores on the PTB test set (Section 23). This table includes reranking models trained on the PTB without external data.
['Model', 'F1 Base', 'F1 Rerank']
This table is divided into three parts by horizontal lines; the upper part describes the scores by single language modeling based rerankers, the middle part shows the results by ensembling five rerankers, and the lower part represents the current state-of-the-art scores in the setting without external data. The upper part also contains the score reported in \newcitechoe-charniak:2016:EMNLP2016 that reranked candidates by the simple LSTM language model. Moreover, AWD-LSTM-DOC outperformed AWD-LSTM and AWD-LSTM- MoS.