Unsupervised Grammar Induction with Depth-bounded PCFG
Table 6: Published PARSEVAL results for competing systems. Please see text for details as the systems are trained and evaluated differently.
['System', 'WSJ10 Precision', 'WSJ10 Recall', 'WSJ10 F1', 'WSJ40 Precision', 'WSJ40 Recall', 'WSJ40 F1']
The CCL results come from \newciteSeginer2007, where the CCL system is trained with all sentences from WSJ, and evaluated on sentences with 40 words or fewer from WSJ (WSJ40) and WSJ10. The UPPARSE results come from \newcitePonvert2011, where the UPPARSE system is trained using 00-21 sections of WSJ, and evaluated on section 23 and the WSJ10 subset of section 23. The DB-PCFG system uses hyperparameters optimized on the WSJ20dev set, and is evaluated on WSJ40 and WSJ10, both excluding WSJ20dev. The results are not directly comparable, but the results from the DB-PCFG system is competitive with the other systems, and numerically have the best recall scores.